Issue16

[ferrighi]

This is a major revision of harvestschemaorg.py. It should cover all elements defined in #16

This version should work in prod environment without addition of new modules.

Main points:

• comment out requests_html/extruct and extract_metadata function. Added a dedicated new function pangaeaapicall: endpoints will lazy loading are now not covered. This needs to be rewritten finding a better module/library.
• improving and extending mapping
• improving content validation (license and temporal element)
• add several checks on field type (dict/str/list) and their presence (many are optional fields)
• improving identifier/url extraction logics

Additional notes for future cleaning/improvements:

• extending supported vocabularies
• create logic to extract related_information/citation if presented as CreativeWork/Article
• add contributor field
• push prints into logging

[ferrighi]

I will add the feedback from pangaea before merging. Converting to draft.