Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AUTO] Update data #50

Merged
merged 2 commits into from
Aug 7, 2023
Merged

[AUTO] Update data #50

merged 2 commits into from
Aug 7, 2023

Conversation

damianooldoni-bot
Copy link
Contributor

Brief description

This is an automatically generated PR.
The following steps are all automatically performed:

  • Fetch raw data
  • Map raw data to DwC standard and save the output in ./data/processed
  • Get an overview of the changes
  • Run some tests, e.g. check the uniqueness of occurrenceID, check that all occurrences have a eventID and scientificName, ...

Note to the reviewer: the workflow automation is still in a development phase. Please, check the output thoroughly before merging to main. In case, improve the data fecthing fetch_data.Rmd, the mapping dwc_mapping.Rmd, both in ./src or the GitHub workflows fetch-data.yaml and mapping_and_testing.yaml in ./.github/workflows.

Files changed:
M	data/raw/rato_data.csv
Files changed:
M	data/processed/occurrence.csv
@PietrH
Copy link
Member

PietrH commented Aug 7, 2023

The raw data reports species "Lettersierschildpad" with the correct gbif id, however in Opmerkingen there is mention of : 12/06: sabotage, 07/07: Zaagrugschildpad ( groot exemplaar), which is Graptemys sp.

This event has been in the dataset for a while, occurrences in current output:

type language license rightsHolder datasetID institutionCode datasetName basisOfRecord eventID occurrenceID recordedBy organismQuantity organismQuantityType occurrenceStatus samplingProtocol samplingEffort eventDate countryCode municipality verbatimLatitude verbatimLongitude verbatimCoordinateSystem verbatimSRS decimalLatitude decimalLongitude geodeticDatum coordinateUncertaintyInMeters scientificName kingdom taxonRank
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 428110 RATO 2 individual(s) present cage trap 1 cage trap 2023-05-19 13:07:41 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 430568 RATO 2 individual(s) present cage trap 1 cage trap 2023-05-22 11:42:24 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 437818 RATO 2 individual(s) present cage trap 1 cage trap 2023-05-26 10:42:52 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 438973 RATO 2 individual(s) present cage trap 1 cage trap 2023-05-30 08:42:31 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 444885 RATO 2 individual(s) present cage trap 1 cage trap 2023-06-02 09:20:24 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 446113 RATO 2 individual(s) present cage trap 1 cage trap 2023-06-05 10:13:53 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 451724 RATO 2 individual(s) present cage trap 1 cage trap 2023-06-08 12:47:56 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 455180 RATO 2 individual(s) present cage trap 1 cage trap 2023-06-12 13:00:05 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 462626 RATO 2 individual(s) present cage trap 1 cage trap 2023-06-19 11:20:37 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 471851 RATO 2 individual(s) present cage trap 1 cage trap 2023-06-26 12:25:41 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 477783 RATO 2 individual(s) present cage trap 1 cage trap 2023-06-30 13:48:12 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 487067 RATO 2 individual(s) present cage trap 1 cage trap 2023-07-07 13:04:32 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 492257 RATO 2 individual(s) present cage trap 1 cage trap 2023-07-14 20:23:27 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species
Event en http://creativecommons.org/publicdomain/zero/1.0/ RATO https://doi.org/10.15468/fw2rbx RATO RATO - Daily operations commissioned by the province East Flanders, Belgium HumanObservation 41583 498235 RATO 2 individual(s) present cage trap 1 cage trap 2023-07-24 09:38:24 BE Gent 198323.4 109641.6 Lambert coordinates Belgian Datum 1972 51.09361 3.79266 WGS84 30 Trachemys scripta Animalia species

In the raw data we can see only the last 3 records make mention of Graptemys sp.
image

There are probably more examples of vernacular names being mentioned in Opmerkingen, some of which might also not match the GBIF_Code provided.

For now, I will not make an exception and parse just these records to add a new species, but I'll create an issue to be discussed when everyone involved is back from holidays.

Copy link
Member

@PietrH PietrH left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

See issue #51

@PietrH PietrH merged commit 947873f into main Aug 7, 2023
@PietrH PietrH deleted the automatic-update-2023-08-07T09-12-16Z branch September 1, 2023 14:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants