Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AUTO] Update data #223

Merged
merged 4 commits into from
Nov 5, 2024
Merged

[AUTO] Update data #223

merged 4 commits into from
Nov 5, 2024

Conversation

PietrH-bot
Copy link
Collaborator

Brief description

This is an automatically generated PR.
The following steps are all automatically performed:

  • Fetch raw data
  • Map raw data to DwC standard and save the output in ./data/processed
  • Get an overview of the changes
  • Run some tests, e.g. check the uniqueness of occurrenceID, check that all occurrences have a eventID and scientificName, ...

Note to the reviewer: the workflow automation is still in a development phase. Please, check the output thoroughly before merging to main. In case, improve the data fecthing fetch_data.Rmd, the mapping dwc_mapping.Rmd, both in ./src or the GitHub workflows fetch-data.yaml and mapping_and_testing.yaml in ./.github/workflows.

Files changed:
M	data/processed/occurrence.csv
@PietrH
Copy link
Member

PietrH commented Oct 22, 2024

Test failed: New species!

@PietrH
Copy link
Member

PietrH commented Oct 22, 2024

Saururus cernuus

@PietrH
Copy link
Member

PietrH commented Oct 22, 2024

34682 removed lines

Copy link
Member

@PietrH PietrH left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Asked for clarification at RATO, 24k+ cases removed, many species, between 2021 and 2024

This was referenced Oct 29, 2024
@PietrH
Copy link
Member

PietrH commented Nov 5, 2024

2741 new records, 3 deleted records.

16 species:

scientificName n
Rattus norvegicus 1412
Vespa velutina 718
Ondatra zibethicus 297
Felis catus domestica 123
Columba livia domestica 71
Muridae 52
Castor fiber 26
Psittacula krameri 15
Martes foina 9
Talpa europaea 9
Hydrocotyle ranunculoides 2
Myriophyllum aquaticum 2
Trachemys scripta 2
Branta canadensis 1
Oryctolagus cuniculus 1
Saururus cernuus 1

On 20 days:

date n
2024-11-04 352
2024-10-21 260
2024-10-25 217
2024-10-22 200
2024-10-30 190
2024-10-24 189
2024-10-28 187
2024-10-31 177
2024-10-23 166
2024-10-15 164
2024-10-29 160
2024-10-16 124
2024-11-05 124
2024-10-18 121
2024-10-17 104
2024-11-01 2
2024-06-12 1
2024-09-04 1
2024-09-11 1
2024-09-25 1

@PietrH
Copy link
Member

PietrH commented Nov 5, 2024

The missing records magically re-appeared again. I never found out where they went.

@PietrH PietrH merged commit 33377e5 into main Nov 5, 2024
1 check passed
@PietrH PietrH deleted the automatic-update-2024-10-22T03-33-31Z branch November 5, 2024 14:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants