Skip to content
This repository has been archived by the owner on Dec 25, 2023. It is now read-only.

Adding changes in LTC to new branch #7

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

TKosfeld
Copy link

@TKosfeld TKosfeld commented Feb 8, 2022

Submission of date comparison automation for acquiring LTC data. As of now the program queries the user for uuid submission. From someone working mostly on windows in a different directory I worked to eliminate any remnants of my computer specific settings, but please let me know if something remains.

Thanks,
Tim

@chris-prener
Copy link
Member

thanks @TKosfeld! I'll have to see how this works... can you write up a minimal .R script that shows me the workflow?

@TKosfeld
Copy link
Author

Updated with edge case handling (missing data file) and added a demonstration script in main folder.
Thanks,
Tim

@chris-prener
Copy link
Member

hey @TKosfeld - this is good! A lot of hard work in here for sure. My struggle is that I still have to go to the website to get the unique ID code, and then the download process is longer than it takes to download the national file manually. Thoughts?

@TKosfeld
Copy link
Author

TKosfeld commented Apr 8, 2022

I hope these new updates can help to address both the uuid and timing issue.

The single ltc function has been reworked into 3 functions in an effort to reduce time heavy R loops. My system.time() estimates placed this new function set at ~2.5 minutes in comparison to ~5 minutes with the previous code.

New scraping has been included to pull uuid as well.

Small changes have been made to column naming due to the removal of suspected case columns from the data (I confirmed the columns were missing with a manual data download).

Description of functions and new scraping tutorial have been added to ltc_README.txt.

@chris-prener
Copy link
Member

This is great @TKosfeld - thanks for your patience! I'll be using this in my COVID work moving forward when I use LTC data. Thanks so much!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants