Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

implement serializable to archive GEAR scrape results #18

Open
Hunter-Buckhorn opened this issue Mar 11, 2016 · 1 comment
Open

implement serializable to archive GEAR scrape results #18

Hunter-Buckhorn opened this issue Mar 11, 2016 · 1 comment

Comments

@Hunter-Buckhorn
Copy link

Currently, the program scrapes the GEAR each time it runs.

Have the GEAR-scraper class implement Serializable and add in a way to check to see if we are in the correct year of GEAR before scraping the URL.
If we are: load the serialized data for the year if it exists.
If we are not: scrape from the GEAR url and serialize this data.

Save the serialized data by year so that previous years of GEAR can be found and loaded if they have been serialized and saved before.

Estimated 200 points.

@arda-
Copy link
Contributor

arda- commented Mar 11, 2016

W16 OK

@Hunter-Buckhorn Hunter-Buckhorn changed the title implement serializable to archive GEAR scape results implement serializable to archive GEAR scrape results Mar 11, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants