Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Write the Django API functions to handle the requests to import data from the scraping scripts #13

Open
shi-jie-samuel-tan opened this issue Aug 29, 2020 · 0 comments

Comments

@shi-jie-samuel-tan
Copy link
Collaborator

Depending on the decision for issue #11, the Django API functions will work differently. If we have decided to not do a .exe file, we can just create one HTTP request function to initialize scraping and channeling the output from the scrapes directly into our database with Django's ORM model. If we decide to use a .exe file, we probably have to create multiple API functions to handle the output from the scraping differently depending on which source we scraped them from. ** The key idea behind the functions is to convert the json data into the django models before sending them into the database. We might include some logic behind how we will update key entities like providers and sites to solve the chicken-egg problems

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant