Skip to content
This repository has been archived by the owner on Feb 8, 2023. It is now read-only.

AS Image scraper failing, can we switch to html? #61

Open
kdqed opened this issue Dec 8, 2021 · 1 comment
Open

AS Image scraper failing, can we switch to html? #61

kdqed opened this issue Dec 8, 2021 · 1 comment

Comments

@kdqed
Copy link
Collaborator

kdqed commented Dec 8, 2021

The image scraper for Assam is failing with the exception as shown below:

Traceback (most recent call last):
  File "scrapers.py", line 172, in <module>
    live_data = fetch_data(states_all[state_code])
  File "scrapers.py", line 125, in fetch_data
    return fn_map[st_obj['state_code'].lower()](st_obj)
  File "/home/kd/datakind-blr/scrapers/statewise_get_data.py", line 131, in as_get_data
    if int(linesArray[len(linesArray) - 1]) > 0:
ValueError: invalid literal for int() with base 10: ' 19 since the first patient was detected on 31st '

image

Also, one of the sources mentioned has HTML data: https://covid19.assam.gov.in/all-districts/. Can we use this for scraping instead of the image?

@kaizer1v
Copy link
Member

kaizer1v commented Feb 3, 2022

Since the htmls aren't regularly updated, it's not reliable to wait until they update it. Thus, volunteering team is using images

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants