Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🏗️ Build spider: Illinois African Descent Citizens Reparations Commission #1059

Merged
merged 6 commits into from
Feb 12, 2024

Conversation

SimmonsRitchie
Copy link
Contributor

What's this PR do?

Adds a spider to scrape meetings from the website of Illinois African Descent Citizens Reparations Commission. The new spider is called il_adcrc.

Why are we doing this?

Requested by City Bureau's Chicago office.

Steps to manually test

  1. Ensure the project is installed:
pipenv sync --dev
  1. Activate the virtual env and enter the pipenv shell:
pipenv shell
  1. Run the spider:
scrapy crawl il_adcrc -O test_output.csv
  1. Monitor the output and ensure no errors are raised.

  2. Inspect test_output.csv to ensure the data looks valid. Target website is here.

Are there any smells or added technical debt to note?

@SimmonsRitchie SimmonsRitchie marked this pull request as ready for review February 6, 2024 20:19
@SimmonsRitchie SimmonsRitchie requested a review from a team February 6, 2024 20:19
Copy link

@LienDang LienDang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@SimmonsRitchie SimmonsRitchie merged commit f451a7f into main Feb 12, 2024
2 checks passed
@SimmonsRitchie SimmonsRitchie deleted the adcrc branch February 12, 2024 15:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants