Skip to content

Commit

Permalink
Merge pull request #4969 from NewAgeAirbender/ga_bills
Browse files Browse the repository at this point in the history
GA: add agenda as dedupe_key
  • Loading branch information
NewAgeAirbender authored Jun 17, 2024
2 parents eeb1317 + cbf6a74 commit 33dbbbc
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions scrapers/ga/events.py
Original file line number Diff line number Diff line change
Expand Up @@ -70,6 +70,7 @@ def scrape(self, start=None):
event.add_document(
"Agenda", row["agendaUri"], media_type="application/pdf"
)
event.dedupe_key = row["agendaUri"]
# Scrape bill ids from agenda pdf
try:
for bill_id in Agenda(source=URL(row["agendaUri"])).do_scrape():
Expand Down

0 comments on commit 33dbbbc

Please sign in to comment.