Skip to content

Commit

Permalink
GA: add agenda as dedupe_key
Browse files Browse the repository at this point in the history
  • Loading branch information
NewAgeAirbender committed Jun 17, 2024
1 parent eeb1317 commit cbf6a74
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions scrapers/ga/events.py
Original file line number Diff line number Diff line change
Expand Up @@ -70,6 +70,7 @@ def scrape(self, start=None):
event.add_document(
"Agenda", row["agendaUri"], media_type="application/pdf"
)
event.dedupe_key = row["agendaUri"]
# Scrape bill ids from agenda pdf
try:
for bill_id in Agenda(source=URL(row["agendaUri"])).do_scrape():
Expand Down

0 comments on commit cbf6a74

Please sign in to comment.