Skip to content

Commit

Permalink
Merge pull request #5014 from NewAgeAirbender/ga_bills
Browse files Browse the repository at this point in the history
GA: add date to dedupe key
  • Loading branch information
NewAgeAirbender authored Aug 26, 2024
2 parents 39d4175 + 4da3c6b commit e6033d6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scrapers/ga/events.py
Original file line number Diff line number Diff line change
Expand Up @@ -70,7 +70,7 @@ def scrape(self, start=None):
event.add_document(
"Agenda", row["agendaUri"], media_type="application/pdf"
)
event.dedupe_key = row["agendaUri"]
event.dedupe_key = f'{row["agendaUri"]}#{start}'
# Scrape bill ids from agenda pdf
try:
for bill_id in Agenda(source=URL(row["agendaUri"])).do_scrape():
Expand Down

0 comments on commit e6033d6

Please sign in to comment.