Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Column names for gsheet feeder need checking + template sheet needs aligning #221

Open
pjrobertson opened this issue Feb 24, 2025 · 5 comments
Labels
documentation Improvements or additions to documentation

Comments

@pjrobertson
Copy link
Collaborator

  1. The column names for the gsheet_feeder need double checking that they align with the template sheet here: https://docs.google.com/spreadsheets/d/1NJZo_XZUBKTI1Ghlgi4nTPVvCfb0HXAs6j5tNGas72k/edit?gid=0#gid=0

I recommend changing the template sheet names to align with the columns set (unless they've changed in our rewrite?)

Also: The article here needs updating, it has quite a bit of outdated info: https://www.bellingcat.com/resources/2022/09/22/preserve-vital-online-content-with-bellingcats-auto-archiver-tool/

@pjrobertson pjrobertson added the documentation Improvements or additions to documentation label Feb 24, 2025
@msramalho
Copy link
Contributor

please close when the template sheet has been made consistent.

the article should/will get a revamp but let's not track that here.

@erinhmclark
Copy link
Collaborator

I've updated the naming to "Destination Folder" in the template, but there are a couple of other inconsistent columns too:

Items implemented in code but not added in the gsheet template:

  • Perceptual Hashes
  • WACZ
  • replaywebpage

I will add these into the template unless they were intentionally omitted?

Items in the template but no longer implemented:

  • Thumbnail Index
  • Duration

I will remove these two from the template as they were depreciated here:

ae3e607
c1a60fd

@msramalho
Copy link
Contributor

yup, please add all available to the template, and add a note like the other columns have.

@erinhmclark
Copy link
Collaborator

I've updated the columns in the template and code references in #225

One to check is the 'text content' value. This was still in the code but wasn't in the template. I added it back in, but maybe we removed this intentionally as it can have large amounts of content - can you remember/ do you have a preference for that?

@msramalho
Copy link
Contributor

Yeah, I think that is indeed why it was removed. But let's keep it so we have all available columns there. I modified it slightly to explain that and differentiate mandatory from optional columns.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

3 participants