Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for incremental list updates #68

Open
englehardt opened this issue Feb 1, 2019 · 1 comment
Open

Add support for incremental list updates #68

englehardt opened this issue Feb 1, 2019 · 1 comment
Labels
p3 Backlog

Comments

@englehardt
Copy link
Contributor

Dimi has confirmed that we have support for this in the platform. Apparently we may also have server-side support [0]. If that works, maybe we just need to update the shavar-list-creation script to generate new “add chunk”(trackers to add) and “sub chunk”(trackers to remove) accordingly.

This would allow us to quickly review and merge list updates, rather than worrying about batching them due to cost.

[0] https://github.com/mozilla-services/shavar/blob/master/shavar/lists.py#L188

@groovecoder
Copy link
Contributor

Another great idea ... may be some significant work and more meticulous release engineering to get this right.

E.g., we would have to tag versions in shavar-prod-lists when we release new list contents, and then we could use the version differences to generate the add & subtract chunks.

Will need some planning and design for sure.

@HarshitSohaney HarshitSohaney added the p3 Backlog label Aug 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
p3 Backlog
Projects
None yet
Development

No branches or pull requests

3 participants