Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cometindex: speedup by committing event changes in batches of 1000 #4854

Merged
merged 2 commits into from
Sep 17, 2024
Merged

cometindex: speedup by committing event changes in batches of 1000 #4854

merged 2 commits into from
Sep 17, 2024

Commits on Sep 13, 2024

  1. cometindex: speedup by committing event changes in batches of 1000 

    Instead of creating one transaction for each event we need to index, we
instead only close this transaction every 1000 events (or when when
we've caught up to the database).

This gives about a 5x performance in catch up speed.
    @cronokirby
    cronokirby committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    71e84cc View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. cometindex: use relevant events as count for batching events

    @cronokirby
    cronokirby committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    21aca87 View commit details
    Browse the repository at this point in the history