Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bloom-compactor] Clean up work to create blooms #11591

Merged
merged 22 commits into from
Jan 5, 2024

Conversation

poyzannur
Copy link
Contributor

@poyzannur poyzannur commented Jan 5, 2024

What this PR does / why we need it:
This PR is the result of debugging sprint on bloom-compactor on a dev cell.
With these changes, compactor now can create and upload blooms and relevant meta files from scratch.

  • Queries tsdb correctly with empty matchers to get all series
  • Seeks to the beginning of the bloom data file before uploading
  • Adds uuid strings to local file name, as checksum is not available at the time of directory creation
  • Creates meta object with all fields populated
  • Additional logging

edit: confirmed that it runs as expected in the dev cell.

@poyzannur poyzannur requested a review from a team as a code owner January 5, 2024 13:49
Copy link
Contributor

github-actions bot commented Jan 5, 2024

Trivy scan found the following vulnerabilities:

  • HIGH, Target: docker.io/grafana/loki:main-852becf (alpine 3.18.4), Type: alpine openssl: Incorrect cipher key and IV length processing in libcrypto3 v3.1.3-r0. Fixed in v3.1.4-r0
  • HIGH, Target: docker.io/grafana/loki:main-852becf (alpine 3.18.4), Type: alpine openssl: Incorrect cipher key and IV length processing in libssl3 v3.1.3-r0. Fixed in v3.1.4-r0
    \nTo see more details on these vulnerabilities, and how/where to fix them, please run docker build -t grafana/loki:main-852becf -f cmd/loki/Dockerfile .
    trivy i grafana/loki:main-852becf on your branch. If these were not introduced by your PR, please considering fixing them in via a subsequent PR. Thanks!

@pull-request-size pull-request-size bot added size/L and removed size/M labels Jan 5, 2024
@poyzannur poyzannur merged commit 44b8174 into main Jan 5, 2024
8 checks passed
@poyzannur poyzannur deleted the chaudum/bloom-compactor-cleanup branch January 5, 2024 15:40
rhnasc pushed a commit to inloco/loki that referenced this pull request Apr 12, 2024
**What this PR does / why we need it**:
This PR is the result of debugging sprint on bloom-compactor on a dev
cell.
With these changes, compactor now can create and upload blooms and
relevant meta files from scratch.

- Queries tsdb correctly with empty matchers to get all series
- Seeks to the beginning of the bloom data file before uploading
- Adds uuid strings to local file name, as checksum is not available at
the time of directory creation
- Creates meta object with all fields populated
- Additional logging

edit: confirmed that it runs as expected in the dev cell.

---------

Signed-off-by: Christian Haudum <[email protected]>
Co-authored-by: Christian Haudum <[email protected]>
Co-authored-by: Paul Rogers <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants