Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support Lucene index scrubbing of missing entries #3008

Open
jjezra opened this issue Dec 16, 2024 · 0 comments
Open

Support Lucene index scrubbing of missing entries #3008

jjezra opened this issue Dec 16, 2024 · 0 comments

Comments

@jjezra
Copy link
Contributor

jjezra commented Dec 16, 2024 •
edited
Loading

To validate Lucene index validity, support "Report Only" scrubbing for missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists.
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Dec 18, 2024
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
0769dbc 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
jjezra added a commit to jjezra/fdb-record-layer that referenced this issue Jan 13, 2025
@jjezra
Resolve FoundationDB#3008: Support Lucene index scrubbing
4939826 
  To validate Lucene index validity, support "Report Only" scrubbing for:
     Dangling Lucene index entries: Iterate "all entries" (similar toLuceneScanAllEntriesTest), validate that all pointers lead to existing records.
     Missing Lucene index entries: iterate all records, validate that their primary keys are represented in the “primary key to Lucene segment” map, and that the Lucene segment exists
@jjezra jjezra changed the title Support Lucene index scrubbing Support Lucene index scrubbing of missing entries Jan 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@jjezra