Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

erasure coding stewardship endpoint returns false #4948

Open
istae opened this issue Jan 14, 2025 · 1 comment · May be fixed by #4955
Open

erasure coding stewardship endpoint returns false #4948

istae opened this issue Jan 14, 2025 · 1 comment · May be fixed by #4955
Assignees
Labels
needs-triaging new issues that need triaging

Comments

@istae
Copy link
Member

istae commented Jan 14, 2025

for erasure encoded data during upload (we tried level 3), the stewardship endpoint returns isRetrievable=false.
The endpoint returns true, however, for the same upload without erasure coding.

Another experiment I did was upload a random file, split all the chunk references with the split cmd, and for no erasure coded uploads, all of the chunks were retrievable, but for erasure coded uploads, some chunks were missing (a tiny percentage).

@istae istae added the needs-triaging new issues that need triaging label Jan 14, 2025
@acha-bill acha-bill linked a pull request Jan 30, 2025 that will close this issue
4 tasks
@istae
Copy link
Member Author

istae commented Jan 31, 2025

the issue is that if you split the refs yourself after uploading the file, there will be some chunks missing that you cant even query using /chunks

looking at the logs specifically for chunks we cannot retrieve, the node did not even pushsync them 😳

so it's not a retrieval issue but more like an issue with syncing chunks that come from a file with erasure coding

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs-triaging new issues that need triaging
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants