Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Read from the compressed ZSTD format #29

Open
outusuke opened this issue Jan 7, 2025 · 2 comments
Open

Read from the compressed ZSTD format #29

outusuke opened this issue Jan 7, 2025 · 2 comments

Comments

@outusuke
Copy link

outusuke commented Jan 7, 2025

Add the ability to read the puzzle directly without extracting it

@brianch
Copy link
Owner

brianch commented Jan 8, 2025

Hi, do you mean to save disk space?

I don't think it's possible, unfortunately.

One thing we might consider is importing the csv to the sqlite database we use for favorites, which would reduce the size a bit and allow for faster searches, but it adds yet another step at the beginning and it's one more thing that can fail 😅

That said, I should test this a bit one of these days. See how long it would take for example.

@outusuke
Copy link
Author

It was just some thoughts that I had while reading a text file using zstdcat

Lichess puzzle weighs only 200MB~ when compressed, while when decompressed it goes up to 800MB~. It would be interesting if some combination using zstd could be possible, since it's the format that comes when downloading

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants