Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cleanup disk more aggressively if there is not enough space left #221

Open
yiranwang52 opened this issue Nov 6, 2019 · 0 comments
Open

Comments

@yiranwang52
Copy link
Collaborator

yiranwang52 commented Nov 6, 2019

Is your feature request related to a problem? Please describe.
Today cleanup logic is mostly configured through TTL. During traffic peak, origin could take much more space than desired, and it would be ideal if cleanup logic could run more aggressively.

Describe the solution you'd like
Could be something simple like if disk usage > 70%, use TTL * 0.5; disk usage > 80%, use TTL * 0.2; disk usage > 90%, use TTL * 0.1. Or could be some logarithm function based on storage space left.
The code lives in https://github.com/uber/kraken/blob/master/lib/store/cleanup.go

Describe alternatives you've considered
Storage LRU capacity is configurable, but it's about number of blobs, not related to blob size. It's difficult to make it function on size, because then one huge blob could cause a lot of smaller blob to be deleted, causing other issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant