Skip to content
This repository has been archived by the owner on Mar 26, 2024. It is now read-only.

Adjust bucket size with index size #178

Open
gravesb opened this issue Jan 7, 2019 · 0 comments
Open

Adjust bucket size with index size #178

gravesb opened this issue Jan 7, 2019 · 0 comments

Comments

@gravesb
Copy link
Contributor

gravesb commented Jan 7, 2019

In some environments we're seeing messages like:

11-08-2016 15:48:36.772 -0600 WARN  IndexConfig - Max bucket size is larger than the index size limit. Please check your index configuration. idx=my-idx; bucket size in MB (from maxDataSize) 750, maxTotalDataSizeMB=133

This is potentially problematic as that means each of these indexes could only have one bucket (on each indexer)... and rolling and making a new bucket would likely wipe out the index completely.

We currently set maxDataSize = auto = 750MB automatically... we should consider auto_high_volume (10GB) for some indexes, but there's of course a range of tuning in between to figure out as well.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant