Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Very slow to do a dry-run with many indexes #26

Open
jgough opened this issue Feb 8, 2023 · 0 comments
Open

Very slow to do a dry-run with many indexes #26

jgough opened this issue Feb 8, 2023 · 0 comments

Comments

@jgough
Copy link

jgough commented Feb 8, 2023

Copying from elastic/curator#1631 as the issue still is a major issue for us:

I'm finding that running Curator with --dry-run can be extremely slow.

As far as I can tell, this is because my cluster has many indexes and it takes roughly 10s to get the full list of indexes. It does this before EVERY action it attempts, so if I have 200 actions then the dry-run takes over 30 minutes to run - most of which is querying OpenSearch for the same list of indexes over and over and over.

In normal mode this makes sense as previous actions can have knock-on effects that affect later actions. However in --dry-run mode it maybe would make a lot more sense to cache the list of indexes and not keep querying OpenSearch for this? It would be a huge speedup and make testing curator actions this way less of a chore.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant