Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set timeout for k8s HTTP client #186

Merged
merged 2 commits into from
Dec 10, 2024
Merged

Conversation

dimitarvdimitrov
Copy link
Contributor

We had a request to an ingesters take 20m and block the reconiliation loop. We want to avoid that, so adding a timeout. We use this client for both k8s and StatefulSet requests.

I assume the operations that the StatefulSet requests will always be fast and will never have to actually do a lot of work (like uploading blocks). Can the reviewers confirm this assumption?

We had a request to an ingesters take 20m and block the reconiliation loop. We want to avoid that, so adding a timeout. We use this client for both k8s and StatefulSet requests.

__I assume the operations that the StatefulSet requests will always be fast and will never have to actually do a lot of work (like uploading blocks). Can the reviewers confirm this assumption?__
Copy link
Collaborator

@pracucci pracucci left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't expect any K8S API call to take more than few seconds by design (I mean, unless issues with the controlplane). So this PR LGTM.

@56quarters 56quarters merged commit 1f8b2a3 into main Dec 10, 2024
6 checks passed
@56quarters 56quarters deleted the dimitar/set-timeout-for-http-client branch December 10, 2024 19:12
56quarters added a commit to grafana/mimir that referenced this pull request Dec 12, 2024
56quarters added a commit to grafana/mimir that referenced this pull request Dec 12, 2024
56quarters added a commit to grafana/mimir that referenced this pull request Dec 12, 2024
56quarters added a commit that referenced this pull request Dec 13, 2024
Make the timeout added in #186 configurable and default to 5 minutes.

Signed-off-by: Nick Pillitteri <[email protected]>
56quarters added a commit that referenced this pull request Dec 13, 2024
* Make Kubernetes client timeout configurable

Make the timeout added in #186 configurable and default to 5 minutes.

Signed-off-by: Nick Pillitteri <[email protected]>

* Changelog

Signed-off-by: Nick Pillitteri <[email protected]>

---------

Signed-off-by: Nick Pillitteri <[email protected]>
bjorns163 pushed a commit to bjorns163/mimir that referenced this pull request Dec 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants