Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Large PITR binlog uploads to Azure storage timeout with "Context deadline exceeded" #1847

Open
dcaputo-harmoni opened this issue Oct 16, 2024 · 0 comments · May be fixed by #1848
Open

Large PITR binlog uploads to Azure storage timeout with "Context deadline exceeded" #1847

dcaputo-harmoni opened this issue Oct 16, 2024 · 0 comments · May be fixed by #1848
Labels

Comments

@dcaputo-harmoni
Copy link
Contributor

Report

When uploading large (1GB) binlog files to Azure, the UploadStream times out with the error "Context deadline exceeded". Realized that the default (max) concurrency for UploadStream is 1, which is too low for large uploads. Increased this to 4 and the problem went away. Will submit PR with the change.

More about the problem

Unfortunately did not capture the failure error before I pushed the fix to my local environment, but basically the binlog upload from the PITR container was stuck / failing on a large binlog file with "Context deadline exceeded" as the error.

Steps to reproduce

Enable PITR with Azure storage and a large binlog file.

Versions

  1. Kubernetes 1.30.4
  2. Operator 1.15.0
  3. Database 1.15.0

Anything else?

No response

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
1 participant