Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log a notification about long-running operations #4839

Closed
gman0 opened this issue Sep 16, 2024 · 0 comments · Fixed by #4847
Closed

Log a notification about long-running operations #4839

gman0 opened this issue Sep 16, 2024 · 0 comments · Fixed by #4847
Assignees
Labels
component/util Utility functions shared between CephFS and RBD enhancement New feature or request logging The Change is only in logging

Comments

@gman0
Copy link
Contributor

gman0 commented Sep 16, 2024

Describe the feature you'd like to have

Currently, the only way to know that an operation is still in progress is to get an ABORTED error saying that "an operation with the given Volume ID already exists". If the controller responsible for retrying eventually gives up, the admins don't have an easy way of checking the operation is still in progress. So, the driver should log a notification about long running grpc calls.

What is the value to the end user? (why is it a priority?)

Operations that are stuck for a long time are being reminded about, making troubleshooting easier.

How will we know we have a good solution? (acceptance criteria)

Try to create a PVC against a non-responsive/unreachable mon and see repeated messages about a slow-running operation.

Additional context

I'm working on a PR.

@gman0 gman0 changed the title Log a notification about a long-running operations Log a notification about long-running operations Sep 16, 2024
@nixpanic nixpanic added enhancement New feature or request component/util Utility functions shared between CephFS and RBD logging The Change is only in logging labels Sep 16, 2024
@gman0 gman0 mentioned this issue Sep 17, 2024
6 tasks
@mergify mergify bot closed this as completed in #4847 Sep 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component/util Utility functions shared between CephFS and RBD enhancement New feature or request logging The Change is only in logging
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants