When delete pv, report rpc error: code = DeadlineExceeded desc = context deadline exceeded

[huanghantao]

It's log:

W0512 08:07:32.487703       1 controller.go:1013] Retrying syncing volume "pvc-3289afd5-2287-4d79-902b-d30557c2904d", failure 3
E0512 08:07:32.487725       1 controller.go:1031] error syncing volume "pvc-3289afd5-2287-4d79-902b-d30557c2904d": rpc error: code = DeadlineExceeded desc = context deadline exceeded
I0512 08:07:32.487756       1 controller.go:1472] delete "pvc-55662a94-8692-4cc4-9fd0-ae1e88daa120": started
E0512 08:07:32.487870       1 controller.go:1482] delete "pvc-04d1fb7f-4b8e-4ad1-98f2-9f0760e2d275": volume deletion failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded
W0512 08:07:32.487883       1 controller.go:1013] Retrying syncing volume "pvc-04d1fb7f-4b8e-4ad1-98f2-9f0760e2d275", failure 2
E0512 08:07:32.487895       1 controller.go:1031] error syncing volume "pvc-04d1fb7f-4b8e-4ad1-98f2-9f0760e2d275": rpc error: code = DeadlineExceeded desc = context deadline exceeded
E0512 08:07:32.487920       1 controller.go:1482] delete "pvc-5cbaf8a5-f1d0-47ad-ac88-cf2b4133022a": volume deletion failed: rpc error: code = DeadlineExceeded desc = context deadline exceeded
W0512 08:07:32.487956       1 controller.go:1013] Retrying syncing volume "pvc-5cbaf8a5-f1d0-47ad-ac88-cf2b4133022a", failure 2
E0512 08:07:32.487969       1 controller.go:1031] error syncing volume "pvc-5cbaf8a5-f1d0-47ad-ac88-cf2b4133022a": rpc error: code = DeadlineExceeded desc = context deadline exceeded
I0512 08:07:32.488006       1 event.go:282] Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"pvc-3289afd5-2287-4d79-902b-d30557c2904d", UID:"b4ead6f1-9e0e-40b2-a697-008e677ddfee", APIVersion:"v1", ResourceVersion:"5657653012", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' rpc error: code = DeadlineExceeded desc = context deadline exceeded

What are the possible causes of this problem?

The cluster's master node crashed for some time before the problem was discovered.

[huanghantao]

version:

nfs-csi v3.1.0

[huanghantao]

NFS CSI still reports this error when the master cluster recovers. After I restart NFS CSI, it works and pv is deleted.

[andyzhangx]

pls provide nfs csi driver controller logs if that issue occurs: https://github.com/kubernetes-csi/csi-driver-nfs/blob/master/docs/csi-debug.md#case1-volume-createdelete-failed

[huanghantao]

Ok, if it happens again later, I will submit the complete log file