Connecting to a ceph cluster that has Auth disabled

[Lindsay-Mathieson]

Yup, as per the title, don't ask how it got like that :(

ceph.conf

[global]
         auth_client_required = none
         auth_cluster_required = none
         auth_service_required = none

Setting up in Nomad - have Controller and plugin nodes deployed and working. Trouble is creating a volume where normally you would auth. I did setup a Client.Nomad user, but when Auth is disabled ceph rejects authenticated connections.

nomad volume create ceph-volume.hcl
Error creating volume: Unexpected response code: 500 (rpc error: rpc error: 1 error occurred:
        * controller create volume: rpc error: controller create volume: CSI.ControllerCreateVolume: controller plugin returned an internal error, check the plugin allocation logs for more information: rpc error: code = Internal desc = failed to get connection: connecting failed: rados: ret=-13, Permission denied)

I tried without the secret and setting user/key to and empty string, but the controller doesn't like those parameters.

Any suggestions? Enabling auth on the cluster is really an option at the moment, I already had one near heart attack restoring the ceph config and cluster remotely :(

nb. Have been work from the Ceph Nomad example:

https://docs.ceph.com/en/latest/rbd/rbd-nomad/

Thanks.

[Lindsay-Mathieson]

Well I worked around it by enabling cephx auth on the cluster, a involved copying missing keys for mons and pols, but got there. A stressful couple of hours.

That got things working with the csi