nodetool clearsnapshot returns a success code when cassandra is stopped

[chrisjmiller1]

Project board link

Hi,

Medusa 0.22.3

When completing a backup-cluster and all instances are down, nodetool clearsnapshot states "All nodes successfully cleared their snapshot." as follows:

imail1@mxiad-tfdevmet01 ~ $ medusa backup-cluster --backup-name=backup8 --parallel-uploads 3 [2024-11-26 11:34:27,593] INFO: Resolving ip address [2024-11-26 11:34:27,593] INFO: ip address to resolve 10.248.63.16 [2024-11-26 11:34:27,595] INFO: Monitoring provider is noop [2024-11-26 11:34:27,604] INFO: Using credentials CensoredCredentials(access_key_id=8..5, secret_access_key=*****, region=us-ashburn-1) [2024-11-26 11:34:27,604] INFO: Connecting to s3_compatible with args {'endpoint_url': 'https://idrnva98r5u4.compat.objectstorage.us-ashburn-1.oraclecloud.com:443', 'verify': False} [2024-11-26 11:34:27,721] INFO: Starting backup backup8 [2024-11-26 11:34:27,944] ERROR: This error happened during the cluster backup: ('Unable to connect to any servers', {'10.248.63.16:9042': ConnectionRefusedError(111, "Tried connecting to [('10.248.63.16', 9042)]. Last error: Connection refused")}) Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/medusa/backup_cluster.py", line 71, in orchestrate backup.execute(cql_session_provider) File "/usr/local/lib/python3.9/site-packages/medusa/backup_cluster.py", line 146, in execute with session_provider.new_session() as session: File "/usr/local/lib/python3.9/site-packages/medusa/cassandra_utils.py", line 124, in new_session session = cluster.connect() File "cassandra/cluster.py", line 1677, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1713, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 1700, in cassandra.cluster.Cluster.connect File "cassandra/cluster.py", line 3507, in cassandra.cluster.ControlConnection.connect File "cassandra/cluster.py", line 3552, in cassandra.cluster.ControlConnection._reconnect_internal cassandra.cluster.NoHostAvailable: ('Unable to connect to any servers', {'10.248.63.16:9042': ConnectionRefusedError(111, "Tried connecting to [('10.248.63.16', 9042)]. Last error: Connection refused")}) [2024-11-26 11:34:27,945] ERROR: Something went wrong! Attempting to clean snapshots and exit. [2024-11-26 11:34:27,945] INFO: Executing "nodetool -Dcom.sun.jndi.rmiURLParsing=legacy clearsnapshot -t medusa-backup8" on following nodes {} with a parallelism/pool size of 3 [2024-11-26 11:34:27,945] INFO: Job executing "nodetool -Dcom.sun.jndi.rmiURLParsing=legacy clearsnapshot -t medusa-backup8" ran and finished Successfully on all nodes. [2024-11-26 11:34:27,945] INFO: All nodes successfully cleared their snapshot.

Regards,

Chris.

┆Issue is synchronized with this Jira Story by Unito
┆Issue Number: MED-109