failed to send error emails when SR or remote server is down

[JohnReUS]

Are you using XOA or XO from the sources?

XO from the sources

Which release channel?

None

Provide your commit number

6d34cf6

Describe the bug

When You Setup a remote SR or "File system remote SMB" than create a backup job.
If the remote SR or "File system remote SMB" is down , the backup job will fail and even if you choose report when "Always" no emails will be send to notify that the job failed.

Screenshots

Node

20

Hypervisor

8.3

Additional context

No response

[Danp2]

Do you see any associated errors under Settings > Logs or by checking the system logs with journalctl -u xo-server -f -n 50?

[JohnReUS]

Remote SMB error:
remote.test
{
"id": "576e39e6-3edd-4790-95c3-9a4e301722ae"
}
{
"errno": -112,
"code": "EHOSTDOWN",
"syscall": "mkdir",
"path": "/run/xo-server/mounts/576e39e6-3edd-4790-95c3-9a4e301722ae",
"message": "EHOSTDOWN: host is down, mkdir '/run/xo-server/mounts/576e39e6-3edd-4790-95c3-9a4e301722ae'",
"name": "Error",
"stack": "Error: EHOSTDOWN: host is down, mkdir '/run/xo-server/mounts/576e39e6-3edd-4790-95c3-9a4e301722ae'"
}

remote(same LAN) SR

sr.scan
{
"id": "4b18f517-925b-a491-59fb-a643dfa098fb"
}
{
"code": "SR_BACKEND_FAILURE_47",
"params": [
"",
"The SR is not available [opterr=no such directory /var/run/sr-mount/4b18f517-925b-a491-59fb-a643dfa098fb]",
""
],
"task": {
"uuid": "9940835d-ca06-466d-425f-fa7ac61693b1",
"name_label": "Async.SR.scan",
"name_description": "",
"allowed_operations": [],
"current_operations": {},
"created": "20250110T17:26:37Z",
"finished": "20250110T17:26:47Z",
"status": "failure",
"resident_on": "OpaqueRef:e6d13089-54f5-4af5-8af5-7035c64137ee",
"progress": 1,
"type": "",
"result": "",
"error_info": [
"SR_BACKEND_FAILURE_47",
"",
"The SR is not available [opterr=no such directory /var/run/sr-mount/4b18f517-925b-a491-59fb-a643dfa098fb]",
""
],
"other_config": {},
"subtask_of": "OpaqueRef:NULL",
"subtasks": [],
"backtrace": "(((process xapi)(filename lib/backtrace.ml)(line 210))((process xapi)(filename ocaml/xapi/storage_access.ml)(line 32))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 24))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 35))((process xapi)(filename ocaml/xapi/message_forwarding.ml)(line 131))((process xapi)(filename lib/xapi-stdext-pervasives/pervasiveext.ml)(line 24))((process xapi)(filename ocaml/xapi/rbac.ml)(line 205))((process xapi)(filename ocaml/xapi/server_helpers.ml)(line 95)))"
},
"message": "SR_BACKEND_FAILURE_47(, The SR is not available [opterr=no such directory /var/run/sr-mount/4b18f517-925b-a491-59fb-a643dfa098fb], )",
"name": "XapiError",
"stack": "XapiError: SR_BACKEND_FAILURE_47(, The SR is not available [opterr=no such directory /var/run/sr-mount/4b18f517-925b-a491-59fb-a643dfa098fb], )
at Function.wrap (file:///opt/xo/xo-builds/xen-orchestra-202412261856/packages/xen-api/_XapiError.mjs:16:12)
at default (file:///opt/xo/xo-builds/xen-orchestra-202412261856/packages/xen-api/_getTaskResult.mjs:13:29)
at Xapi._addRecordToCache (file:///opt/xo/xo-builds/xen-orchestra-202412261856/packages/xen-api/index.mjs:1068:24)
at file:///opt/xo/xo-builds/xen-orchestra-202412261856/packages/xen-api/index.mjs:1102:14
at Array.forEach ()
at Xapi._processEvents (file:///opt/xo/xo-builds/xen-orchestra-202412261856/packages/xen-api/index.mjs:1092:12)
at Xapi._watchEvents (file:///opt/xo/xo-builds/xen-orchestra-202412261856/packages/xen-api/index.mjs:1265:14)"
}

and no email was sent to notify me that the backup job was failed