Job submitted via copr-cli always dies

[ycollet]

I submitted jobs via copr-cli on several days and they always die.
The jobs are running fine locally.
The only useful log I found seems to be this one:

Warning: Permanently added '35.175.192.193' (ED25519) to the list of known hosts.

You can reproduce this build on your computer by running:

  sudo dnf install copr-rpmbuild
  /usr/bin/copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.fedorainfracloud.org/backend/get-build-task/6393846-fedora-37-aarch64 --chroot fedora-37-aarch64


Version: 0.69
PID: 5756
Logging PID: 5757
Task:
{'appstream': False,
 'background': False,
 'build_id': 6393846,
 'buildroot_pkgs': [],
 'chroot': 'fedora-37-aarch64',
 'enable_net': True,
 'fedora_review': False,
 'git_hash': 'e353ed9c44e45fc61c2d251d5b0dafbb3ae59c9e',
 'git_repo': 'https://copr-dist-git.fedorainfracloud.org/git/ycollet/audinux/wavetable',
 'isolation': 'default',
 'memory_reqs': 2048,
 'package_name': 'wavetable',
 'package_version': '0.0.8-1',
 'project_dirname': 'audinux',
 'project_name': 'audinux',
 'project_owner': 'ycollet',
 'repo_priority': None,
 'repos': [{'baseurl': 'https://download.copr.fedorainfracloud.org/results/ycollet/audinux/fedora-37-aarch64/',
            'id': 'copr_base',
            'name': 'Copr repository',
            'priority': None},
           {'baseurl': 'https://download1.rpmfusion.org/free/fedora/releases/$releasever/Everything/$basearch/os/',
            'id': 'https_download1_rpmfusion_org_free_fedora_releases_releasever_Everything_basearch_os',
            'name': 'Additional repo '
                    'https_download1_rpmfusion_org_free_fedora_releases_releasever_Everything_basearch_os'}],
 'sandbox': 'ycollet/audinux--ycollet',
 'source_json': {},
 'source_type': None,
 'submitter': 'ycollet',
 'tags': [],
 'task_id': '6393846-fedora-37-aarch64',
 'timeout': 18000,
 'uses_devel_repo': False,
 'with_opts': [],
 'without_opts': []}

Running: git clone https://copr-dist-git.fedorainfracloud.org/git/ycollet/audinux/wavetable /var/lib/copr-rpmbuild/workspace/workdir-t39fcdak/wavetable --depth 500 --no-single-branch --recursive

cmd: ['git', 'clone', 'https://copr-dist-git.fedorainfracloud.org/git/ycollet/audinux/wavetable', '/var/lib/copr-rpmbuild/workspace/workdir-t39fcdak/wavetable', '--depth', '500', '--no-single-branch', '--recursive']
cwd: .
rc: 0
stdout: 
stderr: Cloning into '/var/lib/copr-rpmbuild/workspace/workdir-t39fcdak/wavetable'...

Running: git checkout e353ed9c44e45fc61c2d251d5b0dafbb3ae59c9e --

cmd: ['git', 'checkout', 'e353ed9c44e45fc61c2d251d5b0dafbb3ae59c9e', '--']
cwd: /var/lib/copr-rpmbuild/workspace/workdir-t39fcdak/wavetable
rc: 0
stdout: 
stderr: Note: switching to 'e353ed9c44e45fc61c2d251d5b0dafbb3ae59c9e'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

HEAD is now at e353ed9 automatic import of wavetable

Running: copr-distgit-client sources

cmd: ['copr-distgit-client', 'sources']
cwd: /var/lib/copr-rpmbuild/workspace/workdir-t39fcdak/wavetable
rc: 0
stdout: 
stderr: INFO: Reading stdout from command: git rev-parse --abbrev-ref HEAD
INFO: Reading stdout from command: git rev-parse HEAD
INFO: Reading sources specification file: sources
INFO: Downloading Wavetable.tar.gz
INFO: Reading stdout from command: curl --help all
/usr/bin/tail:   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
/var/lib/copr-rpmbuild/main.log: file truncated
                                 Dload  Upload   Total   Spent    Left  Speed
100  176M  100  176M    0     0   232M      0 --:--:-- --:--:-- --:--:--  232M
INFO: Reading stdout from command: md5sum Wavetable.tar.gz

Running (timeout=18000): unbuffer mock --spec /var/lib/copr-rpmbuild/workspace/workdir-t39fcdak/wavetable/wavetable.spec --sources /var/lib/copr-rpmbuild/workspace/workdir-t39fcdak/wavetable --resultdir /var/lib/copr-rpmbuild/results --uniqueext 1694428123.916007 -r /var/lib/copr-rpmbuild/results/configs/child.cfg
INFO: mock.py version 5.0 starting (python version = 3.11.3, NVR = mock-5.0-1.fc38)...
Start(bootstrap): init plugins
INFO: tmpfs initialized
INFO: selinux enabled
INFO: chroot_scan: initialized
INFO: compress_logs: initialized
Finish(bootstrap): init plugins
Start: init plugins
INFO: tmpfs initialized
INFO: selinux enabled
INFO: chroot_scan: initialized
INFO: compress_logs: initialized
Finish: init plugins
INFO: Signal handler active
Start: run
INFO: Start(/var/lib/copr-rpmbuild/workspace/workdir-t39fcdak/wavetable/wavetable.spec)  Config(fedora-37-aarch64)
Start: clean chroot
Finish: clean chroot
Mock Version: 5.0
INFO: Mock Version: 5.0
Start(bootstrap): chroot init
INFO: mounting tmpfs at /var/lib/mock/fedora-37-aarch64-bootstrap-1694428123.916007/root.
INFO: calling preinit hooks
INFO: enabled root cache
INFO: enabled package manager cache
Start(bootstrap): cleaning package manager metadata
Finish(bootstrap): cleaning package manager metadata
INFO: Using bootstrap image: registry.fedoraproject.org/fedora:37
INFO: Pulling image: registry.fedoraproject.org/fedora:37
INFO: Copy content of container registry.fedoraproject.org/fedora:37 to /var/lib/mock/fedora-37-aarch64-bootstrap-1694428123.916007/root
INFO: mounting registry.fedoraproject.org/fedora:37 with podman image mount
INFO: image registry.fedoraproject.org/fedora:37 as /var/lib/containers/storage/overlay/10d320c32b08e4e5d4e8a3e2b934705a3e5d6278dc72792d3af34ced56447b46/merged
INFO: umounting image registry.fedoraproject.org/fedora:37 (/var/lib/containers/storage/overlay/10d320c32b08e4e5d4e8a3e2b934705a3e5d6278dc72792d3af34ced56447b46/merged) with podman image umount
INFO: Package manager dnf detected and used (fallback)
INFO: Bootstrap image not marked ready
Start(bootstrap): installing dnf tooling
Failed to mount /proc/sys (type n/a) on /proc/sys (MS_BIND ""): Invalid argument
Child died too early.
WARNING: DNF command failed, retrying, attempt #2, sleeping 10s
Failed to mount /proc/sys (type n/a) on /proc/sys (MS_BIND ""): Invalid argument
Failed to create /user.slice/user-1001.slice/session-15.scope/payload subcgroup: Structure needs cleaning
WARNING: DNF command failed, retrying, attempt #3, sleeping 10s
Failed to mount /proc/sys (type n/a) on /proc/sys (MS_BIND ""): Invalid argument
Failed to create /user.slice/user-1001.slice/session-15.scope/payload subcgroup: Structure needs cleaning
ERROR: Exception(/var/lib/copr-rpmbuild/workspace/workdir-t39fcdak/wavetable/wavetable.spec) Config(fedora-37-aarch64) 0 minutes 24 seconds
INFO: Results and/or logs in: /var/lib/copr-rpmbuild/results
INFO: Cleaning up build root ('cleanup_on_failure=True')
Start: clean chroot
Finish: clean chroot
WARNING: Machine 1009bb86da6a482ebfdafa9274558c87 still running. Killing...
ERROR: Command failed: 
 # /usr/bin/systemd-nspawn -q -M 27b5dbf622054d12982421189f49e924 -D /var/lib/mock/fedora-37-aarch64-bootstrap-1694428123.916007/root -a --console=pipe --setenv=TERM=vt100 --setenv=SHELL=/bin/bash --setenv=HOME=/var/lib/mock/fedora-37-aarch64-bootstrap-1694428123.916007/root/installation-homedir --setenv=HOSTNAME=mock --setenv=PATH=/usr/bin:/bin:/usr/sbin:/sbin --setenv=PROMPT_COMMAND=printf "\033]0;<mock-chroot>\007" --setenv=PS1=<mock-chroot> \s-\v\$  --setenv=LANG=C.UTF-8 --setenv=LC_MESSAGES=C.UTF-8 --setenv=SYSTEMD_NSPAWN_TMPFS_TMP=0 --setenv=SYSTEMD_SECCOMP=0 --resolv-conf=off /usr/bin/dnf-3 --releasever 37 --setopt=deltarpm=False --setopt=allow_vendor_change=yes --allowerasing --disableplugin=local --disableplugin=spacewalk --disableplugin=versionlock install python3-dnf python3-dnf-plugins-core --setopt=tsflags=nocontexts --setopt=tsflags=nocontexts --setopt=tsflags=nocontexts
Failed to mount /proc/sys (type n/a) on /proc/sys (MS_BIND ""): Invalid argument
Failed to create /user.slice/user-1001.slice/session-15.scope/payload subcgroup: Structure needs cleaning

WARNING: Machine 27b5dbf622054d12982421189f49e924 still running. Killing...
Copr build error: Build failed

The URL of the last build:
https://copr.fedorainfracloud.org/coprs/ycollet/audinux/build/6393846/

[ycollet]

I close the bug. It's a duplicate of #2906