Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nvidia-driver sysext hides zfs modules #1576

Open
rradczewski opened this issue Nov 1, 2024 · 0 comments
Open

nvidia-driver sysext hides zfs modules #1576

rradczewski opened this issue Nov 1, 2024 · 0 comments
Labels
kind/bug Something isn't working

Comments

@rradczewski
Copy link

rradczewski commented Nov 1, 2024

Description

The nvidia-driver extension hides the zfs modules in /usr/lib/modules/*/modules.dep

Impact

One can not use flatcar-zfs without manually running insmod on a system with the nvidia-driver extension enabled

Environment and steps to reproduce

  1. Set-up: Create a new flatcar installation on a system with a nvidia GPU and an ignition.json with zfs enabled
  2. Task: Run any zfs related command, e.g. zpool status
  3. Action(s): -
  4. Error: ZFS isn't auto-loaded and can't be loaded using modprobe zfs
core@construct ~ $ grep nvidia /usr/lib/modules/6.6.54-flatcar/modules.dep
kernel/drivers/net/ethernet/nvidia/forcedeth.ko.xz:
video/nvidia-modeset.ko: video/nvidia.ko kernel/drivers/gpu/drm/drm.ko.xz kernel/drivers/i2c/i2c-core.ko.xz
video/nvidia-peermem.ko:
video/nvidia-drm.ko: video/nvidia-modeset.ko video/nvidia.ko kernel/drivers/gpu/drm/drm_kms_helper.ko.xz kernel/drivers/gpu/drm/drm.ko.xz kernel/drivers/i2c/i2c-core.ko.xz
video/nvidia-uvm.ko: video/nvidia.ko kernel/drivers/gpu/drm/drm.ko.xz kernel/drivers/i2c/i2c-core.ko.xz
video/nvidia.ko: kernel/drivers/gpu/drm/drm.ko.xz kernel/drivers/i2c/i2c-core.ko.xz
core@construct ~ $ grep zfs /usr/lib/modules/6.6.54-flatcar/modules.dep
core@construct ~ $ mount | grep sysext
sysext on /usr type overlay (ro,nodev,relatime,seclabel,lowerdir=/run/systemd/sysext/meta/usr:/run/systemd/sysext/extensions/nvidia_runtime/usr:/run/systemd/sysext/extensions/nvidia-driver/usr:/run/systemd/sysext/extensions/flatcar-zfs/usr:/run/systemd/sysext/extensions/docker-flatcar/usr:/run/systemd/sysext/extensions/containerd-flatcar/usr:/usr)

core@construct ~ $ sudo zpool status
The ZFS modules cannot be auto-loaded.
Try running 'modprobe zfs' as root to manually load them.
core@construct ~ $ sudo modprobe zfs
modprobe: FATAL: Module zfs not found in directory /lib/modules/6.6.54-flatcar
core@construct ~ $ sudo insmod /lib/modules/6.6.54-flatcar/extra/spl.ko.xz 
core@construct ~ $ sudo insmod /lib/modules/6.6.54-flatcar/extra/zfs.ko.xz 
core@construct ~ $ sudo zpool status
no pools available

Expected behavior

nvidia-driver and flatcar-zfs can co-exist

Additional information

I've been trying to create a reproducer, but setup-nvidia and install-nvidia both require a NVIDIA GPU to be present and can't be forced to build the sysext.

@rradczewski rradczewski added the kind/bug Something isn't working label Nov 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Something isn't working
Projects
Status: 📝 Needs Triage
Development

No branches or pull requests

1 participant