deploy: f355b1b

.buildinfo

@@ -0,0 +1,4 @@
+# Sphinx build info version 1
+# This file hashes the configuration used when building these files. When it is not found, a full rebuild will be done.
+config: 320f5bcda081068d41c2e1449244f00b
+tags: 645f666f9bcd5a90fca523b33c5a78b7

_sources/gpu-passthrough.md.txt

@@ -0,0 +1,152 @@
+# GPU Passthrough using VFIO
+
+
+This guide will demonstrate the process of passing a GPU through to a Virtual Machine (VM) on KVM,
+an essential step for setting up a VM to function as a Kubernetes GPU worker.
+
+🚧 🚧 🚧 This is Work-in-Progress. 🚧 🚧 🚧
+
+## What you'll need
+
+* A Debian-based system.
+* A working [QEMU/KVM installation](qemu-kvm).
+
+## Step 1: Set your Primary Display for the Host
+
+This step is essential for switching the primary display to the integrated GPU, thereby leaving the
+dedicated GPU available for use by the VM.
+
+### What you'll need
+
+* Access to the BIOS settings of the host machine.
+
+### Procedure
+
+<!-- 1. Change to root user:
+
+    ```console
+    user:~$ sudo su -
+    root:~#
+    ``` -->
+
+1. Get the BusID of the integrated GPU by running the following command:
+
+   ```console
+    user:~/kubeflow-on-kvm$ lspci | grep VGA
+    00:02.0 VGA compatible controller: Intel Corporation Raptor Lake-S GT1 [UHD Graphics 770] (rev 04)
+    01:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] (rev a1)
+    ```
+
+    In this example, the BusID of the integrated GPU is `PCI:0:2:0`.
+
+1. Export the BusID in an environment variable:
+
+    ```console
+    user:~/kubeflow-on-kvm$ export PCI_BUS_ID="PCI:0:2:0"
+    ```
+
+1. Create the configuration file for the X server, using the provided template:
+
+    ```console
+    user:~/kubeflow-on-kvm$ j2 infra/intel.conf.j2 > intel.conf
+    ```
+
+1. Copy the configuration file to the X server configuration directory:
+
+    ```console
+    user:~/kubeflow-on-kvm$ sudo cp intel.conf /etc/X11/xorg.conf.d/20-intel.conf
+    ```
+
+1. Change the ownership and the group of the configuration file to `root`:
+
+    ```console
+    user:~/kubeflow-on-kvm$ sudo chown root:root /etc/X11/xorg.conf.d/20-intel.conf
+    ```
+
+1. Boot to UEFI/BIOS settings, and set the primary display to the integrated GPU. Look under
+   "Advanced" settings, for an option like "Primary Display". Set it to "Auto" and connect the
+   monitor directly to the motherboard. Alternativelly, set it to "CPU" or "iGPU" if available.
+
+    ```console
+    root:~# sudo systemctl reboot --firmware-setup
+    ```
+
+## Step 2: Enable GPU Passthrough
+
+In this section, you will bind the GPU to the VFIO driver and prevent the Linux Kernel from loading
+the NVIDIA driver during boot.
+
+### What you'll need
+
+* A dedicated GPU that is not being used by the host.
+
+### Procedure
+
+1. Get the PCIe ID of the GPU:
+
+    ```console
+    root:~# lspci -nn | grep -i nvidia
+    01:00.0 VGA compatible controller [0300]: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] [10de:2504] (rev a1)
+    01:00.1 Audio device [0403]: NVIDIA Corporation GA106 High Definition Audio Controller [10de:228e] (rev a1)
+    ```
+
+    The PCIe ID of the VGA controller is `10de:2504` and the Audio device is `10de:228e`. Take a note of these IDs. You will need them later.
+
+1. Chane the `GRUB_CMDLINE_LINUX_DEFAULT` variable in the `/etc/default/grub` file to include the
+   following options:
+
+    * `intel_iommu=on`: Enable IOMMU for the integrated GPU.
+    * `iommu=pt`: Enable IOMMU passthrough.
+
+    ```console
+    root:~# sed -i 's/GRUB_CMDLINE_LINUX_DEFAULT="\(.*\)"/GRUB_CMDLINE_LINUX_DEFAULT="\1 intel_iommu=on iommu=pt"/' /etc/default/grub
+    ```
+
+1. Update the GRUB configuration:
+
+    ```console
+    root:~# update-grub
+    ```
+
+1. Create a configuration file to bind the GPU to the VFIO driver:
+
+    a. Run the following command:
+
+    ```console
+    root:~# cat > /etc/modprobe.d/vfio.conf
+    ```
+
+    b. Copy and paste the following text:
+
+    ```
+    options vfio-pci ids=10de:2504,10de:228e
+    softdep nvidia pre: vfio-pci
+    ```
+
+    Replace `10de:2504,10de:228e` with the PCIe IDs of your GPU.
+
+    c. Run `CTRL + D` to exit.
+
+1. Update the initial ramdisk:
+
+    ```console
+    root:~# update-initramfs -c -k $(uname -r)
+    ```
+
+1. Reboot the system:
+
+    ```console
+    root:~# reboot
+    ```
+
+### Verify
+
+1. Check if the GPU is bound to the VFIO driver:
+
+    ```console
+    root:~# lspci -k | grep -E "vfio-pci|NVIDIA"
+    01:00.0 VGA compatible controller: NVIDIA Corporation GA106 [GeForce RTX 3060 Lite Hash Rate] (rev a1)
+        Kernel driver in use: vfio-pci
+    01:00.1 Audio device: NVIDIA Corporation GA106 High Definition Audio Controller (rev a1)
+        Kernel driver in use: vfio-pci
+    ```

_sources/index.rst.txt

@@ -0,0 +1,30 @@
+Kubeflow on KVM
+===============
+
+Kubeflow on KVM is a project dedicated to simplifying the process of setting up
+`Kubeflow <https://www.kubeflow.org/>`_ in a virtualized environment, making it easier for data
+scientists to leverage the power of Machine Learning (ML) workflows on Kubernetes.
+
+🚧 🚧 🚧 This is Work-in-Progress. 🚧 🚧 🚧
+
+Contact
+-------
+
+* Dimitris Poulopoulos [email protected]
+
+We warmly welcome your feedback and look forward to hearing from you!
+
+.. toctree::
+   :maxdepth: 1
+   :caption: Deployment Guides
+
+   qemu-kvm
+   gpu-passthrough
+   pxe-server
+
+.. Indices and tables
+.. ==================
+
+.. * :ref:`genindex`
+.. * :ref:`modindex`
+.. * :ref:`search`