[DOC] - Add docker image to Cerebrium Integration (vllm-project#6510)

xjpang · Jul 24, 2024 · 44f3a70 · 44f3a70
1 parent f00b84f
commit 44f3a70
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/docs/source/serving/deploying_with_cerebrium.rst b/docs/source/serving/deploying_with_cerebrium.rst
@@ -28,6 +28,9 @@ Next, to install the required packages, add the following to your cerebrium.toml
 
 .. code-block:: toml
 
+    [cerebrium.deployment]
+    docker_base_image_url = "nvidia/cuda:12.1.1-runtime-ubuntu22.04"
+
     [cerebrium.dependencies.pip]
     vllm = "latest"