Skip to content

Commit

Permalink
[DOCUMENTATION] Clarify getting started documentation regarding port …
Browse files Browse the repository at this point in the history
…number used in pre-built Docker image. (#313)
  • Loading branch information
alexsherstinsky authored Mar 8, 2024
1 parent 2d9a270 commit eebea85
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions docs/getting_started/docker.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,10 @@ volume=$PWD/data # share a volume with the container as a weight cache
docker run --gpus all --shm-size 1g -p 8080:80 -v $volume:/data \
ghcr.io/predibase/lorax:latest --model-id $model
```
!!! note

The LoRAX server in the pre-built Docker image is configured to listen on port 80 (instead of on the default port number, which is 3000).

!!! note

To use GPUs, you need to install the [NVIDIA Container Toolkit](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html). We also recommend using NVIDIA drivers with CUDA version 11.8 or higher.
Expand Down

0 comments on commit eebea85

Please sign in to comment.