Skip to content

Commit

Permalink
Update online-inference/vllm/Dockerfile
Browse files Browse the repository at this point in the history
Co-authored-by: Sanger Steel <[email protected]>
  • Loading branch information
rtalaricw and sangstar authored Apr 25, 2024
1 parent 367973e commit 47a8aa0
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion online-inference/vllm/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ FROM ghcr.io/coreweave/ml-containers/torch-extras:c1bf355-nccl-cuda12.2.2-ubuntu
ENV DEBIAN_FRONTEND=noninteractive

RUN apt-get -qq update && \
apt-get -qq install --no-install-recommends -y git curl && \
apt-get -qq install --no-install-recommends -y git curl libsodium23 && \
apt-get clean

RUN pip install git+https://github.com/coreweave/vllm.git@sangstar/tensorizer-update#egg=vllm[tensorizer]
Expand Down

0 comments on commit 47a8aa0

Please sign in to comment.