Skip to content

Commit

Permalink
fix vllm version
Browse files Browse the repository at this point in the history
  • Loading branch information
natolambert committed Sep 6, 2024
1 parent 977109e commit e48a485
Showing 1 changed file with 1 addition and 5 deletions.
6 changes: 1 addition & 5 deletions Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ COPY scripts scripts
COPY setup.py setup.py
COPY Makefile Makefile
COPY README.md README.md
RUN pip install -e .
RUN pip install -e .[generative]
RUN chmod +x scripts/*

# this is just very slow
Expand All @@ -74,9 +74,5 @@ RUN pip install openai
RUN pip install together
RUN pip install google-generativeai

# updated for Gemma 2
RUN pip install vllm==0.5.1
# from git+https://github.com/vllm-project/vllm.git@d87f39e9a9dd149f5dd7a58b4d98b21f713827b6

# for interactive session
RUN chmod -R 777 /stage/

0 comments on commit e48a485

Please sign in to comment.