Skip to content

Commit

Permalink
BLD: fix flashinfer installation in dockerfile (#2844)
Browse files Browse the repository at this point in the history
  • Loading branch information
qinxuye authored Feb 12, 2025
1 parent 617454c commit 841cd26
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion xinference/deploy/docker/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ RUN pip install --upgrade -i "$PIP_INDEX" pip && \
pip install -i "$PIP_INDEX" --upgrade-strategy only-if-needed -r /opt/inference/xinference/deploy/docker/requirements.txt && \
pip install -i "$PIP_INDEX" --no-deps sglang && \
pip uninstall flashinfer -y && \
pip install flashinfer_python -i https://flashinfer.ai/whl/cu124/torch2.5/flashinfer/ && \
pip install flashinfer-python -i https://flashinfer.ai/whl/cu124/torch2.5 && \
cd /opt/inference && \
python3 setup.py build_web && \
git restore . && \
Expand Down

0 comments on commit 841cd26

Please sign in to comment.