Skip to content

Commit

Permalink
add outlines to make gen-server
Browse files Browse the repository at this point in the history
  • Loading branch information
jeffreyftang committed Feb 9, 2024
1 parent 9c874fc commit 5781073
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion server/Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ install: gen-server
pip install pip --upgrade
pip install torch==2.2.0
pip install -r requirements.txt
pip install -e ".[bnb, accelerate, quantize, peft]"
pip install -e ".[bnb, accelerate, quantize, peft, outlines]"

run-dev:
# SAFETENSORS_FAST_GPU=1 python -m torch.distributed.run --nproc_per_node=1 lorax_server/cli.py serve gpt2
Expand Down

0 comments on commit 5781073

Please sign in to comment.