error downloading Llama2 #876
Unanswered
yalicohen12
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
hi, i am facing an error while trying to download llm server with LLama2 7b model, would love some help.
command i used: sudo docker run --rm -it -p 3000:3000 ghcr.io/bentoml/openllm start/TheBloke/Llama-2-7B-Chat-GGUF --quantize int4
Beta Was this translation helpful? Give feedback.
All reactions