Convert LLama-2/3 Weights to HuggingFace compatible and run locally.
- The bash script assumes that you've already downloaded your weights from https://llama.meta.com/llama-downloads.
- Run bash script.
chmod +x convert_to_hugging_face.sh
./convert_to_hugging_face.sh /home/llama /home/llama/llama-2-7b-chat 7B
- Install requirements.
pip install -r requirements.txt
- Run python script.
python local_llama.py
Note: Output path will be e.g. /home/llama/llama-2-7b-chat-hf.