Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

generate Vicuna error and inference error #57

Open
wen020 opened this issue Jun 6, 2024 · 0 comments
Open

generate Vicuna error and inference error #57

wen020 opened this issue Jun 6, 2024 · 0 comments

Comments

@wen020
Copy link

wen020 commented Jun 6, 2024

I used the following command to generate Vicuna, but the following error occurred. Which step did I do wrong?

python3 -m fastchat.model.apply_delta
--base-model-path /path/to/llama-7b
--target-model-path /path/to/output/vicuna-7b
--delta-path lmsys/vicuna-7b-delta-v0

base-model:https://huggingface.co/huggyllama/llama-7b/tree/main
delta-model:https://huggingface.co/lmsys/vicuna-7b-delta-v0
image

Then I change delta-model to
delta-model:https://huggingface.co/lmsys/vicuna-7b-delta-v1.1
run python3 -m fastchat.model.apply_delta
--base-model-path /app/wen/Panda-70M/captioning/llama-7b
--target-model-path /app/wen/Panda-70M/captioning/vicuna_weights/vicuna-7b-v0
--delta-path /app/wen/Panda-70M/captioning/vicuna-7b-delta-v1.1

Vicuna was able to successfully generate
image

But when I ran the following command:
python inference.py --video-list inputs/video_list.txt --prompt-list inputs/prompt_list.txt

the following error occurred:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant