New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

lora推理 #71

Open

aSmallsheep opened this issue Jun 6, 2023 · 1 comment

aSmallsheep commented Jun 6, 2023

使用lora做预训练，如何执行推理呢？

hepj987 commented Jun 13, 2023

你lora训练正常么？我lora训练的时候 loss 不降 acc也不升，然后保存的lora模型只有几十兆，不知道怎么和原始模型一起拿来推理

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment