Phi Model Updates #2178
hiyouga
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Due to Microsoft's modification of the Phi-1.5/2 model files, for Phi models downloaded after 2024/1/11, the default modules (i.e.
--lora_target
) should beq_proj,v_proj
instead ofWqkv
. Please be aware of your model file version when using it.If you are using the LLaMA Board and encountering errors, please update the LLaMA Factory.
由于微软修改了 Phi-1.5/2 的模型文件,因此对于 2024/1/11 之后下载的 Phi 模型,其默认模块(即
--lora_target
)应当为q_proj,v_proj
而非Wqkv
。使用模型时请注意您的文件版本。如果您在使用 LLaMA Board 时遇到了报错,请更新 LLaMA Factory。
Beta Was this translation helpful? Give feedback.
All reactions