Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

使用 internvl-1.5 微调后的模型文件特别大,请问是正常的吗? #309

Open
Qinger27 opened this issue Jun 27, 2024 · 2 comments

Comments

@Qinger27
Copy link

晕,用 internvl-1.5 做 lora 微调,发现存了一个微调后模型就 96G 了,请问这是正常的吗?
为什么比pretrained的模型(69G)还大了一半呀?
如果只保存 lora 部分的参数,应该不会占这么大空间吧?请问有人可以帮忙解答一下吗?

@dacian7
Copy link

dacian7 commented Jun 28, 2024

晕,用 internvl-1.5 做 lora 微调,发现存了一个微调后模型就 96G 了,请问这是正常的吗? 为什么比pretrained的模型(69G)还大了一半呀? 如果只保存 lora 部分的参数,应该不会占这么大空间吧?请问有人可以帮忙解答一下吗?

@Qinger27 应该是把 vision encoder 的参数也保存了?你看下保存了什么

@Qinger27
Copy link
Author

请问在哪里设置要保存的内容呀?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants