New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

学习率的设置 #511

Open

zhuH0323 opened this issue Feb 27, 2025 · 0 comments

zhuH0323 commented Feb 27, 2025

在不同规模的基座模型上训练时，qwen32B、14b、7b的学习率设置有什么建议吗？在自己的数据集上用grpo训qwen32b模型时，我们发现1e-6有点大了，一个step后生成的结果都是感叹号！！！！！！！！！！求指导

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment