We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hi everyone, thanks for using lmms-eval.
We are aware of there are challenges in integrating new tasks for new users in lmms-eval and lm-evaluation-harness.
lmms-eval
lm-evaluation-harness
It's welcome that you can share your issues and questions to us, so we can better assist you to add new tasks.
Also you can raise your modification suggestions on our document (sorry for not making it more clear).
https://github.com/EvolvingLMMs-Lab/lmms-eval/blob/main/docs/task_guide.md
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Hi everyone, thanks for using lmms-eval.
We are aware of there are challenges in integrating new tasks for new users in
lmms-eval
andlm-evaluation-harness
.It's welcome that you can share your issues and questions to us, so we can better assist you to add new tasks.
Also you can raise your modification suggestions on our document (sorry for not making it more clear).
https://github.com/EvolvingLMMs-Lab/lmms-eval/blob/main/docs/task_guide.md
The text was updated successfully, but these errors were encountered: