Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New Task Guide #299

Open
Luodian opened this issue Oct 6, 2024 · 0 comments
Open

New Task Guide #299

Luodian opened this issue Oct 6, 2024 · 0 comments
Labels
discussion help wanted Extra attention is needed

Comments

@Luodian
Copy link
Contributor

Luodian commented Oct 6, 2024

Hi everyone, thanks for using lmms-eval.

We are aware of there are challenges in integrating new tasks for new users in lmms-eval and lm-evaluation-harness.

It's welcome that you can share your issues and questions to us, so we can better assist you to add new tasks.

Also you can raise your modification suggestions on our document (sorry for not making it more clear).

https://github.com/EvolvingLMMs-Lab/lmms-eval/blob/main/docs/task_guide.md

@Luodian Luodian added help wanted Extra attention is needed discussion labels Oct 6, 2024
@Luodian Luodian pinned this issue Oct 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
discussion help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant