Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation Error #139

Open
Sunstroperao opened this issue Dec 24, 2024 · 3 comments
Open

Evaluation Error #139

Sunstroperao opened this issue Dec 24, 2024 · 3 comments

Comments

@Sunstroperao
Copy link

[ERROR] Evaluation failed. 'b789de07180846cc972118ee6d1fb027_b0e6fd5561454b2789c853e5350557a8_7' The team name in your submission is [Sunstroperao].

I confirm that the submission format is correct and the team name is identical to the Google Form. Could you help us check it. Thanks!

@ChonghaoSima
Copy link
Contributor

You may use the wrong split for submission. Please use the val split instead of the train split.

@Sunstroperao
Copy link
Author

You may use the wrong split for submission. Please use the val split instead of the train split.

I confirmed the I used the val split. Before using the val set for inference, does it need to be processed into test-llma.json format?

@ChonghaoSima
Copy link
Contributor

does

Please strictly follow the submission procedure, and we also provide the sample of the submission json in the challenge folder. Given the key error it should be the wrong split issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants