Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluating Calibration-There is no output/dev or output/test #1

Open
Mahhos opened this issue Feb 17, 2021 · 0 comments
Open

Evaluating Calibration-There is no output/dev or output/test #1

Mahhos opened this issue Feb 17, 2021 · 0 comments

Comments

@Mahhos
Copy link

Mahhos commented Feb 17, 2021

Hi. Thanks for the great repo. When fine-tuning bert on SNLI task using the commands in the Fine-tuning Models section, one file SNLI_bert-base-uncased.json is generated in the output folder. It seems that for the Evaluating Calibration there should be 2 folders output/dev or output/test. Should we put the generated SNLI_bert-base-uncased.json for both of them?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant