Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

llama3.2_11b_vision用MathVista_MINI测评时,由于不设置.env文件,会报错 #646

Closed
GoogleAlphaZero opened this issue Dec 4, 2024 · 5 comments
Assignees

Comments

@GoogleAlphaZero
Copy link

llama3.2_11b_vision用MathVista_MINI测评时,由于不设置.env文件,会报错。然后我又建立了.env文件,内部是空的,再执行,也一样报错

@GoogleAlphaZero
Copy link
Author

MathVision_MINI也是一样,.env文件内的Openai 密钥为空,会报错

@GoogleAlphaZero
Copy link
Author

MathVista和MathVision,必须要openai的密钥吗?还有哪几个模型必须要密钥,否则无法run通?

@isruihu
Copy link

isruihu commented Dec 17, 2024

跟模型没关系,跟数据集有关系

@PhoenixZ810 PhoenixZ810 self-assigned this Dec 25, 2024
@PhoenixZ810
Copy link
Collaborator

Hello,

Thank you for reaching out.

I hope this message finds you well. I would like to inform you that certain complex benchmarks, such as MMVet and MathVista, require an OpenAI API key to retrieve accurate results. Should you wish to run these specific benchmarks, please ensure you have provided the necessary OpenAI API key. You can verify which benchmarks necessitate an OpenAI API key by reviewing the run.py script in our repository.

@GoogleAlphaZero
Copy link
Author

好的,感谢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants