测评结果为空 #1288
254038lqq
started this conversation in
View all discussions
测评结果为空
#1288
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
我按照文档给的过程配置了环境,但是运行后,结果为空
这是我运行的代码 python3 run.py --models hf_qwen1_5_7b_chat --datasets mmlu_ppl --debug
这是结果:07/04 18:03:41 - OpenCompass - ERROR - /home/archermind/lqq/opencompass/opencompass/opencompass/tasks/openicl_eval.py - _score - 243 - Task [qwen1.5-7b-chat-hf/lukaemon_mmlu_us_foreign_policy]: No predictions found.
07/04 18:03:41 - OpenCompass - DEBUG - Get class
OpenICLEvalTask
from "task" registry in "opencompass"07/04 18:03:41 - OpenCompass - DEBUG - An
OpenICLEvalTask
instance is built from registry, and its implementation can be found in opencompass.tasks.openicl_eval07/04 18:03:42 - OpenCompass - DEBUG - Get class
MMLUDataset
from "load_dataset" registry in "opencompass"07/04 18:03:42 - OpenCompass - DEBUG - An
MMLUDataset
instance is built from registry, and its implementation can be found in opencompass.datasets.mmlu07/04 18:03:42 - OpenCompass - ERROR - /home/archermind/lqq/opencompass/opencompass/opencompass/tasks/openicl_eval.py - _score - 243 - Task [qwen1.5-7b-chat-hf/lukaemon_mmlu_conceptual_physics]: No predictions found.
07/04 18:03:42 - OpenCompass - DEBUG - An
DefaultSummarizer
instance is built from registry, and its implementation can be found in opencompass.summarizers.defaultdataset version metric mode qwen1.5-7b-chat-hf
lukaemon_mmlu_college_biology - - - -
lukaemon_mmlu_college_chemistry - - - -
lukaemon_mmlu_college_computer_science - - - -
lukaemon_mmlu_college_mathematics - - - -
lukaemon_mmlu_college_physics - - - -
lukaemon_mmlu_electrical_engineering - - - -
lukaemon_mmlu_astronomy - - - -
lukaemon_mmlu_anatomy - - - -
lukaemon_mmlu_abstract_algebra - - - -
lukaemon_mmlu_machine_learning - - - -
lukaemon_mmlu_clinical_knowledge - - - -
lukaemon_mmlu_global_facts - - - -
lukaemon_mmlu_management - - - -
lukaemon_mmlu_nutrition - - - -
lukaemon_mmlu_marketing - - - -
有没有人遇到过这个问题呢?
Beta Was this translation helpful? Give feedback.
All reactions