Skip to content
This repository has been archived by the owner on Oct 25, 2024. It is now read-only.

update lm-eval to 0.4.3 #1658

Merged
merged 6 commits into from
Jul 11, 2024
Merged

update lm-eval to 0.4.3 #1658

merged 6 commits into from
Jul 11, 2024

Conversation

changwangss
Copy link
Contributor

Type of Change

feature or bug fix or documentation or others
API changed or not

Description

detail description
JIRA ticket: xxx

Expected Behavior & Potential Risk

the expected behavior that triggered by this PR

How has this PR been tested?

how to reproduce the test (including hardware information)

Dependency Change?

any library dependency introduced or removed

Signed-off-by: changwangss <[email protected]>
Copy link

github-actions bot commented Jul 9, 2024

⚡ Required checks status: All passing 🟢

Groups summary

🟢 Format Scan Tests workflow
Check ID Status Error details
format-scan (pylint) success
format-scan (bandit) success
format-scan (cloc) success
format-scan (cpplint) success

These checks are required after the changes to intel_extension_for_transformers/neural_chat/requirements_cpu.txt, intel_extension_for_transformers/neural_chat/requirements_hpu.txt, intel_extension_for_transformers/neural_chat/requirements_win.txt, intel_extension_for_transformers/neural_chat/tests/requirements.txt, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/accuracy.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/evaluator.py, .github/workflows/script/formatScan/pylint.sh.

🟢 Optimize Unit Test workflow
Check ID Status Error details
optimize-unit-test-baseline success
optimize-unit-test-PR-test success
Genreate-OptimizeUT-Report success

These checks are required after the changes to intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/accuracy.py, intel_extension_for_transformers/transformers/llm/evaluation/lm_eval/evaluator.py, tests/requirements.txt.


Thank you for your contribution! 💜

Note
This comment is automatically generated and will be updates every 180 seconds within the next 6 hours. If you have any other questions, contact VincyZhang or XuehaoSun for help.

@changwangss
Copy link
Contributor Author

CI failed will improve by intel/neural-compressor#1908

@XuehaoSun XuehaoSun merged commit 79277b4 into main Jul 11, 2024
14 checks passed
@XuehaoSun XuehaoSun deleted the wangchang/lm-eval branch July 11, 2024 06:57
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants