Skip to content

Commit

Permalink
charm is supported by opencompass
Browse files Browse the repository at this point in the history
  • Loading branch information
jxd0712 committed Jul 27, 2024
1 parent 22d5804 commit 1d0b0ef
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 6 deletions.
4 changes: 1 addition & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -84,14 +84,12 @@


## 🚀 What's New
- **[2024.7.26]** All inference and evaluation of CHARM are supported by [Opencompass](https://github.com/open-compass/opencompass).🔥🔥🔥
- **[2024.6.06]** Leaderboard updated! LLaMA-3, GPT-4o, Gemini-1.5, Yi1.5, Qwen1.5, etc. are evaluated.
- **[2024.5.24]** CHARM has been open-sourced !!! 🔥🔥🔥
- **[2024.5.15]** CHARM has been accepted to the main conference of the 62nd Annual Meeting of the Association for Computational Linguistics (ACL 2024) !!! 🔥🔥🔥
- **[2024.3.21]** Paper available on [ArXiv](https://arxiv.org/abs/2403.14112).

## 🧾 TODO
- [ ] Support inference and evaluation on Opencompass.

## 🛠️ Inference and Evaluation on Opencompass
Below are the steps for quickly downloading CHARM and using OpenCompass for evaluation.

Expand Down
4 changes: 1 addition & 3 deletions README_ZH.md
Original file line number Diff line number Diff line change
Expand Up @@ -82,14 +82,12 @@


## 🚀 新增功能
- **[2024.7.26]** [Opencompass](https://github.com/open-compass/opencompass)支持CHARM的所有推理和评测任务.🔥🔥🔥
- **[2024.6.06]** 更新排行榜,评测了LLaMA-3、GPT-4o、Gemini-1.5、Yi1.5、Qwen1.5等模型.
- **[2024.5.24]** 开源CHARM数据 !!! 🔥🔥🔥
- **[2024.5.15]** CHARM已被计算语言学协会第62届年会(ACL 2024)主会议接受!!! 🔥🔥🔥
- **[2024.3.21]** 论文发布在 [ArXiv](https://arxiv.org/abs/2403.14112).

## 🧾 待办
- [ ] 支持在Opencompass上进行推理和评测。

## 🛠️ 在 Opencompass 上进行推理和评测
以下是快速下载 CHARM 并在 OpenCompass 上进行评估的步骤。

Expand Down

0 comments on commit 1d0b0ef

Please sign in to comment.