Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

zsre数据集有条数据不符合要求? #495

Open
CaiJichang212 opened this issue Mar 21, 2025 · 6 comments
Open

zsre数据集有条数据不符合要求? #495

CaiJichang212 opened this issue Mar 21, 2025 · 6 comments
Labels
question Further information is requested

Comments

@CaiJichang212
Copy link

运行的代码:

export CUDA_VISIBLE_DEVICES=0
python examples/run_knowedit_llama2.py \
    --editing_method=FT \
    --hparams_dir=./hparams/ICE/gpt2-xl.yaml \
    --data_dir=/KnowEdit-ms/benchmark_ZsRE_ZsRE-test-all.json \
    --datatype='zsre' \
    --metrics_save_dir=./results/gpt2-xl/FT

出现的报错

prompt_ :By which company, **D&RGW 463** has been manufactured? 
subject_:**Rio Grande 463**
Subject:Rio Grande 463 do not exist in prompt: By which company, D&RGW 463 has been manufactured?
Traceback (most recent call last):
  File "/home/lyc/TNTprojectz/KE/ICE/examples/run_knowedit_llama2.py", line 230, in <module>
    metrics, edited_model, _ = editor.edit(
  File "/home/lyc/TNTprojectz/KE/ICE/easyeditor/editors/editor.py", line 174, in edit
    requests = self._prepare_requests(prompts, target_new, ground_truth, rephrase_prompts,
  File "/home/lyc/TNTprojectz/KE/ICE/easyeditor/editors/editor.py", line 558, in _prepare_requests
    assert subject_ in prompt_, print(f'Subject:{subject_} do not exist in prompt: {prompt_}')
AssertionError: None

你们有更新后的数据集?
或者直接把这条数据删除?

@CaiJichang212
Copy link
Author

Image 我可以注释这两行代码嘛? 非常期待您的解答。

@zxlzr zxlzr added the question Further information is requested label Mar 21, 2025
@XeeKee XeeKee pinned this issue Mar 21, 2025
@XeeKee
Copy link
Collaborator

XeeKee commented Mar 21, 2025

注释这两行代码会导致rome和memit无法正常使用。
您是从哪个渠道下载的数据集?我会去检查一遍

@XeeKee XeeKee unpinned this issue Mar 21, 2025
@CaiJichang212
Copy link
Author

注释这两行代码会导致rome和memit无法正常使用。 您是从哪个渠道下载的数据集?我会去检查一遍

KnowEdit-ms,从魔搭modelscope社区,只不过是去年下载的。
期待你的解答,非常感谢。

@XeeKee
Copy link
Collaborator

XeeKee commented Mar 21, 2025

您换成hf下载试试,我明天会检查一下modelscope的数据集是否现在还有问题

@CaiJichang212
Copy link
Author

您换成hf下载试试,我明天会检查一下modelscope的数据集是否现在还有问题

谢谢您,我试试,辛苦啦。这么晚还回复我。

@XeeKee
Copy link
Collaborator

XeeKee commented Mar 23, 2025

我已经检查了modelscope的数据,如果您没有其他的问题可以关闭此issue哈

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants