Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

运行prune.py时,发现缺少alpaca-lora-7B文件 #3

Open
wuren519 opened this issue Sep 25, 2024 · 4 comments
Open

运行prune.py时,发现缺少alpaca-lora-7B文件 #3

wuren519 opened this issue Sep 25, 2024 · 4 comments

Comments

@wuren519
Copy link

感谢您DEALRec这个工作,我对它很感兴趣。在复现过程中发现缺少alpaca-lora-7B文件,我在网上搜到的alpaca-lora-7B使用会报错,因为我搜到的lora r=16,配置需要lora r=8.
parser.add_argument("--resume_from_checkpoint", type=str, default="/storage/xylin/recommendation/LLM/code/alpaca/alpaca-lora-7B/", help="path of the alpaca lora adapter")
parser.add_argument("--lora_r", default=8, type=int, help="lora r")

@wuren519 wuren519 changed the title 在复现过程中发现缺少alpaca-lora-7B文件 运行prune.py时,发现缺少alpaca-lora-7B文件 Sep 25, 2024
@Mithas-114
Copy link

感谢您DEALRec这个工作,我对它很感兴趣。在复现过程中发现缺少alpaca-lora-7B文件,我在网上搜到的alpaca-lora-7B使用会报错,因为我搜到的lora r=16,配置需要lora r=8. parser.add_argument("--resume_from_checkpoint", type=str, default="/storage/xylin/recommendation/LLM/code/alpaca/alpaca-lora-7B/", help="path of the alpaca lora adapter") parser.add_argument("--lora_r", default=8, type=int, help="lora r")

您好,我也遇到了这个问题,请问您是否有解决方法呢?

@Linxyhaha
Copy link
Owner

感谢您DEALRec这个工作,我对它很感兴趣。在复现过程中发现缺少alpaca-lora-7B文件,我在网上搜到的alpaca-lora-7B使用会报错,因为我搜到的lora r=16,配置需要lora r=8. parser.add_argument("--resume_from_checkpoint", type=str, default="/storage/xylin/recommendation/LLM/code/alpaca/alpaca-lora-7B/", help="path of the alpaca lora adapter") parser.add_argument("--lora_r", default=8, type=int, help="lora r")

您好,我也遇到了这个问题,请问您是否有解决方法呢?

感谢对我们工作的兴趣 :)

alpaca-lora-7B所使用的文件是我们follow了BIGRec 预训练后的ckpt。

为了方便大家运行,我们将实验中用到的base model (llama-7B)以及预训练好的alpaca-lora-7B 的ckpt 分享在google链接中供使用者下载 :)
https://drive.google.com/drive/folders/1q6FpI9QMcHkpIDcBzKeWwEqwqbvvIYCK?usp=sharing

@Mithas-114
Copy link

非常感谢您的分享!祝工作顺利!

@wuren519
Copy link
Author

感谢作者大大的分享!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants