Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to fix the following errors? #6

Open
missflash opened this issue Sep 11, 2023 · 1 comment
Open

How to fix the following errors? #6

missflash opened this issue Sep 11, 2023 · 1 comment

Comments

@missflash
Copy link

missflash commented Sep 11, 2023

The following error occurred while running cell 10 in 6. Tune language model using PPO with our preference model.
After adding __init__.py to /content/trlx/examples/summarize_rlhf/reward_model/, I still get the same error.
How can I fix it?

     10 import torch
     11 from datasets import load_dataset
---> 12 from reward_model.reward_model import GPTRewardModel
     13 from tqdm import tqdm
     14 from transformers import AutoTokenizer

ModuleNotFoundError: No module named 'reward_model.reward_model'; 'reward_model' is not a package
@VimukthiRandika1997
Copy link

I got the same issue!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants