Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot load representation layer #6

Open
arkel23 opened this issue Dec 13, 2020 · 0 comments
Open

Cannot load representation layer #6

arkel23 opened this issue Dec 13, 2020 · 0 comments

Comments

@arkel23
Copy link

arkel23 commented Dec 13, 2020

I was trying to load the whole model with pretrained=True and representation layer = True but I get an error
Further inspection by looking at the keys of the state_dict in your config.py file I noticed that there's no such weights in the state_dict for any of the models. It jumps from the transformer weights to a norm layer weights then to the fc weights. It skips the pre_logits.weight. I noticed in your Jupyter notebook it seems to be working correctly. Got any idea what could be wrong?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant