Does anyone try to set image_encoder.requires_grad_(True), and train both the image encoder and the ip_adapter ?

[hongruihuang]

I try to train both the clip image encoder and the ip_adapter,but I got en problem like this

It seems the problem related to clip image encoder, does anyone have idea about this?

[walawalagoose]

Same question as you. I think this link could help you to solve it. I choose the simplist way by modifying .gitconfig.

[hongruihuang]

Same question as you. I think this link could help you to solve it. I choose the simplist way by modifying .gitconfig.

Thanks for your reply，but this seems to have nothing to do with my question,i have no problem linking to huggingface