Feature fusion of different modalities

[shiboliu]

hi,

Suppose I want to use your fusion method to fuse the image features [B * 3, 512] and text features [B, 512] extracted from open_clip. For this cross modal fusion, What changes do I need to make in your code to make it work?

Thank you for your great work!