attention maps code

[taewhankim]

Thank you for sharing your amazing project.
Do you have any plans to share the code to extract the attentions map like in figure 1?
I want to use it to extract an attentions map for zero shot performance.

[byminji]

Hi @taewhankim, thank you for your interest in our work. We modified the attention visualization code in this repo. Specifically, we used max head fusion. Hope this helps :)