Does this repo fix the bug from "WINDOW ATTENTION IS BUGGED" ?

[tcourat]

Hi,

Beside Hiera paper I have also read WINDOW ATTENTION IS BUGGED:
HOW NOT TO INTERPOLATE POSITION EMBEDDINGS . Does this repository fix this issue ? Thanks

[dbolya]

Unfortunately, this repo does not. However the SAM2 github does have it:
https://github.com/facebookresearch/segment-anything-2/blob/7e1596c0b6462eb1d1ba7e1492430fed95023598/sam2/modeling/backbones/hieradet.py#L265

[Mike-YANG-11]

Dear developer,

Thank you for the amazing works on "Hiera" and "Absolute Window Embeddings".

Since I'm currently working on self-supervised learning research, I would like to know that are you planning to release the implementation of "Absolute Window Embeddings" and their IN1k MAE pre-trained weights? (which will help me a lot)

Thank you so much!

[goirik-chakrabarty]

I would also like to know the same