You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@holderhe at this point I don't have the time to prioritize models like this, if someone created a fully functional and clean PR I'd consider, but it's a bit of work to pass the tests.
For reference, much closer to original vit arch (with a few tweaks), updated training recipe my explorations here appear quite a bit better than those models on in1k pretrain when you compare img/sec .... see the 82.5 top-1% little vs the 81.5 t2t_vit_14, without f.sdpa the vit_little is slightly faster in infer, quite a bit in train, and then with the F.sdpa (default0 enabled it's much faster. https://huggingface.co/timm/vit_little_patch16_reg1_gap_256.sbb_in12k
add t2t_vit
The text was updated successfully, but these errors were encountered: