Vector created by the legacy and main branches vectors.bin is different

[JIA-HONG-CHU]

I know that legacy uses openaiclip's github and main branch uses clip_trt's github. I used main branch to make coco's vector.bin and the search perfomance is very bad. I would like to ask where I didn't notice it?

[dusty-nv]

Hello!, yes I recall there being some question of projected vs non (this is unrelated to another mm_projector from VLM) and it resulting in embeddings of dimension 1024 vs 768. clip_trt is using HuggingFace for CLIP/SigLIP vs the legacy branch used openai directly, so will have to double-check exactly which weights are being used to restore the performance building new indexes.