Replies: 1 comment 1 reply
-
Hi @HridayM25, you can make use of cross-encoders such as CLIP to encode and index image embeddings and then run a query against them with a text embedding. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Can we get a search return of another type as opposed to the one we queried?
For example, if I search "Messi goal record" as a query, there a lot of "cards" which are images which contain the said records.
Hence, here if one queries some text, it would make sense to return this said image.
Also, since the "card" will contain information that is better depicted by text, we cannot simply use an image encoder as we will need to do some kind of OCR to derive a semantic meaning.
This was just an idea that crossed my mind.
Example:-
Beta Was this translation helpful? Give feedback.
All reactions