Reason of using _to_llama_similarities as normalization technique in Elastic Search Vector Store #12485
Subham0793
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Because of _to_llama_similarities function, the scores are normalized and maximum score is always at 1.0
What is the reason of this normalization technique, and why has this being called by default?
The problem may arise when some query which is not related to a particular document, is used for retrieving the chunks, and still the results will contain scores starting from 1.0 , even when there is no relation of the chunk with respect to the query.
Code snippet:
return VectorStoreQueryResult( nodes=top_k_nodes, ids=top_k_ids, similarities=_to_llama_similarities(top_k_scores), )
Line no. 623 in
Beta Was this translation helpful? Give feedback.
All reactions