Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bump deps for bm25 #16339

Merged
merged 1 commit into from
Oct 2, 2024
Merged

bump deps for bm25 #16339

merged 1 commit into from
Oct 2, 2024

Conversation

logan-markewich
Copy link
Collaborator

@logan-markewich logan-markewich commented Oct 2, 2024

BM25s added more features, like better language support

For example, Italian is possible

import Stemmer
from llama_index.retrievers.bm25 import BM25Retriever

retriever = BM25Retriever(nodes=nodes, language="it", stemmer=Stemmer.Stemmer("Italian"), ...)

Fixes #16333

@dosubot dosubot bot added the size:XS This PR changes 0-9 lines, ignoring generated files. label Oct 2, 2024
@logan-markewich logan-markewich merged commit 4cd774a into main Oct 2, 2024
10 checks passed
@logan-markewich logan-markewich deleted the logan/bump_bm25 branch October 2, 2024 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size:XS This PR changes 0-9 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature Request]: Adding More Lenguage support for bm25 algorithm
1 participant