Replies: 1 comment 1 reply
-
Lucene supports custom analyzers, and lupyne makes writing one on easier. I'm not as familiar with Solr, but it appears to supports custom analyzers through plugins. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I'm using classical solr/lucene. I'd like to write a python analyzer (part-of-speech NLP library). I couldn't find a good way to do this using solr/lucene. I came across this file which makes me think lupyne might be a solution:
https://github.com/coady/lupyne/blob/main/lupyne/engine/analyzers.py
Or should I instead process the text before inserting into lucene? Eg replace
<word>
with<pos>|<word>
, then tell lucene to split at|
?Beta Was this translation helpful? Give feedback.
All reactions