Full-text search for a field

[ava57r]

Hello.
As far as I know, the index for fields with full-text search is stored only in RAM.

how do you estimate memory consumption for full-text search?
Are there any recommendations for setting up such fields to reduce memory consumption?

[ava57r]

I try to upload data into a collection
This collection has some fields with full-text params
And I can not upload data into a collection more than fixed amount vectors
I tried to use
SQ
PQ x8
PQ x16
PQ x32

I always get OOM.

[generall]

We are working on making full-text index more compact in the next minor release of Qdrant.

how do you estimate memory consumption for full-text search?

That depends on the volume of text you are indexing, but I don't have any benchmarks for now

[ava57r]

How does index RAM depend on min_token_len and max_token_len?

Thanks

[generall]

smaller min_token_len = more ram usage
higher max_token_len = more ram usage