Replies: 3 comments
-
Again, dify eated all my storage. |
Beta Was this translation helpful? Give feedback.
0 replies
-
me too, keywords seems not necessary in somet scene |
Beta Was this translation helpful? Give feedback.
0 replies
-
The same issue. Request administrator attention to a serious issue. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Self Checks
1. Is this request related to a challenge you're experiencing? Tell me about your story.
I am using the
create_by_text
API to upload my documents (around 22,000). The documents have been uploaded, but the vectors are still queued for computation (very slow, seems to be calculated one by one rather than in parallel).Last time, I uploaded about 40,000 documents, which resulted in filling up my hard drive space (using over 100GB, while my original files were only around 200MB).
This time, I conducted further observations and found that the
dataset_keyword_tables
table occupies a very high amount of space, which can be said to be largely occupied by this table.I suspect that this table is used to store the keywords corresponding to each document, but I only use vector search. How can I disable keywords? Or is there any way to reduce this table's hard drive usage?
2. Additional context or comments
Related issue: #6269
Beta Was this translation helpful? Give feedback.
All reactions