-
Notifications
You must be signed in to change notification settings - Fork 283
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Added support for weaviate vector database #353
base: main
Are you sure you want to change the base?
Added support for weaviate vector database #353
Conversation
backend/vectordb.requirements.txt
Outdated
@@ -2,4 +2,4 @@ | |||
singlestoredb==1.0.4 | |||
|
|||
### Weaviate client (in progress) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can remove this in progress comment.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
# TODO (chiragjn): Revisit this, we should not be letting `value` be empty | ||
document_ids.add(group.get("groupedBy", {}).get("value", "") or "") | ||
return list(document_ids) | ||
pass |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This function can be removed as it is not in the base class.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
# TODO (chiragjn): Revisit this, we should not be letting `value` be empty | ||
document_ids.add(group.get("groupedBy", {}).get("value", "") or "") | ||
return list(document_ids) | ||
pass | ||
|
||
def delete_documents(self, collection_name: str, document_ids: List[str]): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This function can be removed as it is not in the base class.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
Co-authored-by: Prathamesh Saraf <[email protected]>
Tested the changes locally using weaviate cloud instance.
Initial Insertion(Added two files, file1 and file2):
Incremental Insertion(Added two more file, file3 and file4):
Weaviate dashboard(4 objects inserted to the collection):