Skip to content
/ vearch Public
forked from vearch/vearch

the vector database on top of CubeFS

License

Notifications You must be signed in to change notification settings

cubefs/vearch

This branch is 17 commits ahead of, 677 commits behind vearch/vearch:master.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

cf60180 · May 24, 2023
Oct 28, 2020
Apr 3, 2023
May 22, 2023
Mar 29, 2023
May 22, 2023
Jul 22, 2022
Mar 3, 2022
Apr 11, 2023
Feb 18, 2022
Dec 21, 2021
May 22, 2023
May 22, 2023
Nov 5, 2021
Mar 7, 2022
Nov 5, 2021
Nov 18, 2021
Mar 29, 2023
May 22, 2023
Nov 5, 2021
May 29, 2020
Jul 15, 2021
Nov 3, 2019
Sep 27, 2019
Sep 27, 2019
Sep 27, 2019
Jan 11, 2022
Sep 3, 2020
May 24, 2023
Dec 17, 2021
Jul 28, 2020
Jan 25, 2022
Jan 25, 2022
Jan 25, 2022

Repository files navigation

Build Status     Gitter

Overview

Here we build a cloud native vector database on top of CubeFS, It supports failover function and separates storage and computation by design.

Architecture

  • Data Model

    space, documents, vectors, scalars

  • Components

    Master, Router and PartitionServer

  • Master

    Responsible for schema mananagement, cluster-level metadata, and resource coordination.

  • Router

    Provides RESTful API: create , delete search and update ; request routing, and result merging.

  • PartitionServer (PS)

    Hosts space partitions; each partition has document store, inverted index and vector index.

    Gamma is the core vector search engine implemented based on faiss. It provides the ability of storing, indexing and retrieving the vectors and scalars.

Quick start

APIs and Use Cases

LowLevelAPI

PythonSDKAPI

Document

Benchmarks

Publication

Jie Li, Haifeng Liu, Chuanghua Gui, Jianyu Chen, Zhenyun Ni, Ning Wang, Yuan Chen. The Design and Implementation of a Real Time Visual Search System on JD E-commerce Platform. In the 19th International ACM Middleware Conference, December 10–14, 2018, Rennes, France. https://arxiv.org/abs/1908.07389

Community

You can report bugs or ask questions in the issues page of the repository.

For public discussion of Vearch or for questions, you can also send email to [email protected].

Our slack : https://vearchwrokspace.slack.com

Known Users

Welcome to register the company name in this issue: vearch#230 (in order of registration)

欢迎在此 issue vearch#230 中登记公司名称

科大讯飞 飞搜科技 君库科技 爱奇艺 人民科技 趣头条 网易严选 咸唐科技 华为技术 OPPO 汽车之家 芯翌智能 图灵机器人 金山云 汇智通信 小红书 VIVO JD

Wechat official communication group

Official Accounts

License

Licensed under the Apache License, Version 2.0. For detail see LICENSE and NOTICE.

About

the vector database on top of CubeFS

Resources

License

Code of conduct

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Go 95.9%
  • Python 2.9%
  • Shell 1.2%