forked from opensearch-project/ml-commons
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
After replicating the local model embeddings. I am able to provide a high level solution of what the tutorial entails. Signed-off-by: Brian Flores <[email protected]>
- Loading branch information
1 parent
1d30671
commit f605636
Showing
1 changed file
with
33 additions
and
0 deletions.
There are no files selected for viewing
33 changes: 33 additions & 0 deletions
33
docs/tutorials/semantic_search/asymmetric_embedding_model.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,33 @@ | ||
# Topic | ||
|
||
This tutorial shows how to generate embeddings using a local asymmetric embedding model in OpenSearch implemented in a Docker container . | ||
|
||
Note: Replace the placeholders that start with `your_` with your own values. | ||
|
||
# Steps | ||
## 1. Spin up a docker OpenSearch Cluster | ||
|
||
### a. Use a docker compose file | ||
|
||
## 2. Prepare the model for OpenSearch | ||
|
||
### a. Clone the model | ||
### b. Zip the contents | ||
### c. Calculate hash | ||
### d. service the zip file using a python server | ||
|
||
- can cancel the server now | ||
|
||
## 3. Register a model group | ||
## 4. Register the model | ||
## 5. Deploy The model | ||
## 6. Run Inference | ||
## Next steps | ||
|
||
- Create an ingest pipeline for your documents with assymetric embeddings | ||
- Run a query using KNN with your asymmetric model | ||
|
||
|
||
# References | ||
|
||
Wang, Liang, et al. (2024). *Multilingual E5 Text Embeddings: A Technical Report*. arXiv preprint arXiv:2402.05672. [Link](https://arxiv.org/abs/2402.05672) |