From 956702510488b4e7730d806d2def633ab3869a44 Mon Sep 17 00:00:00 2001 From: Kleczyk Date: Thu, 4 Apr 2024 03:50:19 +0200 Subject: [PATCH] fix readme --- README.md | 10 +++------- embedingModels/README.md | 11 ++++++++--- 2 files changed, 11 insertions(+), 10 deletions(-) diff --git a/README.md b/README.md index b009f8f..8381813 100644 --- a/README.md +++ b/README.md @@ -63,16 +63,14 @@ docker compose --profile prod up ``` - - ### Dowload embeding and llm (must have for servis llm and sercis embedning-api to work ) ### Embedding api What you need: -- git lfs https://git-lfs.com/ -- ssh key. More info: https://huggingface.co/docs/hub/security-git-ssh or https://huggingface.co/blog/password-git-deprecation -- NVIDIA Docker Toolkit https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html +- git lfs [link](https://git-lfs.com/) +- ssh key. More info: [link](https://huggingface.co/docs/hub/security-git-ssh ) or [link](https://huggingface.co/blog/password-git-deprecation) +- NVIDIA Docker Toolkit [link]([URL](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html)) - GPU From nvidia ```sh @@ -97,5 +95,3 @@ or ```sh wget -P ./llm/models/llama-2-7b.Q3_K_L.gguf https://huggingface.co/TheBloke/Llama-2-7B-GGUF/resolve/main/llama-2-7b.Q3_K_L.gguf ``` - - diff --git a/embedingModels/README.md b/embedingModels/README.md index ec0f5ce..ba83f2f 100644 --- a/embedingModels/README.md +++ b/embedingModels/README.md @@ -3,6 +3,7 @@ ## How run servis ### GPU option + 1. Instal git lfs 2. NVIDIA Docker Toolkit https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html 3. Add shh key to hugingface account https://huggingface.co/docs/hub/security-git-ssh or https://huggingface.co/blog/password-git-deprecation @@ -13,10 +14,13 @@ cd embeding_models git clone git@hf.co:intfloat/e5-large-v2 ``` ### Aleternativ for 1,2,3 + copy evry flie form here: https://huggingface.co/intfloat/multilingual-e5-large/tree/main -#### IMPORTANT +#### IMPORTANT + keep file tree like this !!! + ```sh embeding_models ├── e5-large-v2 @@ -37,6 +41,7 @@ embeding_models ``` ### NO GPU option + from `docker-compose.yml` remove: ```sh @@ -49,9 +54,9 @@ from `docker-compose.yml` remove: 54 capabilities: [ gpu ] ``` -#### MOST IMPORTANT DONT PUSH THIS CHANGE !!! +#### MOST IMPORTANT DONT PUSH THIS CHANGE !!! ps. Patryk don't kill me :'( I want help to beginers. -#### Rest like in GPU option GLHF :) \ No newline at end of file +#### Rest like in GPU option GLHF :)