Skip to content

Commit

Permalink
feat: upgrade from xx_sent_ud_sm to SaT
Browse files Browse the repository at this point in the history
  • Loading branch information
lsorber committed Jan 2, 2025
1 parent c41c6f8 commit cc5b9b7
Show file tree
Hide file tree
Showing 6 changed files with 109 additions and 720 deletions.
35 changes: 14 additions & 21 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -39,27 +39,20 @@ RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with Postgr

## Installing

First, begin by installing spaCy's multilingual sentence model:

```sh
# Install spaCy's xx_sent_ud_sm:
pip install https://github.com/explosion/spacy-models/releases/download/xx_sent_ud_sm-3.7.0/xx_sent_ud_sm-3.7.0-py3-none-any.whl
```

Next, it is optional but recommended to install [an accelerated llama-cpp-python precompiled binary](https://github.com/abetlen/llama-cpp-python?tab=readme-ov-file#supported-backends) with:

```sh
# Configure which llama-cpp-python precompiled binary to install (⚠️ On macOS only v0.3.2 is supported right now):
LLAMA_CPP_PYTHON_VERSION=0.3.2
PYTHON_VERSION=310
ACCELERATOR=metal|cu121|cu122|cu123|cu124
PLATFORM=macosx_11_0_arm64|linux_x86_64|win_amd64

# Install llama-cpp-python:
pip install "https://github.com/abetlen/llama-cpp-python/releases/download/v$LLAMA_CPP_PYTHON_VERSION-$ACCELERATOR/llama_cpp_python-$LLAMA_CPP_PYTHON_VERSION-cp$PYTHON_VERSION-cp$PYTHON_VERSION-$PLATFORM.whl"
```

Finally, install RAGLite with:
> [!TIP]
> It is optional but recommended to install [an accelerated llama-cpp-python precompiled binary](https://github.com/abetlen/llama-cpp-python?tab=readme-ov-file#supported-backends) with:
> ```sh
> # Configure which llama-cpp-python precompiled binary to install (⚠️ On macOS only v0.3.2 is supported right now):
> LLAMA_CPP_PYTHON_VERSION=0.3.2
> PYTHON_VERSION=310
> ACCELERATOR=metal|cu121|cu122|cu123|cu124
> PLATFORM=macosx_11_0_arm64|linux_x86_64|win_amd64
>
> # Install llama-cpp-python:
> pip install "https://github.com/abetlen/llama-cpp-python/releases/download/v$LLAMA_CPP_PYTHON_VERSION-$ACCELERATOR/llama_cpp_python-$LLAMA_CPP_PYTHON_VERSION-cp$PYTHON_VERSION-cp$PYTHON_VERSION-$PLATFORM.whl"
> ```
Install RAGLite with:
```sh
pip install raglite
Expand Down
Loading

0 comments on commit cc5b9b7

Please sign in to comment.