diff --git a/docs/Quickstart.md b/docs/Quickstart.md index 98690772..d9f06d0e 100644 --- a/docs/Quickstart.md +++ b/docs/Quickstart.md @@ -22,9 +22,9 @@ cd llumnix make install ``` -If you want to use NCCL as the migration backend, run `make cupy-cuda` to install (cupy-cuda) [https://pypi.org/search/?q=cupy-cuda] manually, as it is related to the CUDA version. +The default migration backend is RPC. If you want to use NCCL as the migration backend, run `make cupy-cuda` to install (cupy-cuda) [https://pypi.org/search/?q=cupy-cuda] manually, as it is related to the CUDA version. -If you want to use Gloo as migration backend, in addition to installing cupy-cuda, please refer to [this link](https://github.com/ZeldaHuang/pygloo/blob/main/.github/workflows/ubuntu_basic.yml#L24C1-L26C1) to install [Bazel](https://github.com/bazelbuild/bazel) >= 5.1.0. Then, run `make pygloo` to install [pygloo](https://github.com/ZeldaHuang/pygloo). +If you want to use Gloo as migration backend, **in addition to installing cupy-cuda**, please refer to [this link](https://github.com/ZeldaHuang/pygloo/blob/main/.github/workflows/ubuntu_basic.yml#L24C1-L26C1) to install [Bazel](https://github.com/bazelbuild/bazel) >= 5.1.0. Then, run `make pygloo` to install [pygloo](https://github.com/ZeldaHuang/pygloo). Note: Using conda is not recommended, as it cannot properly handle pygloo's dependency on gcc libstdc++.so.6: version GLIBCXX_3.4.30. diff --git a/setup.py b/setup.py index aabc8be7..8aef38f6 100644 --- a/setup.py +++ b/setup.py @@ -33,8 +33,8 @@ def readme(): setup( name='llumnix', - version='0.0.1', - python_requires='>=3.8.1, <=3.10', + version='0.0.2', + python_requires='>=3.8.1, <3.11', description='Efficient and easy multi-instance LLM serving', long_description=readme(), long_description_content_type="text/markdown",