From 91190d8a22c6f9dc9dad06813382bd381e9dc518 Mon Sep 17 00:00:00 2001 From: Tianyu Fu Date: Tue, 20 May 2025 11:34:29 +0800 Subject: [PATCH] [minor] Update install.md to correct torch version --- _sources/start/install.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/_sources/start/install.md b/_sources/start/install.md index b20627dd5..a87b5c54a 100644 --- a/_sources/start/install.md +++ b/_sources/start/install.md @@ -16,7 +16,7 @@ uv pip install "sglang[all]>=0.4.6.post4" **Quick Fixes to Common Problems** -- SGLang currently uses torch 2.5, so you need to install flashinfer for torch 2.5. If you want to install flashinfer separately, please refer to [FlashInfer installation doc](https://docs.flashinfer.ai/installation.html). Please note that the FlashInfer pypi package is called `flashinfer-python` instead of `flashinfer`. +- SGLang currently uses torch 2.6, so you need to install flashinfer for torch 2.6. If you want to install flashinfer separately, please refer to [FlashInfer installation doc](https://docs.flashinfer.ai/installation.html). Please note that the FlashInfer pypi package is called `flashinfer-python` instead of `flashinfer`. Please remove the cached flashinfer under your `.cache/flashinfer` before installing a different version. - If you encounter `OSError: CUDA_HOME environment variable is not set`. Please set it to your CUDA install root with either of the following solutions: