diff --git a/.claude/skills/cookbook-add-model/templates/page.mdx.tmpl b/.claude/skills/cookbook-add-model/templates/page.mdx.tmpl index 74afbb02a..62081cf8f 100644 --- a/.claude/skills/cookbook-add-model/templates/page.mdx.tmpl +++ b/.claude/skills/cookbook-add-model/templates/page.mdx.tmpl @@ -27,7 +27,7 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -uv pip install sglang +uv pip install --prerelease=allow sglang ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/Baidu/PaddleOCR-VL.mdx b/docs/cookbook/autoregressive/Baidu/PaddleOCR-VL.mdx index f2cdf9f6a..8623b7206 100644 --- a/docs/cookbook/autoregressive/Baidu/PaddleOCR-VL.mdx +++ b/docs/cookbook/autoregressive/Baidu/PaddleOCR-VL.mdx @@ -19,7 +19,7 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -uv pip install sglang +uv pip install --prerelease=allow sglang ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/Baidu/Unlimited-OCR.mdx b/docs/cookbook/autoregressive/Baidu/Unlimited-OCR.mdx index f276f9cbf..616661ad3 100644 --- a/docs/cookbook/autoregressive/Baidu/Unlimited-OCR.mdx +++ b/docs/cookbook/autoregressive/Baidu/Unlimited-OCR.mdx @@ -22,7 +22,7 @@ uv venv --python 3.12 && source .venv/bin/activate git clone https://github.com/sgl-project/sglang.git cd sglang git fetch origin pull/29186/head && git checkout FETCH_HEAD -uv pip install -e python +uv pip install --prerelease=allow -e python ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/DeepReinforce/Ornith-1.0.mdx b/docs/cookbook/autoregressive/DeepReinforce/Ornith-1.0.mdx index 595876aa7..ad3a1a0d5 100644 --- a/docs/cookbook/autoregressive/DeepReinforce/Ornith-1.0.mdx +++ b/docs/cookbook/autoregressive/DeepReinforce/Ornith-1.0.mdx @@ -19,7 +19,7 @@ Ornith-1.0 model cards recommend SGLang `>=0.5.9`. The Deploy panel below emits ```bash Command pip install --upgrade pip pip install uv -uv pip install "sglang>=0.5.9" +uv pip install --prerelease=allow "sglang>=0.5.9" ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/DeepSeek/DeepSeek-V4.mdx b/docs/cookbook/autoregressive/DeepSeek/DeepSeek-V4.mdx index d9eadf09e..720224104 100644 --- a/docs/cookbook/autoregressive/DeepSeek/DeepSeek-V4.mdx +++ b/docs/cookbook/autoregressive/DeepSeek/DeepSeek-V4.mdx @@ -19,7 +19,7 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -uv pip install sglang +uv pip install --prerelease=allow sglang ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/GLM/GLM-4.6V.mdx b/docs/cookbook/autoregressive/GLM/GLM-4.6V.mdx index 2c101cb71..a8e89d631 100644 --- a/docs/cookbook/autoregressive/GLM/GLM-4.6V.mdx +++ b/docs/cookbook/autoregressive/GLM/GLM-4.6V.mdx @@ -41,7 +41,7 @@ git clone https://github.com/sgl-project/sglang.git cd sglang uv venv source .venv/bin/activate -uv pip install -e "python[all]" --index-url=https://pypi.org/simple +uv pip install --prerelease=allow -e "python[all]" --index-url=https://pypi.org/simple pip install nvidia-cudnn-cu12==9.16.0.29 # Install ffmpeg to support video input sudo apt update diff --git a/docs/cookbook/autoregressive/GLM/GLM-5.2.mdx b/docs/cookbook/autoregressive/GLM/GLM-5.2.mdx index 5ef4ee9a8..3b19ce986 100644 --- a/docs/cookbook/autoregressive/GLM/GLM-5.2.mdx +++ b/docs/cookbook/autoregressive/GLM/GLM-5.2.mdx @@ -19,7 +19,7 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -uv pip install sglang +uv pip install --prerelease=allow sglang ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/InternLM/Intern-S1.mdx b/docs/cookbook/autoregressive/InternLM/Intern-S1.mdx index e5047e6d6..5d9e81b1b 100644 --- a/docs/cookbook/autoregressive/InternLM/Intern-S1.mdx +++ b/docs/cookbook/autoregressive/InternLM/Intern-S1.mdx @@ -15,7 +15,7 @@ Intern-S1 includes the large **Intern-S1** MoE model and the smaller **Intern-S1 Refer to the [official SGLang installation guide](../../../docs/get-started/install), or install from source: ```bash Command -uv pip install 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' +uv pip install --prerelease=allow 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' ``` ## 3. Model Deployment diff --git a/docs/cookbook/autoregressive/InternLM/Intern-S2-Mobius.mdx b/docs/cookbook/autoregressive/InternLM/Intern-S2-Mobius.mdx index 851665c74..e6a22fdeb 100644 --- a/docs/cookbook/autoregressive/InternLM/Intern-S2-Mobius.mdx +++ b/docs/cookbook/autoregressive/InternLM/Intern-S2-Mobius.mdx @@ -19,7 +19,7 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -uv pip install sglang +uv pip install --prerelease=allow sglang ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/InternLM/Intern-S2-Preview.mdx b/docs/cookbook/autoregressive/InternLM/Intern-S2-Preview.mdx index b3ee4bbf1..e4d14f94a 100644 --- a/docs/cookbook/autoregressive/InternLM/Intern-S2-Preview.mdx +++ b/docs/cookbook/autoregressive/InternLM/Intern-S2-Preview.mdx @@ -20,7 +20,7 @@ Install SGLang from source or use an NVIDIA Docker image: ```bash Command # Install from source -uv pip install 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' +uv pip install --prerelease=allow 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' # Or use Docker for NVIDIA GPUs docker pull lmsysorg/sglang:latest diff --git a/docs/cookbook/autoregressive/LiquidAI/LFM2.5.mdx b/docs/cookbook/autoregressive/LiquidAI/LFM2.5.mdx index 6b9abb1f1..1b5862b28 100644 --- a/docs/cookbook/autoregressive/LiquidAI/LFM2.5.mdx +++ b/docs/cookbook/autoregressive/LiquidAI/LFM2.5.mdx @@ -19,7 +19,7 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -uv pip install sglang +uv pip install --prerelease=allow sglang ``` diff --git a/docs/cookbook/autoregressive/Meta/MuseGlimmer.mdx b/docs/cookbook/autoregressive/Meta/MuseGlimmer.mdx index dfa3f3f14..9ae2dd742 100644 --- a/docs/cookbook/autoregressive/Meta/MuseGlimmer.mdx +++ b/docs/cookbook/autoregressive/Meta/MuseGlimmer.mdx @@ -23,7 +23,7 @@ pip install uv # https://github.com/sgl-project/sglang/pull/34262 git clone -b muse-glimmer https://github.com/sgl-project/sglang.git cd sglang -uv pip install -e "python[all]" +uv pip install --prerelease=allow -e "python[all]" ``` Run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/MiniMax/MiniMax-M3.mdx b/docs/cookbook/autoregressive/MiniMax/MiniMax-M3.mdx index bc081ee38..8326f3dc8 100644 --- a/docs/cookbook/autoregressive/MiniMax/MiniMax-M3.mdx +++ b/docs/cookbook/autoregressive/MiniMax/MiniMax-M3.mdx @@ -25,10 +25,10 @@ uv venv --python 3.12 && source .venv/bin/activate git clone https://github.com/sgl-project/sglang.git cd sglang git fetch origin pull/27944/head && git checkout FETCH_HEAD -uv pip install -e python +uv pip install --prerelease=allow -e python ``` -Then run the **Python** output of the command panel below in that environment. The **Docker** tab is simpler — its image bundles the CUDA-13 runtime and the #27944 code. Once [PR #27944](https://github.com/sgl-project/sglang/pull/27944) is merged and released, `uv pip install sglang` will pull M3 support directly. +Then run the **Python** output of the command panel below in that environment. The **Docker** tab is simpler — its image bundles the CUDA-13 runtime and the #27944 code. Once [PR #27944](https://github.com/sgl-project/sglang/pull/27944) is merged and released, `uv pip install --prerelease=allow sglang` will pull M3 support directly. diff --git a/docs/cookbook/autoregressive/Moonshotai/Kimi-K3.mdx b/docs/cookbook/autoregressive/Moonshotai/Kimi-K3.mdx index 499df1e1a..8b88a8ec6 100644 --- a/docs/cookbook/autoregressive/Moonshotai/Kimi-K3.mdx +++ b/docs/cookbook/autoregressive/Moonshotai/Kimi-K3.mdx @@ -19,7 +19,7 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -uv pip install sglang +uv pip install --prerelease=allow sglang ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Nano-Omni.mdx b/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Nano-Omni.mdx index 29bd16733..49d2a25db 100644 --- a/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Nano-Omni.mdx +++ b/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Nano-Omni.mdx @@ -46,7 +46,7 @@ Install SGLang via pip or from source: pip install sglang # Or install from source -uv pip install 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' +uv pip install --prerelease=allow 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' # Or use Docker docker pull lmsysorg/sglang:latest diff --git a/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Nano.mdx b/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Nano.mdx index 0da99a106..ee60b6c92 100644 --- a/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Nano.mdx +++ b/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Nano.mdx @@ -22,7 +22,7 @@ At a high level: Refer to the [official SGLang installation guide](../../../docs/get-started/install), or install nightly wheel through: ```bash Command -uv pip install sglang==0.5.6.post3.dev1278+gad1b4e472 --extra-index-url https://sgl-project.github.io/whl/nightly/ +uv pip install --prerelease=allow sglang==0.5.6.post3.dev1278+gad1b4e472 --extra-index-url https://sgl-project.github.io/whl/nightly/ ``` ## 3. Model Deployment diff --git a/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Super.mdx b/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Super.mdx index e3628971f..1a070ea7e 100644 --- a/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Super.mdx +++ b/docs/cookbook/autoregressive/NVIDIA/Nemotron3-Super.mdx @@ -25,7 +25,7 @@ SGLang from the main branch is required for Nemotron3-Super. You can install fro ```bash Command # Install from source -uv pip install 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' +uv pip install --prerelease=allow 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' # Or use Docker docker pull lmsysorg/sglang:latest diff --git a/docs/cookbook/autoregressive/NVIDIA/Nemotron3.5-Lightning.mdx b/docs/cookbook/autoregressive/NVIDIA/Nemotron3.5-Lightning.mdx index 9f6dc0b7d..92fd60a97 100644 --- a/docs/cookbook/autoregressive/NVIDIA/Nemotron3.5-Lightning.mdx +++ b/docs/cookbook/autoregressive/NVIDIA/Nemotron3.5-Lightning.mdx @@ -19,7 +19,7 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -SGLANG_BUILD_RUST_EXTS=none uv pip install 'git+https://github.com/sgl-project/sglang.git@refs/pull/33554/head#subdirectory=python' +SGLANG_BUILD_RUST_EXTS=none uv pip install --prerelease=allow 'git+https://github.com/sgl-project/sglang.git@refs/pull/33554/head#subdirectory=python' ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/Poolside/Laguna-M.1.mdx b/docs/cookbook/autoregressive/Poolside/Laguna-M.1.mdx index 32976dcbe..ad710058b 100644 --- a/docs/cookbook/autoregressive/Poolside/Laguna-M.1.mdx +++ b/docs/cookbook/autoregressive/Poolside/Laguna-M.1.mdx @@ -23,7 +23,7 @@ uv venv --python 3.12 && source .venv/bin/activate # tagged release — install from main. The serving runtime is in the base dependencies, no extra needed: git clone https://github.com/sgl-project/sglang.git cd sglang -uv pip install -e python +uv pip install --prerelease=allow -e python ``` Then run the **Python** output of the command panel below in that environment. The **Docker** tab is simpler — `lmsysorg/sglang:latest` bundles the CUDA-13 runtime and the M.1 code. diff --git a/docs/cookbook/autoregressive/Poolside/Laguna-S-2.1.mdx b/docs/cookbook/autoregressive/Poolside/Laguna-S-2.1.mdx index 1d4f13b36..70abbba23 100644 --- a/docs/cookbook/autoregressive/Poolside/Laguna-S-2.1.mdx +++ b/docs/cookbook/autoregressive/Poolside/Laguna-S-2.1.mdx @@ -22,7 +22,7 @@ uv venv --python 3.12 && source .venv/bin/activate git clone https://github.com/sgl-project/sglang.git cd sglang -uv pip install -e python +uv pip install --prerelease=allow -e python ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/Poolside/Laguna-XS-2.1.mdx b/docs/cookbook/autoregressive/Poolside/Laguna-XS-2.1.mdx index 7d0ff41fa..a0bfc837f 100644 --- a/docs/cookbook/autoregressive/Poolside/Laguna-XS-2.1.mdx +++ b/docs/cookbook/autoregressive/Poolside/Laguna-XS-2.1.mdx @@ -23,7 +23,7 @@ uv venv --python 3.12 && source .venv/bin/activate git clone https://github.com/sgl-project/sglang.git cd sglang -uv pip install -e python +uv pip install --prerelease=allow -e python ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/Qwen/Qwen3.5.mdx b/docs/cookbook/autoregressive/Qwen/Qwen3.5.mdx index f5cfe5f0b..f7d788b3f 100644 --- a/docs/cookbook/autoregressive/Qwen/Qwen3.5.mdx +++ b/docs/cookbook/autoregressive/Qwen/Qwen3.5.mdx @@ -97,7 +97,7 @@ SGLang from the main branch is required for Qwen3.5. You can install from source ```bash Command # Install from source -uv pip install 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' +uv pip install --prerelease=allow 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' # Or use Docker (NVIDIA GPUs) docker pull lmsysorg/sglang:latest diff --git a/docs/cookbook/autoregressive/Qwen/Qwen3.6.mdx b/docs/cookbook/autoregressive/Qwen/Qwen3.6.mdx index dfe58c543..c71c4c4f0 100644 --- a/docs/cookbook/autoregressive/Qwen/Qwen3.6.mdx +++ b/docs/cookbook/autoregressive/Qwen/Qwen3.6.mdx @@ -77,10 +77,10 @@ SGLang `>=0.5.10` is required for Qwen3.6. You can install from PyPI, from sourc ```bash Command # Install from PyPI -uv pip install sglang +uv pip install --prerelease=allow sglang # Or install from source -uv pip install 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' +uv pip install --prerelease=allow 'git+https://github.com/sgl-project/sglang.git#subdirectory=python' # Or use Docker (NVIDIA GPUs; also serves the NVFP4 variants) docker pull lmsysorg/sglang:latest diff --git a/docs/cookbook/autoregressive/Qwen/Qwen3.8-27B.mdx b/docs/cookbook/autoregressive/Qwen/Qwen3.8-27B.mdx index f098ba7e5..4d3205ff8 100644 --- a/docs/cookbook/autoregressive/Qwen/Qwen3.8-27B.mdx +++ b/docs/cookbook/autoregressive/Qwen/Qwen3.8-27B.mdx @@ -19,14 +19,14 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -uv pip install sglang +uv pip install --prerelease=allow sglang # For the DFLASH2 cells only — DFlash2 selector support is newer than the # latest release, so build from the commit those cells were validated on # instead of the line above: # git clone https://github.com/sgl-project/sglang.git && cd sglang # git checkout 1cf2b8c54d81802abc15dcf23a29b9cc687bc01e # PR #35496 -# uv pip install -e "python[all]" +# uv pip install --prerelease=allow -e "python[all]" ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/Qwen/Qwen3.8.mdx b/docs/cookbook/autoregressive/Qwen/Qwen3.8.mdx index 5a4e9b286..4b9589d82 100644 --- a/docs/cookbook/autoregressive/Qwen/Qwen3.8.mdx +++ b/docs/cookbook/autoregressive/Qwen/Qwen3.8.mdx @@ -18,7 +18,7 @@ For all methods and hardware platforms, see the [official SGLang installation gu ```bash Command pip install --upgrade pip pip install uv -uv pip install sglang +uv pip install --prerelease=allow sglang ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/RedNote/Dots3-Note.mdx b/docs/cookbook/autoregressive/RedNote/Dots3-Note.mdx index faa0f7203..feb71c55a 100644 --- a/docs/cookbook/autoregressive/RedNote/Dots3-Note.mdx +++ b/docs/cookbook/autoregressive/RedNote/Dots3-Note.mdx @@ -23,7 +23,7 @@ uv venv --python 3.12 && source .venv/bin/activate git clone https://github.com/sgl-project/sglang.git cd sglang git fetch origin pull/33829/head && git checkout FETCH_HEAD -uv pip install -e python +uv pip install --prerelease=allow -e python ``` Then run the **Python** output of the command panel below in that environment. diff --git a/docs/cookbook/autoregressive/Tencent/Hy3.mdx b/docs/cookbook/autoregressive/Tencent/Hy3.mdx index 859c0f79b..6143d9434 100644 --- a/docs/cookbook/autoregressive/Tencent/Hy3.mdx +++ b/docs/cookbook/autoregressive/Tencent/Hy3.mdx @@ -21,11 +21,11 @@ pip install -U uv uv venv --python 3.12 && source .venv/bin/activate # Install from source (main carries the suffix-aware `hunyuan` parser + the -# HYV3 model code). Once a tagged release picks it up, `uv pip install sglang` -# is enough. +# HYV3 model code). Once a tagged release picks it up, +# `uv pip install --prerelease=allow sglang` is enough. git clone https://github.com/sgl-project/sglang.git cd sglang -uv pip install -e python +uv pip install --prerelease=allow -e python ``` Run the **Python** output of the command panel below in that environment. diff --git a/docs/docs/get-started/install.mdx b/docs/docs/get-started/install.mdx index cddd74002..669bcf482 100644 --- a/docs/docs/get-started/install.mdx +++ b/docs/docs/get-started/install.mdx @@ -25,6 +25,10 @@ pip install uv uv pip install --prerelease=allow sglang ``` + +Some of SGLang's dependencies only publish pre-releases on PyPI, so without `--prerelease=allow` uv older than 0.12.0 silently installs SGLang 0.5.9. On [uv 0.12.0](https://github.com/astral-sh/uv/releases/tag/0.12.0) and newer the flag is a harmless no-op. + + The major version of Cuda is 13 by default. To install sglang under Cuda 12 with pip or uv, please try the following commands: ```bash Command pip install --upgrade pip