From abe3aeb14235cde44ee82420940c3a866cd49a4f Mon Sep 17 00:00:00 2001 From: amote-i <49533125+amote-i@users.noreply.github.com> Date: Wed, 26 Aug 2026 14:51:43 +0800 Subject: [PATCH] [NPU] [DOC] Update CANN version in NPU installation docs (#36325) --- .../getting-started/installation.mdx | 94 ++++++++++++++++++- 1 file changed, 91 insertions(+), 3 deletions(-) diff --git a/docs/docs/hardware-platforms/ascend-npus/getting-started/installation.mdx b/docs/docs/hardware-platforms/ascend-npus/getting-started/installation.mdx index f3caf3752..399ec006b 100644 --- a/docs/docs/hardware-platforms/ascend-npus/getting-started/installation.mdx +++ b/docs/docs/hardware-platforms/ascend-npus/getting-started/installation.mdx @@ -6,6 +6,11 @@ You can install SGLang using any of the methods below. Please go through `System ## Component Version Mapping For SGLang +Each CANN version requires its own matched set of component versions — do not mix versions across sets. + + + + @@ -58,6 +63,71 @@ You can install SGLang using any of the methods below. Please go through `System
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
ComponentVersionObtain Method
HDK25.5.2link
CANN9.1.0Obtain Images
TorchNPU26.1.0link
MemFabric1.1.4`pip install memfabric-hybrid==1.1.4`
Triton3.2.2`pip install https://github.com/triton-lang/triton-ascend/releases/download/v3.2.2/triton_ascend-3.2.2-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl`
`(aarch64 host: replace x86_64 with aarch64)`
SGLang NPU Kernel20260821link
MemFabric-zbal1.1.3`pip install memfabric-zbal==1.1.3`
+ + +SGLang Docker images for the CANN 9.1.0 set have not been published yet. If you deploy with the prebuilt SGLang +images ([Method 2](#method-2-using-docker-image)), use the CANN 9.0.0 set for now. To use the CANN 9.1.0 set, install +SGLang from source ([Method 1](#method-1-installing-from-source-with-prerequisites), with the component versions in +this tab) or start from a CANN 9.1.0 base image (see [Obtain CANN Image](#obtain-cann-image)). + + + + + ### Obtain CANN Image @@ -70,14 +140,22 @@ You can obtain the dependency of a specified version of CANN through an image. ```bash Command +# CANN 9.0.0 docker pull quay.io/ascend/cann:9.0.0-a3-ubuntu22.04-py3.11 + +# CANN 9.1.0 +docker pull quay.io/ascend/cann:9.1.0-a3-ubuntu22.04-py3.12 ``` ```bash Command +# CANN 9.0.0 docker pull quay.io/ascend/cann:9.0.0-910b-ubuntu22.04-py3.11 + +# CANN 9.1.0 +docker pull quay.io/ascend/cann:9.1.0-910b-ubuntu22.04-py3.12 ``` @@ -87,16 +165,22 @@ docker pull quay.io/ascend/cann:9.0.0-910b-ubuntu22.04-py3.11 ### Method 1: Installing from source with prerequisites +The steps in this method install the **CANN 9.0.0** set. To install the CANN 9.1.0 set from source, follow the same steps +with the component versions from the [version mapping table](#component-version-mapping-for-sglang) (python 3.12 is +required for the CANN 9.1.0 set). + #### Python Version -**Only `python==3.11` is supported currently**. If you don't want to break system pre-installed python, try installing with [conda](https://github.com/conda/conda). +**The CANN 9.0.0 set requires `python==3.11`, and the CANN 9.1.0 set uses `python==3.12`.** If you don't want to break +system pre-installed python, try installing with [conda](https://github.com/conda/conda). ```bash Command conda create --name sglang_npu python=3.11 conda activate sglang_npu ``` -Note on Anaconda repository restrictions +**Note on Anaconda repository restrictions** + If you encounter an error like “Terms of Service have not been accepted” during the conda create step, the default Anaconda repository is blocking package downloads. To resolve this, configure a mirror (e.g., Tsinghua Open Source Mirror): ```bash Command @@ -107,7 +191,7 @@ conda config --set show_channel_urls yes conda config --remove channels defaults ``` -Edit the system-level conda config to remove any hardcoded defaults, e.g., vi ~/miniconda3/.condarc +Edit the system-level conda config to remove any hardcoded defaults, e.g., `vi ~/miniconda3/.condarc`. Then remove the failed environment and recreate it: ```bash Command @@ -209,6 +293,10 @@ Ensure sufficient disk space before pulling images. Each Docker image requires a We publish both **stable releases** and **daily builds**. Choose a stable release tag (e.g., `cann9.0.0-a3-v0.5.16`) if you prefer a validated version, or a daily build tag (e.g., `main-cann9.0.0-a3`) if you need the latest development changes. + +SGLang images for the CANN 9.1.0 set have not been published yet. For now, please use the CANN 9.0.0 images below. + +