diff --git a/docs/docs/developer_guide/msprobe_debugging_guide.mdx b/docs/docs/developer_guide/msprobe_debugging_guide.mdx index 3b8a69499..51c7ea231 100644 --- a/docs/docs/developer_guide/msprobe_debugging_guide.mdx +++ b/docs/docs/developer_guide/msprobe_debugging_guide.mdx @@ -235,7 +235,7 @@ After locating the divergent node (e.g., a specific Conv layer or torch API with ### No Dump Files Generated -1. To confirm if MSProbe is installed, use `pip show mindstudio_probe` to troubleshoot. If it is installed, the MSProbe +1. To confirm if MSProbe is installed, use `pip show mindstudio-probe` to troubleshoot. If it is installed, the MSProbe version information will be printed. If it is confirmed that it has not been installed, please use `pip install mindstudio-probe --pre` for installation; 2. Confirm the `--msprobe-dump-config` parameter points to the **correct JSON file path**. diff --git a/docs/docs/hardware-platforms/ascend-npus/development/support_new_models.mdx b/docs/docs/hardware-platforms/ascend-npus/development/support_new_models.mdx index ece4d062b..a3c30759c 100644 --- a/docs/docs/hardware-platforms/ascend-npus/development/support_new_models.mdx +++ b/docs/docs/hardware-platforms/ascend-npus/development/support_new_models.mdx @@ -12,7 +12,7 @@ SGLang. It also covers how to test new models and register external implementati To support a new model in SGLang, you only need to add a single file under the [SGLang Models Directory](https://github.com/sgl-project/sglang/tree/main/python/sglang/srt/models). You can learn from existing model implementations and create a new file for your model. For most models, you should be able to find a -similar model to start with (e.g., starting from Llama). Also refer how +similar model to start with (e.g., starting from Llama). Also refer to how to [port a Model from vLLM to SGLang](#port-a-model-from-vllm-to-sglang) NPU adaptations are embedded in existing model files (e.g., `llama.py`, `qwen3_vl.py`) through `_is_npu` conditional diff --git a/docs/docs/hardware-platforms/ascend-npus/getting-started/installation.mdx b/docs/docs/hardware-platforms/ascend-npus/getting-started/installation.mdx index 2cbdb691d..f3caf3752 100644 --- a/docs/docs/hardware-platforms/ascend-npus/getting-started/installation.mdx +++ b/docs/docs/hardware-platforms/ascend-npus/getting-started/installation.mdx @@ -16,7 +16,7 @@ You can install SGLang using any of the methods below. Please go through `System Component Version - Obtain Way + Obtain Method @@ -119,7 +119,7 @@ conda activate sglang_npu #### CANN -Prior to start work with SGLang on Ascend you need to install CANN Toolkit, Kernels operator package and NNAL version 9.0.0, check the [installation guide](https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/900/softwareinst/instg/instg_0008.html?OS=openEuler&InstallType=local) +Prior to starting work with SGLang on Ascend, you need to install CANN Toolkit, Kernels operator package and NNAL version 9.0.0, check the [installation guide](https://www.hiascend.com/document/detail/zh/CANNCommunityEdition/900/softwareinst/instg/instg_0008.html?OS=openEuler&InstallType=local) #### MemFabric-Hybrid @@ -140,7 +140,7 @@ installed in addition to MemFabric-Hybrid. pip install memfabric-zbal==1.1.1 ``` -#### PyTorch and PyTorch Framework Adaptor on Ascend +#### PyTorch and PyTorch Framework Adapter on Ascend ```bash Command PYTORCH_VERSION=2.10.0 @@ -270,7 +270,7 @@ alias drun='docker run -it --rm --privileged --network=host --ipc=host --shm-siz --volume /etc/ascend_install.info:/etc/ascend_install.info \ --volume /var/queue_schedule:/var/queue_schedule --volume ~/.cache/:/root/.cache/' -# Add HF_TOKEN env for download model by SGLang. +# Add HF_TOKEN env for downloading models by SGLang. # The container runs with the '--rm' flag, so it will be automatically removed after the command finishes (including Ctrl+C) drun --env "HF_TOKEN=" \ \ @@ -291,7 +291,7 @@ alias drun='docker run -it --rm --privileged --network=host --ipc=host --shm-siz --volume /etc/ascend_install.info:/etc/ascend_install.info \ --volume /var/queue_schedule:/var/queue_schedule --volume ~/.cache/:/root/.cache/' -# Add HF_TOKEN env for download model by SGLang. +# Add HF_TOKEN env for downloading models by SGLang. # The container runs with the '--rm' flag, so it will be automatically removed after the command finishes (including Ctrl+C) drun --env "HF_TOKEN=" \ \ @@ -539,7 +539,7 @@ curl http://127.0.0.1:30000/v1/chat/completions \ }' ``` -Some models return responses accompanied with thinking process content. To disable this output, configure parameters as follows: +Some models return responses accompanied by thinking process content. To disable this output, configure parameters as follows: ```bash Command curl http://127.0.0.1:30000/v1/chat/completions \ diff --git a/docs/docs/hardware-platforms/ascend-npus/reference/environment_variables.mdx b/docs/docs/hardware-platforms/ascend-npus/reference/environment_variables.mdx index fb4d0a03d..fdfc94279 100644 --- a/docs/docs/hardware-platforms/ascend-npus/reference/environment_variables.mdx +++ b/docs/docs/hardware-platforms/ascend-npus/reference/environment_variables.mdx @@ -19,7 +19,7 @@ This document provides a list of commonly used environment variables and aims to SGLANG_NPU_USE_MLAPO - Adopts the MLAPO fusion operator in attention
preprocessing stage of the MLA model. + Adopts the MLAPO fusion operator in the attention
preprocessing stage of the MLA model. false @@ -34,7 +34,7 @@ This document provides a list of commonly used environment variables and aims to SGLANG_NPU_DISABLE_ACL_FORMAT_WEIGHT - Disable cast model weight tensor to a specific NPU
ACL format. + Disable casting model weight tensor to a specific NPU
ACL format. false @@ -109,7 +109,7 @@ This document provides a list of commonly used environment variables and aims to TASK_QUEUE_ENABLE - Used to control the optimization level of the dispatch queue
about the task_queue operator. Detail + Used to control the optimization level of the dispatch queue
for the task_queue operator. Detail 1