minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[NPU] [DOC] fix typos, heading levels and terminology in NPU docs (#40402)

Browse Source
This commit is contained in:
amote-i
2026-09-20 15:15:58 +08:00
committed by GitHub
parent f4c256354c
commit 5c69e32abe
6 changed files with 17 additions and 16 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/docs/hardware-platforms/ascend-npus/evaluation/accuracy_evaluation.mdx
+1
View File
@@ -267,6 +267,7 @@ This is a common workaround for corporate proxy environments. If it does not res
If you cannot obtain the CA certificate, download datasets manually as shown in [Download Dataset Error](#download-dataset-error) below. If you cannot obtain the CA certificate, download datasets manually as shown in [Download Dataset Error](#download-dataset-error) below.
### EvalScope Request Retry Timeout ### EvalScope Request Retry Timeout
If EvalScope keeps retrying requests with errors like: If EvalScope keeps retrying requests with errors like:
``` ```
2026-06-22 03:09:03 - evalscope - WARNING: Attempt 4 / 5 failed: ....... Retrying... 2026-06-22 03:09:03 - evalscope - WARNING: Attempt 4 / 5 failed: ....... Retrying...
docs/docs/hardware-platforms/ascend-npus/faq.mdx
+3 -3
View File
@@ -42,13 +42,13 @@ Thread 0x0000fff873f6f120 (most recent call first):
(SGLangEngine pid=3872176) [ERROR] 2026-04-14-12:14:41 (PID:3874122, Device:0, RankID:-1) ERR00100 PTA call acl api failed (SGLangEngine pid=3872176) [ERROR] 2026-04-14-12:14:41 (PID:3874122, Device:0, RankID:-1) ERR00100 PTA call acl api failed
(SGLangEngine pid=3872176) [Error]: An internal error occurs in the runtime module on the host. (SGLangEngine pid=3872176) [Error]: An internal error occurs in the runtime module on the host.
(SGLangEngine pid=3872176) Rectify the fault based on the error information in the ascend log. (SGLangEngine pid=3872176) Rectify the fault based on the error information in the ascend log.
(SGLangEngine pid=3872176) [PID: 3874122] 2026-04-14-12:14:41.897.548 AclNN_Runtime_Error(EZ9903): aclrtLaunchKerneWithHostArgs failed, return: 507000 (SGLangEngine pid=3872176) [PID: 3874122] 2026-04-14-12:14:41.897.548 AclNN_Runtime_Error(EZ9903): aclrtLaunchKernelWithHostArgs failed, return: 507000
(SGLangEngine pid=3872176) Solution: In this scenario, collect the plog when the fault occurs and locate the fault based on the plog. (SGLangEngine pid=3872176) Solution: In this scenario, collect the plog when the fault occurs and locate the fault based on the plog.
(SGLangEngine pid=3872176) TraceBack (most recent call last): (SGLangEngine pid=3872176) TraceBack (most recent call last):
(SGLangEngine pid=3872176) Check kernel task failed, stream_id=2028, task_id=48, retCode=0x7080005.[FUNC:LaunchKernel][FILE:context.cc][LINE:1585] (SGLangEngine pid=3872176) Check kernel task failed, stream_id=2028, task_id=48, retCode=0x7080005.[FUNC:LaunchKernel][FILE:context.cc][LINE:1585]
(SGLangEngine pid=3872176) rtsLaunchKernelWithHostArgs execution failed, reason=kernel type error[FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:61] (SGLangEngine pid=3872176) rtsLaunchKernelWithHostArgs execution failed, reason=kernel type error[FUNC:FuncErrorReason][FILE:error_message_manage.cc][LINE:61]
(SGLangEngine pid=3872176) rtsLaunchKernelWithHostArgs failed, runtime result = 507000.[FUNC:ReportCallError][FILE:Log_inner.cpp][LINE:148] (SGLangEngine pid=3872176) rtsLaunchKernelWithHostArgs failed, runtime result = 507000.[FUNC:ReportCallError][FILE:Log_inner.cpp][LINE:148]
(SGLangEngine pid=3872176) aclrtLaunchKerneWWithHostArgs failed, return: 507000 (SGLangEngine pid=3872176) aclrtLaunchKernelWithHostArgs failed, return: 507000
(SGLangEngine pid=3872176) Launch kernel failed. (SGLangEngine pid=3872176) Launch kernel failed.
(SGLangEngine pid=3872176) #### KernelLaunch failed: /home/850b160/cann-8.5.8/opp/built-in/op_impl/ai_core/tbe//kernel/ascend910_93/ops_legacy/fill/Fill_41dadce325bOf810d03359af2a38990b_high_performance.o (SGLangEngine pid=3872176) #### KernelLaunch failed: /home/850b160/cann-8.5.8/opp/built-in/op_impl/ai_core/tbe//kernel/ascend910_93/ops_legacy/fill/Fill_41dadce325bOf810d03359af2a38990b_high_performance.o
(SGLangEngine pid=3872176) Kernel Run failed. opType: 18, Fill (SGLangEngine pid=3872176) Kernel Run failed. opType: 18, Fill
@@ -119,7 +119,7 @@ prefill 7.log:3094:RuntimeError: ACL stream synchronize failed, error code:50703
[ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.911 [stream.cc:1335]170327 GetError:AIV Kernel happen error, retCode=0x31. [ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.911 [stream.cc:1335]170327 GetError:AIV Kernel happen error, retCode=0x31.
[ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.929 [stream.cc:1335]170327 GetError:[AIC_INFO] after execute:args print end [ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.929 [stream.cc:1335]170327 GetError:[AIC_INFO] after execute:args print end
[ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.936 stream.cc:13351170327 GetError: DFX INFO1Aicore kernel execute failed, device id=13, stream id=43, report stream id=43, task id=13145, tlip num=56, [ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.936 stream.cc:13351170327 GetError: DFX INFO1Aicore kernel execute failed, device id=13, stream id=43, report stream id=43, task id=13145, tlip num=56,
fault kernel_name=alloc_extend_kernel_18, ault kernel info ext=alloc_extend_kernel, program id=141, hash=14069671779787989248. fault kernel_name=alloc_extend_kernel_18, fault kernel info ext=alloc_extend_kernel, program id=141, hash=14069671779787989248.
[ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.943 [stream.cc:3549]170327 EnterFailureAbort:stream id=43 enter failure abort. [ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.943 [stream.cc:3549]170327 EnterFailureAbort:stream id=43 enter failure abort.
[ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.973 [stars_engine.cc:1427]170327 StarsResumeRtsa:stop scheduling in abort failure mode: stream id=43, sq id=6,sq head=801, task id=13145, taskType=66. [ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.973 [stars_engine.cc:1427]170327 StarsResumeRtsa:stop scheduling in abort failure mode: stream id=43, sq id=6,sq head=801, task id=13145, taskType=66.
[ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.972 [stream.cc:1463]164629 SynchronizeExecutedTask:context is abort, status=0x715005e. [ERROR] RUNTIME(164629,):2026-04-14-05:34:12.383.972 [stream.cc:1463]164629 SynchronizeExecutedTask:context is abort, status=0x715005e.
docs/docs/hardware-platforms/ascend-npus/mindspore_backend.mdx
+6 -6
View File
@@ -33,9 +33,9 @@ pip install -e .
Current SGLang-MindSpore supports Qwen3 and DeepSeek V3/R1 models. This doc uses Qwen3-8B as an example. Current SGLang-MindSpore supports Qwen3 and DeepSeek V3/R1 models. This doc uses Qwen3-8B as an example.
### Offline infer ### Offline Inference
Use the following script for offline infer: Use the following script for offline inference:
<CodeGroup> <CodeGroup>
```python Offline Inference ```python Offline Inference
@@ -107,7 +107,7 @@ python3 -m sglang.launch_server \
## Troubleshooting ## Troubleshooting
#### Debug Mode ### Debug Mode
Enable sglang debug logging by log-level argument. Enable sglang debug logging by log-level argument.
@@ -132,7 +132,7 @@ export GLOG_v=0 # DEBUG
``` ```
</CodeGroup> </CodeGroup>
#### Explicitly select devices ### Explicitly select devices
Use the following environment variable to explicitly select the devices to use. Use the following environment variable to explicitly select the devices to use.
@@ -142,7 +142,7 @@ export ASCEND_RT_VISIBLE_DEVICES=4,5,6,7 # to set device
``` ```
</CodeGroup> </CodeGroup>
#### Some communication environment issues ### Some communication environment issues
In case of some environment with special communication environment, users need set some environment variables. In case of some environment with special communication environment, users need set some environment variables.
@@ -152,7 +152,7 @@ export MS_ENABLE_LCCL=off # current not support LCCL communication mode in SGLan
``` ```
</CodeGroup> </CodeGroup>
#### Some dependencies of protobuf ### Some dependencies of protobuf
In case of some environment with special protobuf version, users need set some environment variables to avoid binary version mismatch. In case of some environment with special protobuf version, users need set some environment variables to avoid binary version mismatch.
docs/docs/hardware-platforms/ascend-npus/optimization/ring_sp_performance.mdx
+1 -1
View File
@@ -1,7 +1,7 @@
--- ---
title: "Ring-SP Performance (Wan2.1-T2V-1.3B)" title: "Ring-SP Performance (Wan2.1-T2V-1.3B)"
metatags: metatags:
description: "This page reports Ring-SP performance on Ascend NPU with torchnpu==2.10.0." description: "This page reports Ring-SP performance on Ascend NPU with torch_npu==2.10.0."
--- ---
This page reports Ring-SP performance on Ascend NPU with `torch_npu==2.10.0`. This page reports Ring-SP performance on Ascend NPU with `torch_npu==2.10.0`.
docs/docs/supported-models/mindspore_models.mdx
+1 -1
View File
@@ -37,7 +37,7 @@ Current SGLang-MindSpore supports Qwen3 and DeepSeek V3/R1 models. This doc uses
Use the following script for offline inference: Use the following script for offline inference:
```python Offline Infer ```python Offline Inference
import sglang as sgl import sglang as sgl
# Initialize the engine with MindSpore backend # Initialize the engine with MindSpore backend