From 11d77a60df41e3c9fb0ffec9795333699b1f699d Mon Sep 17 00:00:00 2001 From: amote-i <49533125+amote-i@users.noreply.github.com> Date: Sat, 25 Apr 2026 15:37:07 +0800 Subject: [PATCH] [NPU] [DOC] Update supported models and features of npu (#23564) --- .../ascend_npu_support_features.mdx | 224 ++++++++++++++++++ .../ascend-npus/ascend_npu_support_models.mdx | 99 ++++++++ 2 files changed, 323 insertions(+) diff --git a/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx b/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx index a8ab43b80..dfcbc451b 100644 --- a/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx +++ b/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx @@ -173,6 +173,58 @@ click [Server Arguments](../../advanced_features/server_arguments). +## SSL/TLS + +
| Argument | +Defaults | +Options | +Server supported | +
|---|---|---|---|
| `--ssl-keyfile` | +`None` | +Type: str | +A2, A3 | +
| `--ssl-certfile` | +`None` | +Type: str | +A2, A3 | +
| `--ssl-keyfile-password` | +`None` | +Type: str | +A2, A3 | +
| `--enable-ssl-refresh` | +`False` | +bool flag (set to enable) |
+ A2, A3 | +
| `--enable-http2` | +`False` | +bool flag (set to enable) |
+ A2, A3 | +
| bool flag (set to enable) |
A2, A3 | +||
| `--disable-priority-preemption` | +`False` | +bool flag (set to enable) |
+ A2, A3 | +
| `--default-priority-value` | +`None` | +Type: int | +A2, A3 | +
| `--schedule-low-priority-` `values-first` |
`False` | @@ -495,6 +559,18 @@ click [Server Arguments](../../advanced_features/server_arguments).bool flag (set to enable) | A2, A3 |
--stream-response-default-include-usage |
+ False |
+ bool flag (set to enable) | +A2, A3 | +
--enable-streaming-session |
+ False |
+ bool flag (set to enable) | +A2, A3 | +
--random-seed |
None |
@@ -561,6 +637,18 @@ click [Server Arguments](../../advanced_features/server_arguments).
bool flag (set to enable) | A2, A3 |
--use-ray |
+ False |
+ bool flag (set to enable) | +A2, A3 | +
--custom-sigquit-handler |
+ None |
+ Only for engine | +A2, A3 | +
--file-storage-pathsglang_storage--enable-cache-reportFalsetriton,<br/>csgmv,<br/>ascend,<br/>torch_native--experts-shared-outer-lorasNone--lora-use-virtual-expertsFalse--lora-strict-loadingFalse| Argument | +Defaults | +Options | +Server supported | +
|---|---|---|---|
| `--dllm-algorithm` | +`None` | +Type: str | +A2, A3 | +
| `--dllm-algorithm-config` | +`None` | +Type: str | +A2, A3 | +
| bool flag (set to enable) |
A2, A3 | +||
--enable-dp-attention-local-control-broadcast |
+ `False` | +bool flag (set to enable) |
+ A2, A3 | +
--enable-dp-lm-head |
`False` | @@ -1971,6 +2153,12 @@ click [Server Arguments](../../advanced_features/server_arguments).bool flag (set to enable) |
A2, A3 |
--enforce-shared-experts-fusion |
+ False |
+ bool flag (set to enable) |
+ A2, A3 | +
--disable-chunked-<br/>prefix-cache |
True |
@@ -2043,12 +2231,36 @@ click [Server Arguments](../../advanced_features/server_arguments).
bool flag (set to enable) |
A2, A3 |
| `--enable-prefill-context-parallel` | +`False` | +bool flag (set to enable) |
+ A2, A3 | +
| `--prefill-cp-mode` | +`in-seq-split` | +Type: str | +A2, A3 | +
| `--enable-fused-qk-` `norm-rope` |
`False` | bool flag (set to enable) |
Special for GPU |
| `--enable-precise-embedding-interpolation` | +`False` | +bool flag (set to enable) |
+ A2, A3 | +
| `--gc-threshold` | +`None` | +List[int] | +A2, A3 | +
| Models | +Model Family | +A2 Supported | +A3 Supported | +
|---|---|---|---|
| inclusionAI/LLaDA2.0-flash | +LLaDA2.0 (mini, flash) | +✅ | +✅ | +
| JetLM/SDAR-8B-Chat | +SDAR (JetLM) | +✅ | +✅ | +
| JetLM/SDAR-30B-A3B-Chat | +SDAR (JetLM) | +✅ | +✅ | +