minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Improve parameters usage constraints for npu deployment (#22700)

Browse Source 
Co-authored-by: h30064329 <hanbing45@h-partners.com>
This commit is contained in:
loading66
2026-04-13 22:02:56 +08:00
committed by GitHub
co-authored by h30064329
parent 56c97c7738
commit 2089ac86a7
1 changed files with 23 additions and 25 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/platforms/ascend/ascend_npu_support_features.md
+2 -4
View File
@@ -244,9 +244,9 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen
## Expert parallelism
| Argument | Defaults | Options | Server supported |
|-------------------------------------------------------|-----------|---------------------------------------------|:----------------:|
|-------------------------------------------------------|-----------|---------------------------------------------------------------------------|:----------------:|
| `--expert-parallel-size`<br/>`--ep-size`<br/>`--ep` | `1` | Type: int | A2, A3 |
| `--moe-a2a-backend` | `none` | `none`,<br/> `deepep`,<br/> `ascend_fuseep` | A2, A3 |
| `--moe-a2a-backend` | `none` | `none`,<br/> `deepep`,<br/> `ascend_fuseep`(It is incompatible with eplb) | A2, A3 |
| `--moe-runner-backend` | `auto` | `auto`, `triton` | A2, A3 |
| `--flashinfer-mxfp4-`<br/>`moe-precision` | `default` | `default`,<br/> `bf16` | Special for GPU |
| `--enable-flashinfer-`<br/>`allreduce-fusion` | `False` | bool flag<br/> (set to enable) | Special for GPU |
@@ -436,8 +436,6 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen
| Argument | Defaults | Options | Server supported |
|-----------------------------------------------|----------|--------------------------------|:----------------:|
| `--mm-max-concurrent-calls` | `32` | Type: int | A2, A3 |
| `--mm-per-request-timeout` | `10.0` | Type: float | A2, A3 |
| `--enable-broadcast-mm-`<br/>`inputs-process` | `False` | bool flag<br/> (set to enable) | A2, A3 |
| `--mm-process-config` | `None` | Type: JSON / Dict | A2, A3 |
| `--mm-enable-dp-encoder` | `False` | bool flag<br/> (set to enable) | A2, A3 |