minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[NPU] --attn-cp-size --init-expert-location --eplb-algorithm parameter docs update (#22704)

Browse Source 
Co-authored-by: Jianzhao Xu <xujianchao@huawei.com>
This commit is contained in:
jianzhao-xu
2026-04-13 22:42:34 +08:00
committed by GitHub
co-authored by Jianzhao Xu
parent 8d904e50f2
commit b6a91b1afe
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/platforms/ascend/ascend_npu_support_features.md
+3 -3
View File
@@ -87,7 +87,7 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen
| `--device` | `None` | Type: str | A2, A3 |
| `--tensor-parallel-size`<br/>`--tp-size` | `1` | Type: int | A2, A3 |
| `--pipeline-parallel-size`<br/>`--pp-size` | `1` | Type: int; Currently `2` not supported | A2, A3 |
| `--attention-context-parallel-size`<br/>`--attn-cp-size` | `1` | Type: int | A2, A3 |
| `--attention-context-parallel-size`<br/>`--attn-cp-size` | `1` | Type: int; must be equal to --tp-size | A2, A3 |
| `--moe-data-parallel-size`<br/>`--moe-dp-size` | `1` | Type: int | A2, A3 |
| `--pp-max-micro-batch-size` | `None` | Type: int | A2, A3 |
| `--pp-async-batch-depth` | `None` | Type: int | A2, A3 |
@@ -254,9 +254,9 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen
| `--deepep-config` | `None` | Type: str | Special for GPU |
| `--ep-num-redundant-experts` | `0` | Type: int | A2, A3 |
| `--ep-dispatch-algorithm` | `None` | `static`,<br/> `dynamic`,<br/> `fake` | A2, A3 |
| `--init-expert-location` | `trivial` | Type: str | A2, A3 |
| `--init-expert-location` | `trivial` | `trivial`,<br/> `<path.pt>`,<br/> `<path.json>`,<br/> `<json_string>` | A2, A3 |
| `--enable-eplb` | `False` | bool flag<br/> (set to enable) | A2, A3 |
| `--eplb-algorithm` | `deepseek`| Type: str | A2, A3 |
| `--eplb-algorithm` | `deepseek`| `auto`,<br/> `deepseek` | A2, A3 |
| `--eplb-rebalance-num-iterations` | `1000` | Type: int | A2, A3 |
| `--eplb-rebalance-layers-`<br/>`per-chunk` | `None` | Type: int | A2, A3 |
| `--eplb-min-rebalancing-`<br/>`utilization-threshold` | `1.0` | Type: float | A2, A3 |