minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity

[NPU] offloading docs update (#23378)

Browse Source 
Co-authored-by: Jianzhao Xu <xujianchao@huawei.com>
This commit is contained in:
jianzhao-xu
2026-04-22 11:01:55 +08:00
committed by GitHub
co-authored by Jianzhao Xu
parent 4befc31408
commit 2f3e6a3143
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/platforms/ascend/ascend_npu_support_features.md
+1 -1
View File
@@ -305,7 +305,7 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen
| `--offload-group-size` | `-1` | Type: int (DeepSeek only) | A2, A3 |
| `--offload-num-in-group` | `1` | Type: int (DeepSeek only) | A2, A3 |
| `--offload-prefetch-step` | `1` | Type: int (DeepSeek only) | A2, A3 |
| `--offload-mode` | `cpu` | `cpu` (DeepSeek only) <br/>`meta` (DeepSeek only) <br/>`sharded_gpu` (DeepSeek only) | A2, A3 |
| `--offload-mode` | `cpu` | `cpu` (DeepSeek only) <br/>`meta` (DeepSeek only) <br/>`sharded_gpu` (DeepSeek only, only support tp=1 dp>1) | A2, A3 |
## Args for multi-item scoring