minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Offloading docs update (#22795)

Browse Source 
Co-authored-by: Jianzhao Xu <xujianchao@huawei.com>
This commit is contained in:
jianzhao-xu
2026-04-14 20:03:29 +08:00
committed by GitHub
co-authored by Jianzhao Xu
parent 88253c39b0
commit 68dfffaaa3
1 changed files with 5 additions and 5 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/platforms/ascend/ascend_npu_support_features.md
+5 -5
View File
@@ -301,11 +301,11 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen
| Argument | Defaults | Options | Server supported |
|---------------------------|----------|-----------|:----------------:|
| `--cpu-offload-gb` | `0` | Type: int | A2, A3 |
| `--offload-group-size` | `-1` | Type: int | Planned |
| `--offload-num-in-group` | `1` | Type: int | Planned |
| `--offload-prefetch-step` | `1` | Type: int | Planned |
| `--offload-mode` | `cpu` | Type: str | Planned |
| `--cpu-offload-gb` | `0` | Type: int (must be used with `--disable-cuda-graph`) | A2, A3 |
| `--offload-group-size` | `-1` | Type: int | A2, A3 |
| `--offload-num-in-group` | `1` | Type: int | A2, A3 |
| `--offload-prefetch-step` | `1` | Type: int | A2, A3 |
| `--offload-mode` | `cpu` | `cpu`,<br/> `meta`,<br/> `sharded_gpu` (must be used with `--disable-cuda-graph`, only supported for DeepSeek) | A2, A3 |
## Args for multi-item scoring