minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Modify the optional values and constraints of parameter. (#22705)

Browse Source
This commit is contained in:
chx96642264
2026-04-13 22:50:48 +08:00
committed by GitHub
parent b6a91b1afe
commit c6403a11cb
1 changed files with 12 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/platforms/ascend/ascend_npu_support_features.md
+3 -3
View File
@@ -274,14 +274,14 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen
| `--max-mamba-cache-size` | `None` | Type: int | A2, A3 |
| `--mamba-ssm-dtype` | `float32` | `float32`,<br/>`bfloat16`,<br/>`float16` | A2, A3 |
| `--mamba-full-memory-ratio` | `0.9` | Type: float | A2, A3 |
| `--mamba-scheduler-strategy` | `auto` | Only `auto`, `no_buffer` supported | A2, A3 |
| `--mamba-scheduler-strategy` | `auto` | `auto`,<br/>`no_buffer`,<br/>`extra_buffer` | A2, A3 |
| `--mamba-track-interval` | `256` | Type: int | A2, A3 |
## Hierarchical cache
| Argument | Defaults | Options | Server supported |
|-------------------------------------------------|-----------------|---------------------------------------------------------------------|:----------------:|
| `--enable-hierarchical-`<br/>`cache` | `False` | bool flag<br/> (set to enable) | A2, A3 |
|-------------------------------------------------|-----------------|-------------------------------------------------------------------------------|:----------------:|
| `--enable-hierarchical-`<br/>`cache` | `False` | bool flag<br/> (set to enable).<br/> Currently, mamba cache is not supported. | A2, A3 |
| `--hicache-ratio` | `2.0` | Type: float | A2, A3 |
| `--hicache-size` | `0` | Type: int | A2, A3 |
| `--hicache-write-policy` | `write_through` | Currently only `write_back` supported | A2, A3 |