From c6403a11cbfc76c245ede585bfd66a89890f52e0 Mon Sep 17 00:00:00 2001 From: chx96642264 Date: Mon, 13 Apr 2026 22:50:48 +0800 Subject: [PATCH] Modify the optional values and constraints of parameter. (#22705) --- .../ascend/ascend_npu_support_features.md | 24 +++++++++---------- 1 file changed, 12 insertions(+), 12 deletions(-) diff --git a/docs/platforms/ascend/ascend_npu_support_features.md b/docs/platforms/ascend/ascend_npu_support_features.md index a46f4854a..9b17a090b 100644 --- a/docs/platforms/ascend/ascend_npu_support_features.md +++ b/docs/platforms/ascend/ascend_npu_support_features.md @@ -274,22 +274,22 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen | `--max-mamba-cache-size` | `None` | Type: int | A2, A3 | | `--mamba-ssm-dtype` | `float32` | `float32`,
`bfloat16`,
`float16` | A2, A3 | | `--mamba-full-memory-ratio` | `0.9` | Type: float | A2, A3 | -| `--mamba-scheduler-strategy` | `auto` | Only `auto`, `no_buffer` supported | A2, A3 | +| `--mamba-scheduler-strategy` | `auto` | `auto`,
`no_buffer`,
`extra_buffer` | A2, A3 | | `--mamba-track-interval` | `256` | Type: int | A2, A3 | ## Hierarchical cache -| Argument | Defaults | Options | Server supported | -|-------------------------------------------------|-----------------|---------------------------------------------------------------------|:----------------:| -| `--enable-hierarchical-`
`cache` | `False` | bool flag
(set to enable) | A2, A3 | -| `--hicache-ratio` | `2.0` | Type: float | A2, A3 | -| `--hicache-size` | `0` | Type: int | A2, A3 | -| `--hicache-write-policy` | `write_through` | Currently only `write_back` supported | A2, A3 | -| `--hicache-io-backend` | `kernel` | `kernel_ascend`,
`direct` | A2, A3 | -| `--hicache-mem-layout` | `layer_first` | `page_first_direct`,
`page_first_kv_split` | A2, A3 | -| `--hicache-storage-`
`backend` | `None` | `file` | A2, A3 | -| `--hicache-storage-`
`prefetch-policy` | `best_effort` | `best_effort`,
`wait_complete`,
`timeout` | Special for GPU | -| `--hicache-storage-`
`backend-extra-config` | `None` | Type: str | Special for GPU | +| Argument | Defaults | Options | Server supported | +|-------------------------------------------------|-----------------|-------------------------------------------------------------------------------|:----------------:| +| `--enable-hierarchical-`
`cache` | `False` | bool flag
(set to enable).
Currently, mamba cache is not supported. | A2, A3 | +| `--hicache-ratio` | `2.0` | Type: float | A2, A3 | +| `--hicache-size` | `0` | Type: int | A2, A3 | +| `--hicache-write-policy` | `write_through` | Currently only `write_back` supported | A2, A3 | +| `--hicache-io-backend` | `kernel` | `kernel_ascend`,
`direct` | A2, A3 | +| `--hicache-mem-layout` | `layer_first` | `page_first_direct`,
`page_first_kv_split` | A2, A3 | +| `--hicache-storage-`
`backend` | `None` | `file` | A2, A3 | +| `--hicache-storage-`
`prefetch-policy` | `best_effort` | `best_effort`,
`wait_complete`,
`timeout` | Special for GPU | +| `--hicache-storage-`
`backend-extra-config` | `None` | Type: str | Special for GPU | ## LMCache