diff --git a/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx b/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx index 9d0e9871e..2c032ec41 100644 --- a/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx +++ b/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx @@ -1314,6 +1314,12 @@ click [Server Arguments](../../advanced_features/server_arguments). `xgrammar` A2, A3 + + `--radix-cache-backend` + `None` + Type: str + A2, A3 + `--mm-attention-backend` `None` @@ -2011,6 +2017,60 @@ click [Server Arguments](../../advanced_features/server_arguments). bool flag
(set to enable) A2, A3 + + `--cuda-graph-config` + `None` + Type: JSON + A2, A3 + + + `--cuda-graph-backend-decode` + `None` + `full`,
`breakable`,
`tc_piecewise`,
`disabled` + A2, A3 + + + `--cuda-graph-backend-prefill` + `None` + `breakable`,
`tc_piecewise`,
`disabled` + A2, A3 + + + `--cuda-graph-max-bs-decode` + `None` + Type: int + A2, A3 + + + `--cuda-graph-max-bs-prefill` + `None` + Type: int + A2, A3 + + + `--cuda-graph-bs-decode` + `None` + Type: List[int] + A2, A3 + + + `--cuda-graph-bs-prefill` + `None` + Type: List[int] + A2, A3 + + + `--disable-prefill-cuda-graph` + `False` + bool flag
(set to enable) + A2, A3 + + + `--disable-decode-cuda-graph` + `False` + bool flag
(set to enable) + A2, A3 + `--cuda-graph-max-bs` `None` @@ -2598,12 +2658,24 @@ click [Server Arguments](../../advanced_features/server_arguments). `zmq_to_scheduler`,
`zmq_to_tokenizer`,
`mooncake` A2, A3 - + `--encoder-urls` `[]` List[str]
(List of encoder server urls) A2, A3 + + `--encoder-bootstrap-port` + `8997` + Type: int + A2, A3 + + + `--encoder-register-urls` + `[]` + List[str] + A2, A3 +