diff --git a/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx b/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx index d022fe465..82e5a6abd 100644 --- a/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx +++ b/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_features.mdx @@ -1247,7 +1247,7 @@ click [Server Arguments](../../advanced_features/server_arguments). `--lora-strict-loading` `False` Type: bool - A2, A3 + Special for GPU `--lora-drain-wait-threshold` @@ -1638,7 +1638,8 @@ click [Server Arguments](../../advanced_features/server_arguments). `--deepep-dispatcher-output-dtype` `auto` - `auto`,
`bf16`,
`int8` + `auto`,
`bf16`,
`int8`
(When enabling DeepEP for a quantized model, set the dispatcher output dtype according to your model’s quantization. +If the value is int8, you must also set the environment variable:DEEP_NORMAL_MODE_USE_INT8_QUANT=1) A2, A3 @@ -2894,7 +2895,7 @@ click [Server Arguments](../../advanced_features/server_arguments). `--enable-quant-communications` `False` - bool flag (set to enable) + bool flag (set to enable)
(When using DeepEP with a quantized model, you must set --deepep-dispatcher-output-dtype) A2, A3 diff --git a/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_models.mdx b/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_models.mdx index 71c3455ae..e372977f2 100644 --- a/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_models.mdx +++ b/docs_new/docs/hardware-platforms/ascend-npus/ascend_npu_support_models.mdx @@ -571,45 +571,6 @@ You are welcome to enable various models based on your business requirements. -## Diffusion language models - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
ModelsModel FamilyA2 SupportedA3 Supported
inclusionAI/LLaDA2.0-flashLLaDA2.0 (mini, flash)✅✅
JetLM/SDAR-8B-ChatSDAR (JetLM)✅✅
JetLM/SDAR-30B-A3B-ChatSDAR (JetLM)✅✅
- ## Embedding Models