diff --git a/docs_new/src/snippets/autoregressive/deepseek-v4-deployment.jsx b/docs_new/src/snippets/autoregressive/deepseek-v4-deployment.jsx index d7f00f079..746f69d0f 100644 --- a/docs_new/src/snippets/autoregressive/deepseek-v4-deployment.jsx +++ b/docs_new/src/snippets/autoregressive/deepseek-v4-deployment.jsx @@ -1035,11 +1035,16 @@ SGLANG_OPT_USE_DEEPGEMM_MEGA_MOE=1 SGLANG_OPT_FIX_MEGA_MOE_MEMORY=1 SGLANG_OPT_FIX_NEXTN_MEGA_MOE=1 SGLANG_OPT_DEEPGEMM_MEGA_MOE_NUM_MAX_TOKENS_PER_RANK=8320 -SGLANG_DEEPEP_NUM_MAX_DISPATCH_TOKENS_PER_RANK=0` +SGLANG_DEEPEP_NUM_MAX_DISPATCH_TOKENS_PER_RANK=0 + +# Optional env vars for custom w4a4 MegaMoE kernel +SGLANG_OPT_DEEPGEMM_MEGA_MOE_USE_FP4_ACTS=1 +SGLANG_OPT_DEEPGEMM_MEGA_MOE_USE_MXF4_KIND=1` }

Adjust SGLANG_OPT_DEEPGEMM_MEGA_MOE_NUM_MAX_TOKENS_PER_RANK based on your chunked prefill size (e.g. 4096 for balanced, 8320 for max-throughput).
SGLANG_DEEPEP_NUM_MAX_DISPATCH_TOKENS_PER_RANK=0 — if your config mentions DeepEP dispatch buffer constraints, they do not apply when this is set to 0.
+ SGLANG_OPT_DEEPGEMM_MEGA_MOE_USE_FP4_ACTS=1 SGLANG_OPT_DEEPGEMM_MEGA_MOE_USE_MXF4_KIND=1 for customized w4a4 MegaMoE kernel. With this kernel, the performance can be increased with negligible accuracy drop (~89.5 GPQA for Pro model)
These flags are expected to be simplified in a future release.