diff --git a/docs/cookbook/diffusion/MiniMax/MiniMax-H3.mdx b/docs/cookbook/diffusion/MiniMax/MiniMax-H3.mdx index 278f569c6..9b7b032e8 100644 --- a/docs/cookbook/diffusion/MiniMax/MiniMax-H3.mdx +++ b/docs/cookbook/diffusion/MiniMax/MiniMax-H3.mdx @@ -314,6 +314,12 @@ honors each layer's activation mode; omit `--quantization`. Mixed exports use the same command: SGLang dispatches each marked layer to its serialized W4A4 or INT8 ConvRot kernel instead of applying one global method. +Comfy NVFP4 DiTs reuse SGLang's ModelOpt NVFP4 backend, which requires CUDA +compute capability 10.0 or newer. Pass a pruned FL2VA / Ref2VA file such as +`Abiray/Minimax-H3-nvfp4-INT4-INT8-Convrot/MiniMax_H3_FL2VA_pruned_nvfp4.safetensors` +to `--transformer-weights-path` and omit `--quantization`. SGLang infers the +packed group size and Comfy scale layout from the checkpoint; FSDP is rejected. + ### Advanced: precomputed AdaLN cache The [model card](https://huggingface.co/MiniMaxAI/MiniMax-H3) notes that about diff --git a/docs/docs/sglang-diffusion/quantization.mdx b/docs/docs/sglang-diffusion/quantization.mdx index 136dc9d69..8a0faae09 100644 --- a/docs/docs/sglang-diffusion/quantization.mdx +++ b/docs/docs/sglang-diffusion/quantization.mdx @@ -154,11 +154,11 @@ backend.
modelopt-nvfp4config.json, raw NVFP4 safetensors export/repo, or full ModelOpt Diffusers repoconfig.json, raw or Comfy layer-marked NVFP4 safetensors, or full ModelOpt Diffusers repo--transformer-path for mixed overrides; --transformer-weights-path for raw exports; --model-path for full repos--model-path; raw exports such as black-forest-labs/FLUX.2-dev-NVFP4 still use the weights-path flow--model-path; raw exports such as black-forest-labs/FLUX.2-dev-NVFP4 use the weights-path flow. Comfy markers select their checkpoint layout automatically; omit --quantization.gguf