[diffusion] feat: support loading comfy nvfp4 minimax h3 checkpoints (#36044)
This commit is contained in:
@@ -314,6 +314,12 @@ honors each layer's activation mode; omit `--quantization`.
|
||||
Mixed exports use the same command: SGLang dispatches each marked layer to its
|
||||
serialized W4A4 or INT8 ConvRot kernel instead of applying one global method.
|
||||
|
||||
Comfy NVFP4 DiTs reuse SGLang's ModelOpt NVFP4 backend, which requires CUDA
|
||||
compute capability 10.0 or newer. Pass a pruned FL2VA / Ref2VA file such as
|
||||
`Abiray/Minimax-H3-nvfp4-INT4-INT8-Convrot/MiniMax_H3_FL2VA_pruned_nvfp4.safetensors`
|
||||
to `--transformer-weights-path` and omit `--quantization`. SGLang infers the
|
||||
packed group size and Comfy scale layout from the checkpoint; FSDP is rejected.
|
||||
|
||||
### Advanced: precomputed AdaLN cache
|
||||
|
||||
The [model card](https://huggingface.co/MiniMaxAI/MiniMax-H3) notes that about
|
||||
|
||||
Reference in New Issue
Block a user