[diffusion] feat: dispatch fp8 companions in mixed NVFP4 checkpoints (#36066)

This commit is contained in:
Mick
2026-08-25 11:26:37 +08:00
committed by GitHub
parent 833be86c15
commit 67853c5804
5 changed files with 32 additions and 6 deletions
@@ -319,8 +319,9 @@ compute capability 10.0 or newer. Pass a pruned FL2VA / Ref2VA file such as
`Abiray/Minimax-H3-nvfp4-INT4-INT8-Convrot/MiniMax_H3_FL2VA_pruned_nvfp4.safetensors`
to `--transformer-weights-path` and omit `--quantization`. SGLang infers the
packed group size and Comfy scale layout from the checkpoint; FSDP is rejected.
Mixed files may mark selected linears as `int8_tensorwise`; SGLang dispatches
those layers to the serialized Kitchen INT8 ConvRot path automatically.
Mixed files may mark selected linears as `int8_tensorwise` or dynamic/static
FP8; SGLang dispatches those layers to their serialized Kitchen INT8 or native
FP8 path automatically.
### Advanced: precomputed AdaLN cache
+1 -1
View File
@@ -162,7 +162,7 @@ backend.
<td><code>--transformer-path</code> for mixed overrides; <code>--transformer-weights-path</code> for raw exports; <code>--model-path</code> for full repos</td>
<td>FLUX.1, FLUX.2, Wan2.2, Qwen Image, Qwen Image 2512, Qwen Image Edit, Qwen Image Edit 2511, MiniMax-H3</td>
<td>None</td>
<td>Mixed override repos keep the base model separate; full Qwen Image exports can be loaded directly as <code>--model-path</code>; raw exports such as <code>black-forest-labs/FLUX.2-dev-NVFP4</code> use the weights-path flow. Comfy markers select their checkpoint layout automatically; omit <code>--quantization</code>.</td>
<td>Mixed override repos keep the base model separate; full Qwen Image exports can be loaded directly as <code>--model-path</code>; raw exports such as <code>black-forest-labs/FLUX.2-dev-NVFP4</code> use the weights-path flow. Comfy markers select NVFP4 plus INT8 or FP8 companion linears automatically; omit <code>--quantization</code>.</td>
</tr>
<tr>
<td><code>gguf</code></td>