[diffusion] feat: dispatch fp8 companions in mixed NVFP4 checkpoints (#36066)
This commit is contained in:
@@ -319,8 +319,9 @@ compute capability 10.0 or newer. Pass a pruned FL2VA / Ref2VA file such as
|
||||
`Abiray/Minimax-H3-nvfp4-INT4-INT8-Convrot/MiniMax_H3_FL2VA_pruned_nvfp4.safetensors`
|
||||
to `--transformer-weights-path` and omit `--quantization`. SGLang infers the
|
||||
packed group size and Comfy scale layout from the checkpoint; FSDP is rejected.
|
||||
Mixed files may mark selected linears as `int8_tensorwise`; SGLang dispatches
|
||||
those layers to the serialized Kitchen INT8 ConvRot path automatically.
|
||||
Mixed files may mark selected linears as `int8_tensorwise` or dynamic/static
|
||||
FP8; SGLang dispatches those layers to their serialized Kitchen INT8 or native
|
||||
FP8 path automatically.
|
||||
|
||||
### Advanced: precomputed AdaLN cache
|
||||
|
||||
|
||||
@@ -162,7 +162,7 @@ backend.
|
||||
<td><code>--transformer-path</code> for mixed overrides; <code>--transformer-weights-path</code> for raw exports; <code>--model-path</code> for full repos</td>
|
||||
<td>FLUX.1, FLUX.2, Wan2.2, Qwen Image, Qwen Image 2512, Qwen Image Edit, Qwen Image Edit 2511, MiniMax-H3</td>
|
||||
<td>None</td>
|
||||
<td>Mixed override repos keep the base model separate; full Qwen Image exports can be loaded directly as <code>--model-path</code>; raw exports such as <code>black-forest-labs/FLUX.2-dev-NVFP4</code> use the weights-path flow. Comfy markers select their checkpoint layout automatically; omit <code>--quantization</code>.</td>
|
||||
<td>Mixed override repos keep the base model separate; full Qwen Image exports can be loaded directly as <code>--model-path</code>; raw exports such as <code>black-forest-labs/FLUX.2-dev-NVFP4</code> use the weights-path flow. Comfy markers select NVFP4 plus INT8 or FP8 companion linears automatically; omit <code>--quantization</code>.</td>
|
||||
</tr>
|
||||
<tr>
|
||||
<td><code>gguf</code></td>
|
||||
|
||||
Reference in New Issue
Block a user