[diffusion] feat: support loading serialized convrot w4a4 checkpoints (#36039)
This commit is contained in:
@@ -306,6 +306,12 @@ and packed INT4 tensors automatically. Do not add `--quantization`. TP remains
|
||||
subject to each row-parallel shard preserving the checkpoint's ConvRot group
|
||||
boundary, and FSDP is rejected.
|
||||
|
||||
W4A4 ConvRot files are also detected from their layer metadata. Install a
|
||||
current `comfy-kitchen`, then pass a full or pruned FL2VA / Ref2VA file such as
|
||||
`Merserk/MiniMax-H3-INT4-ConvRot/minimax_h3_fl2va_pruned_int4_convrot.safetensors`
|
||||
to `--transformer-weights-path`. The packed weights stay INT4 and the runtime
|
||||
honors each layer's activation mode; omit `--quantization`.
|
||||
|
||||
### Advanced: precomputed AdaLN cache
|
||||
|
||||
The [model card](https://huggingface.co/MiniMaxAI/MiniMax-H3) notes that about
|
||||
@@ -969,6 +975,16 @@ Install `comfy-kitchen>=0.2.27` and omit `--quantization`. SGLang automatically
|
||||
loads its W4A8 language linears and tensorwise INT8 embedding; the unmarked
|
||||
vision tower remains BF16.
|
||||
|
||||
W4A4 Qwen3-VL files use the same overlay, for example:
|
||||
|
||||
```bash Overlay
|
||||
--component-paths.text_encoder \
|
||||
Merserk/MiniMax-H3-INT4-ConvRot/qwen3vl_32b_minimax_h3_int4_convrot.safetensors
|
||||
```
|
||||
|
||||
This checkpoint keeps its unmarked embedding and vision tower in their source
|
||||
precision; no explicit component quantization option is needed.
|
||||
|
||||
The same component option accepts a self-describing Quanto qint8 file without
|
||||
an additional quantization flag:
|
||||
|
||||
|
||||
Reference in New Issue
Block a user