Xiaoyu Zhang
9866fe910b
[diffusion] Speed up LingBot high-quality VAE decode ( #36024 )
2026-08-24 14:13:03 +08:00
Xiaoyu Zhang
cc74aba330
[diffusion] Honor XDG cache for model overlays ( #36019 )
2026-08-24 14:11:26 +08:00
ming_wang
97b176e64c
Support streaming session on NPU ( #32597 )
2026-08-24 14:07:44 +08:00
Shangming Cai
852b04b358
fix(xpu): read enable_deterministic_inference from the config bag ( #36149 )
2026-08-24 13:56:41 +08:00
Xiaoyu Zhang
6d40b8aebf
[diffusion] Fix Hunyuan QKV pack indexing at production video shapes ( #36009 )
2026-08-24 13:39:26 +08:00
Xiaoyu Zhang
b43931e878
[diffusion] Refresh quality and BCG benchmark skills ( #36016 )
...
Signed-off-by: BBuf <1182563586@qq.com >
2026-08-24 13:37:45 +08:00
Yuan Luo and luoyuan.luo
77940dec80
[MoE] Gather the cutlass MoE activation and its scales in one launch ( #34915 )
...
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com >
2026-08-24 13:37:14 +08:00
Mick
3fe18f13cd
[diffusion] feat: add plain component weight overrides ( #36086 )
2026-08-24 13:33:23 +08:00
Mick
8df3b9eff9
[diffusion] feat: support loading mixed w4a8 text encoders ( #36037 )
2026-08-24 13:31:27 +08:00
Xiaoyu Zhang
344613c159
[diffusion] Default Hunyuan VAE to tiled decode ( #36012 )
2026-08-24 13:18:06 +08:00
vikram singh shekhawat
f98b60de80
fix(xpu): enable compressed-tensors FP8 W8A8 on XPU (RedHatAI FP8-dynamic models) ( #33057 )
2026-08-24 12:53:48 +08:00
Lianmin Zheng
b498efce52
chore: move cuda_vmm_utils.py under srt/utils/ ( #36053 )
2026-08-23 21:47:29 -07:00
gaopengff and Ma Mingfei
56834422a1
[Intel XPU] Add xpu pass for biased_topk and hash_topk ( #33323 )
...
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
2026-08-24 12:18:22 +08:00
Chunyuan WU
1daa94a069
[CPU] Fix NUMA/core binding for DP ranks ( #32856 )
2026-08-24 12:15:38 +08:00
Aurick Qiao and Yuwei An
3e30649064
[Fix] Harden FlashAttention CUDA graph metadata bounds ( #35454 )
...
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com >
2026-08-23 21:11:46 -07:00
Xia Weiwen
5b5b29d4e2
[XPU] Use a fused GDN kernel from sgl-kernel for Qwen3.5 ( #33354 )
2026-08-24 12:07:50 +08:00
Xiaoyu Zhang
8dcfb3b5e7
[diffusion] Fuse LongCat-Image QKNorm and interleaved RoPE ( #35995 )
2026-08-24 12:07:26 +08:00
Xiaoyu Zhang
09592f5889
[diffusion] Keep LongLive2 components resident on large GPUs ( #35993 )
2026-08-24 12:06:52 +08:00
Xuan Liao and Ma Mingfei
acba8921bf
[XPU] Support softmax_lse in sgl_kernel::fwd API ( #33840 )
...
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
2026-08-24 12:05:15 +08:00
Mick
7a7b655ddf
[quantization] share bounded post-load device staging ( #35180 )
2026-08-24 11:48:30 +08:00
Mick
5ce700aee8
[diffusion] feat: infer LoRA alpha from safetensors metadata ( #36082 )
2026-08-24 11:46:18 +08:00
Mick
230c052ebc
[diffusion] chore: reuse srt AutoRound for quantized DiTs ( #36068 )
2026-08-24 11:21:44 +08:00
Mick and Claude Opus 5
f294d51a71
[diffusion] fix: fix a refit key error on mapped weights, and stop claiming strides the reload discards ( #35832 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-24 11:11:35 +08:00
Alison Shao
0c1e9bda57
[OpenAI] Drop empty assistant turns for mistral_common tokenizers ( #35915 )
...
mistral_common rejects an assistant turn carrying neither content nor tool calls, while other chat templates ignore it, so an OpenAI-compatible request that works elsewhere failed on Mistral models. Drop those turns before templating; turns with tool_calls, multimodal content, or real text are untouched, and a trailing assistant message is already consumed upstream as the continue_final_message prefix.
2026-08-23 20:07:17 -07:00
Mick
6ca872a11f
[diffusion] chore: fetch metadata beside nested lora weights ( #36057 )
2026-08-24 11:02:23 +08:00
Mick
1a368eca1c
[diffusion] optimization: reuse minimax h3 prompt refinement across outputs ( #36027 )
2026-08-24 11:01:21 +08:00
Xun Sun and siyu
a90d770c40
[Weight Cache] Support static DP/EP layouts ( #33684 )
...
Co-authored-by: siyu <liusy58@linux.alibaba.com >
2026-08-23 19:57:52 -07:00
YangKai0616 and gemini-code-assist[bot]
fbdec2855a
[XPU] Support INT4 dense linear (AWQ/GPTQ) for XPU ( #30236 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-08-24 10:41:59 +08:00
Mick
f6fff25756
[diffusion] feat: support vae weight-file overrides ( #36085 )
2026-08-24 10:33:14 +08:00
Mick
2d84de5e69
[diffusion] feat: support loading serialized comfy w4a8 checkpoints ( #36036 )
2026-08-24 10:32:21 +08:00
YanbingJiang
fd73d4b019
[CPU] Add graph register for fused_sigmoid_mul_cpu, fused_qk_gemma_rmsnorm ( #35506 )
2026-08-24 10:18:57 +08:00
Kalyan Kumar and vshekhawat-hlab
4c02584773
Add intel_xpu to DETERMINISTIC_ATTENTION_BACKEND_CHOICES ( #29143 )
...
Co-authored-by: vshekhawat-hlab <vshekhawat@habana.ai >
2026-08-24 09:47:34 +08:00
Mick
fee00a41db
[diffusion] feat: add composable component weight path cli ( #36078 )
2026-08-24 09:31:08 +08:00
Mick
1c1c9d9b4e
[diffusion] refactor: reuse srt quantization contracts and mxfp8 kernels ( #36063 )
2026-08-24 09:26:54 +08:00
YanbingJiang
167c339c8e
[CPU] Add check for fused_input_proj in TP=4 ( #35669 )
2026-08-24 09:21:03 +08:00
Xiaoyu Zhang
e129fe21e5
[diffusion] Flatten Wan VAE RMSNorm row addressing ( #35981 )
2026-08-24 08:57:54 +08:00
Xiaoyu Zhang
b2eb0fa51e
[diffusion] Keep Cosmos3 Nano resident on high-memory GPUs ( #36000 )
2026-08-24 08:51:58 +08:00
Xiaoyu Zhang
447048dba2
[diffusion] Reject unsafe quality=high BCG replay ( #36008 )
2026-08-24 08:50:26 +08:00
Xiaoyu Zhang
f4448e677f
[diffusion] Reuse SANA fast paths in SANA-Video BCG ( #35961 )
2026-08-24 08:47:04 +08:00
billishyahao
fb6e3872e1
[Mamba] fix mamba index h unexpected assertion for dcp ( #36005 )
2026-08-23 17:15:33 -07:00
Mick
d1af3c8923
[diffusion] feat: support loading native diffusers miniMax h3 components ( #36067 )
2026-08-23 22:13:59 +08:00
Mick
de6a1dbd7a
[diffusion] feat: support hybrid conditioning for minimax h3 ( #36080 )
2026-08-23 21:51:25 +08:00
pllimax and sglang-npu-bot
8014d9d062
[npu] Kill evalscope session by process group and fix report score parsing ( #35988 )
...
Co-authored-by: sglang-npu-bot <sglangnpu@163.com >
2026-08-23 21:31:42 +08:00
Mick
939c00a7e3
[diffusion] feat: support compact qwen3-vl conditioning for minimax h3 ( #36076 )
2026-08-23 21:25:11 +08:00
Mick and Claude Fable 5
886e37a649
[diffusion] CI: guard the anonymous-host budget alongside peak VRAM ( #36051 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-08-23 20:13:46 +08:00
Mick
dd15fb57b5
[diffusion] feat: automatically infer comfy fp8 activation scaling ( #36060 )
2026-08-23 18:43:33 +08:00
Sahithi Chigurupati and Mohammad Miadh Angkad
44db041700
[NVIDIA] Fix SM107 MXFP8 activation prep ( #35405 )
...
Signed-off-by: Sahithi Chigurupati <chigurupati.sahithi@gmail.com >
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com >
2026-08-23 18:17:03 +08:00
27aa48bca1
[Fix] lfm2 detector: recover tool calls dropped by common model-outpu… ( #34237 )
...
Co-authored-by: Claude <noreply@anthropic.com >
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
2026-08-23 18:09:43 +08:00
Mick
e3a008a9db
[diffusion] UX: clean up startup and offload logs ( #36034 )
2026-08-23 16:50:25 +08:00
Cheng Wan and Claude Opus 5
340391a297
config: publish before the launcher reads effective configuration ( #35910 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-08-23 01:20:20 -07:00
Xiaoyu Zhang