Commit Graph
13661 Commits
Author SHA1 Message Date
00b21d6415 [diffusion] fix: reset DiT cache state at the start of each request (#42437)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-07 23:25:49 +08:00
Mohammad Miadh AngkadandMohammad Angkad 44d10eab5e [GLM-V] Shard the vision tower over the attention-TP group under DP attention (#42931)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-07 23:17:06 +08:00
d9a0f1cb34 [diffusion] fix: fix hybrid SP+TP for I2V models (#41917)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-07 22:33:03 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 1e86143bf0 [Bugfix] Return None for empty reasoning_content outside K2 Horizon (#42962)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 21:02:40 +08:00
Tianyang GuandClaude Fable 5.1 aa5551d9b6 [diffusion] fix: do not interleave comfy-kitchen MXFP8 scales twice (#38028)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-10-07 17:56:39 +08:00
YC Yen-Ching Tseng c389cbaf99 [AMD][diffusion] Route bf16 fuse_scale_shift to the native fallback on gfx1250 (#42859) 2026-10-07 02:37:43 -07:00
YC Yen-Ching Tseng 49d7d60dfa [AMD][diffusion] VAE attention to the math SDPA backend on gfx1250 (#42858) 2026-10-07 02:32:02 -07:00
Yihao WangandClaude Opus 5.5 11972e5207 [deps] bump transformers to 5.19.0 (#42784)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 17:04:08 +08:00
Rain Jiang c52dcc5a01 The sgalng api specs (#41585) 2026-10-07 01:55:01 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 ba77d30256 [FA4] Keep stream last in the SM100 MLA kernel so disk-cached objects load (#42926)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 15:58:55 +08:00
Khoa Pham e23093077e [DSv4] Fix shared index cache accessor page size (#42832) 2026-10-07 00:53:17 -07:00
jiaryang 1c42ad3679 [ROCm] Skip the tilelang act_quant in the DSA indexer on gfx1250 (#42747) 2026-10-07 00:16:46 -07:00
Hyogeun Oh (오효근)andmickqian 1d019ce1c8 [diffusion] fix: honor the lazy transformer loader contract (#15215)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
2026-10-07 14:23:00 +08:00
Mark b0dff4009f [diffusion] cli: restore gated Diffusers model detection (#34903) 2026-10-07 14:21:37 +08:00
Mohammad Miadh AngkadandMohammad Angkad f47d89564d [KDA] Default GLM-5-Next spec verify to the CuTe DSL KDA kernel (#42905)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-06 22:31:41 -07:00
AMD-yanfeiwangandThomas Wang 9ddbba50dd [AMD][DSV4] feat: enable PCP with fp8 unified_kv on gfx950 (#39923)
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-10-06 22:09:18 -07:00
Seas0andMick Qian 43b4abd857 [diffusion] fix: validate SageAttention 2 head sizes without overriding component policy (#41529)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-07 12:39:54 +08:00
Xinyi Song 168458fd90 [AMD][V4.1] Fix wo_b input flatten for packed fp8 activations on gfx950 (#42796) 2026-10-06 21:35:51 -07:00
Khoa Pham 9e26600f3a [DSA] Clarify pooled-page naming and ownership (#42671) 2026-10-06 21:05:29 -07:00
CuzMi bde01f8dc8 [Diffusion] Fuse Anima AdaLN modulation and cache the FFI callable (#42608) 2026-10-07 12:01:59 +08:00
Tuan Nguyen GiaandCursor c0df52be2d [AMD] Fix Quark W4A4 MXFP4 MoE clamped-SwiGLU on the AITER path (#34540)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-07 03:20:40 +00:00
Yi (Vincent) ZhongandClaude Opus 5.5 012cd3858b [Fix] Make the fused KDA beta sigmoid bit-identical to torch.sigmoid (#42611)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 20:04:59 -07:00
Jay Zenith 35f18848db [diffusion] fix: validate output_quality and fix return type annotation (#19530) 2026-10-07 10:53:29 +08:00
Yash AkhauriandBBuf 9c8fc6a8e4 [Bugfix] Preserve empty K2 Horizon reasoning in chat responses (#42623)
Co-authored-by: BBuf <1182563586@qq.com>
2026-10-07 10:44:55 +08:00
d7190b0122 [Perf] Accelerate DiffusionGemma with FA4 and CUDA graphs on Blackwell (#42239)
Co-authored-by: lianghougong <lianghouhong@xiaohongshu.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-07 10:31:00 +08:00
2f6e0ec45d [DSv4.1] Trim prefill model-entry overhead (#41704)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
2026-10-07 09:50:34 +08:00
7a4d6dfd2f [diffusion] feat: name the quality tiers after what they guarantee (#42370)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-10-07 09:49:30 +08:00
660b17e8dc [AMD] Let AITER unified verify run without host seq_lens (#42635)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: zx3xyy <zx3xyy@users.noreply.github.com>
2026-10-06 18:27:27 -07:00
WenhaoZhang 6da08fd7cf [diffusion] CI: fix qwen cache-dit step 10/49 perf baselines (#42495) 2026-10-07 08:51:12 +08:00
MickandMick Qian 1351f32bb4 [diffusion] refactor: simplify Kandinsky 6 models, SR sampling and tests (#42768)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-07 08:48:16 +08:00
f1065423d3 [PD] Stop reserving unallocated mamba spec-verify scratch in prefill KV sizing (#42649)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
2026-10-06 17:16:22 -07:00
08aad0c196 [HiCache] Manage buffer-mode backups per storage pool (#42633)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
2026-10-06 16:45:05 -07:00
jain-riaandishandhanani fd62ee84f7 feat(grpc): expose follower metadata and node-local KV sources (#39659)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-10-06 16:39:01 -07:00
Chunan ZengandCheng Wan 90aa1cb0fb [Scheduler] Gather prefill-delayer queue timeout across ranks (#42625)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-10-06 16:15:34 -07:00
Jan BernlöhrandPo-Han Huang 0a0fe001f1 fix: route Thor SM110 FP8 and ModelOpt NVFP4 auto backends (#41765)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
2026-10-06 16:02:45 -07:00
6b737fd4c6 Bind the MessageQueue remote socket atomically (#42695)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: charlotte12l <charlotte12l@users.noreply.github.com>
2026-10-06 15:50:59 -07:00
264d1c2015 Back the DFlash-family draft KV pool to the post-capture token count (#42651)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
2026-10-06 14:23:18 -07:00
4506927635 [Metrics] Add per-rank DP attention imbalance metrics (#42755)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: hanming-lu <hanming-lu@users.noreply.github.com>
2026-10-06 14:20:41 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 3eec178e48 [Spec][MegaMoE] Let the speculative draft choose its own W4A4 MXFP4 MegaMoE MMA type (#42022)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 14:09:57 -07:00
Liangsheng Yin 12004043b8 [Metrics] Read scheduled prefill KV tokens from batch prefix_lens (#42797) 2026-10-06 13:11:29 -07:00
a34cba3c62 [HiCache] Resolve write_back to write_through under buffer_only host memory (#42754)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
2026-10-06 11:02:23 -07:00
Byron Hsu abed685de1 [PD] Fix crash for allocation when mamba + pd + decode radix cache (#41927) 2026-10-06 09:36:31 -07:00
Emil BogomolovandEmil Bogomolov e17935820a [diffusion] fix: fix width/height silently dropped on multipart /v1/videos requests (#35108)
Co-authored-by: Emil Bogomolov <zetyquickly@googlemail.com>
2026-10-06 23:31:31 +08:00
WenhaoZhangandMick 2579875b5d [diffusion] feat: support loading community ComfyUI-GGUF Qwen-Image-2.1 transformers (#42556)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-10-06 23:30:48 +08:00
49bafb58cd perf(mla): use native SATFINITE FP8 conversion in MLA KV/Q preparation (#42659)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-06 22:47:47 +08:00
Xiaoshuai Zhangandjet 679d2851ba fix(mimo-vl): keep multimodal features when capturing aux hidden states and correct vision preprocessing (#40888)
Co-authored-by: jet <dev@jetd.one>
2026-10-06 22:15:14 +08:00
16a23a672b [diffusion] model: support Kandinsky 6 (#42743)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Lev Novitskiy <57654885+leffff@users.noreply.github.com>
Co-authored-by: Kirill <kykozlov@gmail.com>
Co-authored-by: Artem Borisov <divotionchannel@gmail.com>
2026-10-06 22:13:29 +08:00
730f1f3e5b [DeepSeek-V4.1] Unify mHC into one state machine and drop medium-batch fusion variants (#42245)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
2026-10-06 21:01:42 +08:00
WenhaoZhang 2a5f45d3d4 [diffusion] fix: skip zero blocks when hashing large conditioning inputs (#42748) 2026-10-06 20:43:08 +08:00
WMCandjacky.cheng ba94488b42 [diffusion] feat: default Qwen-Image 2.1 to VAE tiling on gfx1151 (#41655)
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-10-06 20:20:58 +08:00