Commit Graph
13679 Commits
Author SHA1 Message Date
Richard Wang 5cb7fb886c [Feature] support pplx-decider-v1.1 and update the pplx-decider cookbooks (#42645) 2026-10-08 09:03:50 +08:00
MickandClaude Opus 5.5 9101e895ea [diffusion] feat: encode the MP4 while the VAE decodes (MiniMax-H3, Wan) (#41819)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 09:01:19 +08:00
Cheng Wan 7760d5264a [Refactor] Use destination layouts for model checkpoint mappings (#42590) 2026-10-07 16:24:22 -07:00
Cheng Wan 5e12831cec [Refactor] Load auxiliary and expert checkpoints using owner partitions (#42589) 2026-10-07 16:24:03 -07:00
Cheng Wan 64c7f65eac [Refactor] Retain process groups in parallel linear layers (#42588) 2026-10-07 16:23:40 -07:00
Cheng Wan 267e34516c [Refactor] Select parallel groups for remaining model projections (#42587) 2026-10-07 16:22:57 -07:00
Cheng Wan dec5d9d6fc [Refactor] Let vision encoders select their parallel group (#42586) 2026-10-07 16:22:32 -07:00
Cheng Wan b83827ea02 [Fix] Quantize reloaded FP8 weights after native sharding (#42585) 2026-10-07 16:20:47 -07:00
Cheng Wan 59740a728f [Refactor] Let MLA projections select their parallel group (#42484) 2026-10-07 16:19:33 -07:00
Cheng Wan 961d7290fe [Refactor] Let model MLPs select their parallel group (#42468) 2026-10-07 16:18:14 -07:00
Cheng Wan 4c5130ac5a [Refactor] Let linear layers select their parallel group (#42426) 2026-10-07 16:15:26 -07:00
Liangsheng Yin 1066decce6 [Scheduler] Replace extend_range with extend_end derived from prefix_len (#42822) 2026-10-07 16:07:16 -07:00
Liangsheng Yin 5349d3e9d2 [Scheduler] Derive prefix KV indices from last_node at allocation; drop Req.prefix_indices (#42825) 2026-10-07 16:03:09 -07:00
Liangsheng Yin e9240b3243 [Scheduler] Track prefill progress as prefix_len (#42824) 2026-10-07 15:59:06 -07:00
Liangsheng Yin 4bf8f28d15 [Scheduler] Fold match write-back into match_kv_cache (#42823) 2026-10-07 15:43:05 -07:00
Liangsheng Yin b1ffe5c16a [dLLM] Keep the request row across FDFO blocks (#42846) 2026-10-07 15:39:33 -07:00
Ping QiuandZhiqiang Xie 685d4d453d [HiCache] Add SeaweedFS L3 storage backend (#42399)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2026-10-07 15:05:37 -07:00
WenhaoZhang 0b635266d4 [diffusion] CI: warm up CI cases at the request's quality level (#42958) 2026-10-07 23:26:36 +08:00
00b21d6415 [diffusion] fix: reset DiT cache state at the start of each request (#42437)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-07 23:25:49 +08:00
Mohammad Miadh AngkadandMohammad Angkad 44d10eab5e [GLM-V] Shard the vision tower over the attention-TP group under DP attention (#42931)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-07 23:17:06 +08:00
d9a0f1cb34 [diffusion] fix: fix hybrid SP+TP for I2V models (#41917)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-07 22:33:03 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 1e86143bf0 [Bugfix] Return None for empty reasoning_content outside K2 Horizon (#42962)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 21:02:40 +08:00
Tianyang GuandClaude Fable 5.1 aa5551d9b6 [diffusion] fix: do not interleave comfy-kitchen MXFP8 scales twice (#38028)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-10-07 17:56:39 +08:00
YC Yen-Ching Tseng c389cbaf99 [AMD][diffusion] Route bf16 fuse_scale_shift to the native fallback on gfx1250 (#42859) 2026-10-07 02:37:43 -07:00
YC Yen-Ching Tseng 49d7d60dfa [AMD][diffusion] VAE attention to the math SDPA backend on gfx1250 (#42858) 2026-10-07 02:32:02 -07:00
Yihao WangandClaude Opus 5.5 11972e5207 [deps] bump transformers to 5.19.0 (#42784)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 17:04:08 +08:00
Rain Jiang c52dcc5a01 The sgalng api specs (#41585) 2026-10-07 01:55:01 -07:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 ba77d30256 [FA4] Keep stream last in the SM100 MLA kernel so disk-cached objects load (#42926)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 15:58:55 +08:00
Khoa Pham e23093077e [DSv4] Fix shared index cache accessor page size (#42832) 2026-10-07 00:53:17 -07:00
jiaryang 1c42ad3679 [ROCm] Skip the tilelang act_quant in the DSA indexer on gfx1250 (#42747) 2026-10-07 00:16:46 -07:00
Hyogeun Oh (오효근)andmickqian 1d019ce1c8 [diffusion] fix: honor the lazy transformer loader contract (#15215)
Signed-off-by: Zerohertz <ohg3417@gmail.com>
Co-authored-by: mickqian <mickqian@users.noreply.github.com>
2026-10-07 14:23:00 +08:00
Mark b0dff4009f [diffusion] cli: restore gated Diffusers model detection (#34903) 2026-10-07 14:21:37 +08:00
Mohammad Miadh AngkadandMohammad Angkad f47d89564d [KDA] Default GLM-5-Next spec verify to the CuTe DSL KDA kernel (#42905)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-06 22:31:41 -07:00
AMD-yanfeiwangandThomas Wang 9ddbba50dd [AMD][DSV4] feat: enable PCP with fp8 unified_kv on gfx950 (#39923)
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-10-06 22:09:18 -07:00
Seas0andMick Qian 43b4abd857 [diffusion] fix: validate SageAttention 2 head sizes without overriding component policy (#41529)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-07 12:39:54 +08:00
Xinyi Song 168458fd90 [AMD][V4.1] Fix wo_b input flatten for packed fp8 activations on gfx950 (#42796) 2026-10-06 21:35:51 -07:00
Khoa Pham 9e26600f3a [DSA] Clarify pooled-page naming and ownership (#42671) 2026-10-06 21:05:29 -07:00
CuzMi bde01f8dc8 [Diffusion] Fuse Anima AdaLN modulation and cache the FFI callable (#42608) 2026-10-07 12:01:59 +08:00
Tuan Nguyen GiaandCursor c0df52be2d [AMD] Fix Quark W4A4 MXFP4 MoE clamped-SwiGLU on the AITER path (#34540)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-10-07 03:20:40 +00:00
Yi (Vincent) ZhongandClaude Opus 5.5 012cd3858b [Fix] Make the fused KDA beta sigmoid bit-identical to torch.sigmoid (#42611)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-06 20:04:59 -07:00
Jay Zenith 35f18848db [diffusion] fix: validate output_quality and fix return type annotation (#19530) 2026-10-07 10:53:29 +08:00
Yash AkhauriandBBuf 9c8fc6a8e4 [Bugfix] Preserve empty K2 Horizon reasoning in chat responses (#42623)
Co-authored-by: BBuf <1182563586@qq.com>
2026-10-07 10:44:55 +08:00
d7190b0122 [Perf] Accelerate DiffusionGemma with FA4 and CUDA graphs on Blackwell (#42239)
Co-authored-by: lianghougong <lianghouhong@xiaohongshu.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-07 10:31:00 +08:00
2f6e0ec45d [DSv4.1] Trim prefill model-entry overhead (#41704)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
2026-10-07 09:50:34 +08:00
7a4d6dfd2f [diffusion] feat: name the quality tiers after what they guarantee (#42370)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-10-07 09:49:30 +08:00
660b17e8dc [AMD] Let AITER unified verify run without host seq_lens (#42635)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: zx3xyy <zx3xyy@users.noreply.github.com>
2026-10-06 18:27:27 -07:00
WenhaoZhang 6da08fd7cf [diffusion] CI: fix qwen cache-dit step 10/49 perf baselines (#42495) 2026-10-07 08:51:12 +08:00
MickandMick Qian 1351f32bb4 [diffusion] refactor: simplify Kandinsky 6 models, SR sampling and tests (#42768)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-10-07 08:48:16 +08:00
f1065423d3 [PD] Stop reserving unallocated mamba spec-verify scratch in prefill KV sizing (#42649)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
2026-10-06 17:16:22 -07:00
08aad0c196 [HiCache] Manage buffer-mode backups per storage pool (#42633)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
2026-10-06 16:45:05 -07:00