Commit Graph
17220 Commits
Author SHA1 Message Date
3ce4f957eb [diffusion] fix: fix MiniMax-H3 dp_size>1 deadlock and cross-request audio determinism (#36398)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-08-26 14:54:08 +08:00
amote-i abe3aeb142 [NPU] [DOC] Update CANN version in NPU installation docs (#36325) 2026-08-26 14:51:43 +08:00
Ziang Li 3c9febc68b [Spec][DSA] Add --speculative-dsa-topk-backend (#36313) 2026-08-25 23:35:03 -07:00
Khoa PhamandClaude Opus 5 0c84eaba7f [CI] Grant no-cooldown and tag permissions to seven contributors (#36445)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-25 23:23:38 -07:00
weireweireandweireweire db15976fe9 Fix DSV4 DSpark sample-from-anchor initialization (#36419)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-25 23:18:58 -07:00
Tan TrinhandKhoa Pham 04c1036bb3 [Kernel] Skip reserved writes in MLA KV cache (#36003)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
2026-08-25 22:42:23 -07:00
Yihao WangandClaude Opus 5 d7baad0116 [diffusion] Keep the Cosmos3 Super DiT resident on high-memory GPUs (#36375)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-25 21:10:39 -07:00
Alison Shao 3ec22948c1 [CI] /rerun-failed-ci: rerun cancelled runs and target the newest run per workflow (#34057) 2026-08-25 20:15:54 -07:00
34de1fb47f fix(test): stabilize nightly precision regression (#34668)
Co-authored-by: Alison Shao <54658187+alisonshao@users.noreply.github.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-08-25 20:04:52 -07:00
ming_wang 2e4773aadd Fix NPUMHATokenToKVPool missing k_data_ptrs/v_data_ptrs (#35820) 2026-08-26 11:01:11 +08:00
Bingxu Chen 5bcc978f2a [AMD][CI] Pass USE_PDL explicitly in the fused MoE gate (#36306) 2026-08-25 19:57:59 -07:00
Xiaoyu Zhang fa3ac61661 [Diffusion] Bound reusable Ulysses A2A staging buffers across shapes (#36327) 2026-08-26 10:57:29 +08:00
HuangJi cc3b61873f [Diffusion][minimax-h3] Restrict MiniMax-H3 SubBlock sparsity to video queries (#35850) 2026-08-26 10:55:09 +08:00
Alison Shao 4382947b58 Fix DSV4 shared-fusion CPU unit test after the EP guard landed (#36424) 2026-08-25 19:52:05 -07:00
Shuwen WangandClaude Opus 5 303227951a fix: use a bf16-relative tolerance in the DSA indexer K kernel test (#35795)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-25 19:50:29 -07:00
Bingxu Chen 07a9de25b4 [AMD][CI] Fix shared-KV verify tests for multi-head GQA (#36296) 2026-08-25 19:46:27 -07:00
Yuanle Liu 4ae30dc736 fix: detect cross-node multimodal transport by nnodes (#35646) 2026-08-26 10:31:48 +08:00
2d8484740d Support deepseek v4 and kimi k3 on ssd (#35314)
Co-authored-by: 1BIN4 <1741738350@qq.com>
Co-authored-by: L-Ark <fliangae@connect.ust.hk>
Co-authored-by: Chikati <jxudn@connect.ust.hk>
Co-authored-by: mengzili <zilim@ust.hk>
2026-08-26 10:05:12 +08:00
Zhangheng bec6248272 [Unified Cache]: add glm5.2 per commit ci (#36281) 2026-08-26 10:04:19 +08:00
Joe 4b2c182d3f [diffusion] feat: support out-of-tree torch.compile backends (#36249) 2026-08-26 09:53:39 +08:00
586a50cd96 [AMD][CI] Restore MiniMax-M2.5 4-GPU MI35x nightly job (#36393)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
2026-08-26 09:34:51 +08:00
Mick 054f485d38 [diffusion] docs: add MiniMax H3 checkpoint format table (#36028) 2026-08-26 09:18:07 +08:00
Mick 223dfce917 fix: bound CUDA memory for fast image preprocessing (#36295) 2026-08-26 09:02:08 +08:00
Baizhou ZhangandRyan Stewart 41e7612dee [Model] Support Nemotron 3.5 Lightning speculative decoding (#36186)
Co-authored-by: Ryan Stewart <rystewart@nvidia.com>
2026-08-25 16:43:58 -07:00
Baizhou Zhang 2d88c79b3e [CI] Add Kimi-K3 MMMU-Pro accuracy coverage (#36284) 2026-08-25 16:33:46 -07:00
cctry aa718f7343 Refactor HiCache host pool management (#36232) 2026-08-25 16:31:57 -07:00
0c42a44cd7 Add Spark3 Model (#35963)
Co-authored-by: Yaowj <yaowj@MacBook-Air.local>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
2026-08-25 16:24:00 -07:00
Leon Gao f7a56494b1 Fix SWA ownership across grouped frees (#36381) 2026-08-25 14:57:30 -07:00
Junpan Wu 4b4bf3d2a5 [Deepseek-V4] Enable shared-experts fusion on the flashinfer_mxfp4 (trtllm-gen) MoE path (#35505)
Signed-off-by: Shiki Wu <shikiw@nvidia.com>
2026-08-25 14:55:25 -07:00
Michael 6569125e3a [AMD][CI] Add MiniMax-M3-MXFP8 MI35x nightly perf benchmark (#36142) 2026-08-25 14:05:01 -07:00
Shangming Cai edff717ef0 fix(disagg): snapshot affected rooms before iterating outside the lock (#36351) 2026-08-26 03:31:10 +08:00
Kevin FlansburgandShangming Cai 7ddf92d5f4 fix(disagg): refresh stale prefill bootstrap metadata (#36029)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-08-26 03:29:20 +08:00
Xinyuan Tong 99c02d71b1 docs(cookbook): use auto parser resolution for Granite 4.2 (#36342) 2026-08-25 10:38:46 -07:00
Bingxu Chen 96a73c4e15 [AMD][CI] Adjust MI300 score API performance thresholds (#36290) 2026-08-25 09:41:36 -07:00
YAMY e9c9df6a52 [Performance] Tune FlashInfer EXTEND for DP prefill (#36219) 2026-08-25 08:29:57 -07:00
Xinyuan Tong b760f7fb19 docs(cookbook): add IBM Granite 4.2 cookbook (#36286) 2026-08-25 22:54:55 +08:00
elvischenv 46d9427b91 Fix MXFP8 MoE weight sizing for non-gated models (#36097) 2026-08-25 22:09:09 +08:00
Benjamin Truong a1f9508dd4 [Bugfix] Fix int32 destination offset overflow in CUTLASS MoE pre-reorder (#35188) 2026-08-25 20:56:42 +08:00
829138a31e [HiCache] Fix PP inconsistency with HiCache L3 (#22607) (#27010)
Co-authored-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: shangmingc <csmthu@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
2026-08-25 20:49:57 +08:00
MickandClaude Fable 5 c3947eeada [diffusion] docs: desktop-safe 24 GB recipe and the DGX Spark tier (#36169)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-08-25 20:25:17 +08:00
hhhh1252023 0c7ff19e3b [NPU] [CI] Split the base-c-test-acc-2-npu-a3 task into two parts running in parallel (#36257) 2026-08-25 19:23:20 +08:00
Cheng Wan 443527af0c config: the model-config cache keys on the path the record carried (#36300) 2026-08-25 03:18:28 -07:00
jacky.cheng 6a81038317 [AMD] Drop redundant FP8 bpreshuffle scale transpose via fused AR kernel (#33021) 2026-08-25 02:49:57 -07:00
a618d4c064 [AMD] Add Kimi-K2.7-Code-MXFP4 to cookbook (#36246)
Co-authored-by: Hung <Emmanuel0612@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-08-25 17:37:32 +08:00
jiaryang 3bc1c580c6 [AMD] Enable draft_extend CUDA graph for HIP DSA backend (#35672) 2026-08-25 02:18:08 -07:00
8f096b853a [diffusion] fix: crop GLM-Image output to requested size (#33859)
Co-authored-by: AuFlow <AuFlow@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-08-25 11:50:47 +03:00
Xinyi Song 2e3934f4cb [AMD] Enable Mori-EP on kimi-k3 (#35630) 2026-08-25 01:48:09 -07:00
Bingxu Chen d067622820 [AMD][bugfix] Add moe_ep_size/moe_tp_size to the allreduce-fusion gate test stub (#35340) 2026-08-25 01:24:52 -07:00
Mick 191244b3f6 [diffusion] feat: support loading Comfy NVFP4-AWQ text encoders (#36046) 2026-08-25 15:43:30 +08:00
Lianmin Zhengandyangliu991 bf1e03f712 [MegaMoE] Respect padded MXFP8 scale row strides in pre-dispatch (#36237)
Co-authored-by: yangliu991 <yangliu991@fb.com>
2026-08-25 00:27:33 -07:00