Commit Graph
4372 Commits
Author SHA1 Message Date
Po-Han Huang (NVIDIA) c608f9bf75 [CI] Fix Q8KV8 sparse prefill test fixture (#36639) 2026-08-27 01:00:22 -07:00
b8a6adadfe [Bug][Spec] fix startup crash and reduce CUDA graph memory usage for speculative adaptive (#35275)
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-27 00:46:13 -07:00
jacky.cheng c967cd19b5 [AMD] Optimize Qwen3.5 MTP unified attention on gfx950 (#36330) 2026-08-27 00:13:49 -07:00
Xun Sun adcf73d7f7 [Weight Cache] Enhance test and support EPLB (#36198) 2026-08-26 23:11:53 -07:00
b294bd4bc7 [CPU][CI]: fix a few issues that cause XEON CI failures (#36413)
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
2026-08-27 13:59:08 +08:00
weireweireandweireweire 4d5d506486 Publish gated DSV4 DFLASH-family target-prefill read completion (#35947)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-26 21:33:08 -07:00
Alison Shao 02dfd37826 [CI] Remove GLM-4.1V-9B-Thinking from nightly VLM MMMU eval (#36602) 2026-08-26 20:29:38 -07:00
Jialin Ouyang a2b589fdf8 [Radix Cache] Add test-only TreeCore inspector for shared backend tests (#35791) 2026-08-27 11:17:51 +08:00
a3ae667d67 [Feature] Add DeepEPv2 (ElasticBuffer) MoE A2A backend (#35634)
Co-authored-by: menyu <menyu@nvidia.com>
Co-authored-by: Jinyan Chen <93358689+liz-badada@users.noreply.github.com>
Co-authored-by: Han Yu <helloyu0903@gmail.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
2026-08-26 19:54:33 -07:00
Michael 1c8f2b38cb [AMD][CI] Add DeepSeek-V4-Flash FP8 accuracy coverage on MI30x (#36396) 2026-08-26 19:30:07 -07:00
MickandClaude Opus 5 07570202f0 [VLM] route every multimodal processor through the worker pool's call site (#35342)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-08-27 10:27:45 +08:00
Promisewjx 9d07b9e227 [Performance] Reduce idle DP work in breakable prefill CUDA graphs (#33871) 2026-08-27 10:09:54 +08:00
Bingxu Chen d2b3e9051d [AMD][CI] Stabilize PyTorch sampling backend test on ROCm (#36307) 2026-08-26 18:44:10 -07:00
Alison Shao 15688fea7d Fix BailingMoeV3 reading enable_dp_lm_head off live topology instead of config (#36584) 2026-08-26 18:41:39 -07:00
ashwini rathi a8b72c4c34 [Intel XPU] Fix cross-encoder rerank hang on B580 runners (#36360) 2026-08-27 09:33:20 +08:00
20621aa14b [Model] Support Ling-3.0-flash (BailingMoeV3) (#33561)
Signed-off-by: JustinTong <justintong0323@gmail.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 得泽 <zhangkaihong.zkh@antgroup.com>
Co-authored-by: 翎悦 <vito.yy@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
Co-authored-by: tiwei.btw <tiwei.btw@antgroup.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: 文赋 <zibin.zb@antgroup.com>
Co-authored-by: JustinTong <justintong0323@gmail.com>
2026-08-26 17:27:23 -07:00
ec4bdbfa4a [Feature] Beam search support (#31626)
Co-authored-by: cswuyg <cswuyg@gmail.com>
Co-authored-by: cswuyg <496090217@qq.com>
Co-authored-by: Vedant Jhaveri <vedantjh2@gmail.com>
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
2026-08-26 16:56:15 -07:00
Liangsheng Yin 45c85c198b [CI] Lower the AWQ Marlin MMLU threshold to 0.80 (#36570) 2026-08-26 14:43:20 -07:00
weireweireandweireweire 5263568bcb [HiCache] Keep auxiliary load-back out of Full KV pending ownership (#36317)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
2026-08-27 01:30:38 +08:00
Shangming Cai c8b56b1f44 chore: bump mooncake version to 0.3.13 (#36493) 2026-08-26 22:21:15 +08:00
Cheng Wan 413df1f8db config: ServerArgs holds the raw input (#36255) 2026-08-26 05:14:05 -07:00
27c36368b6 fix(moe): guard FP8 delegate activation params (#36275)
Signed-off-by: jikuixie <jikuixie@gmail.com>
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: shyeh25 <206795756+shyeh25@users.noreply.github.com>
2026-08-26 12:12:21 +00:00
Cheng Wan 937af8538b config: the runtime readers take the published bags (#36254) 2026-08-26 05:08:25 -07:00
Cheng Wan 5b7fc61306 config: resolution reads the declarations, not the fields (#36253) 2026-08-26 05:05:28 -07:00
Cheng Wan ae5feb4b9c config: stop handing the record to code that does not read it (#36252) 2026-08-26 05:02:17 -07:00
Cheng Wan d7b144f64e config: publishing is the process entry's job (#36251) 2026-08-26 04:58:41 -07:00
Cheng Wan 8005df61d3 config: spell the parallel config tier at the call site (#36250) 2026-08-26 03:00:28 -07:00
DarkSharpness 689ade69d1 [kernel] Split the custom all-reduce communicator into push/pull planes (#35735) 2026-08-26 17:40:28 +08:00
Aurick QiaoandYuwei An 58ecbba0bd [Feature] Coordinate FullCG prefill across DP-attention ranks (#35640)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
2026-08-26 02:16:02 -07:00
SuperSongandseokwoosong 2511743bd7 [unified-memory] Stop eviction when shared allocation capacity is sufficient (#33091)
Co-authored-by: seokwoosong <seokwoosong@users.noreply.github.com>
2026-08-26 02:06:32 -07:00
Mohammad Miadh AngkadandMohammad Angkad ffc431cd4c [CI] Fix stale tool_call_parser key in Spark2.5 detector test (#36464)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-08-26 01:34:39 -07:00
Mohammad Miadh AngkadandMohammad Angkad a3c4936438 Sync FlashInfer autotune tactic choice across TP ranks (#35343)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-08-26 16:30:47 +08:00
Jialin Ouyang bede6bc37c Fix unified HiCache PP test import (#36454) 2026-08-26 15:35:18 +08:00
KnightYao 7ef49e8f7d Rename Spark3 to Spark2.5 (#36416) 2026-08-26 00:04:46 -07:00
Ziang Li 3c9febc68b [Spec][DSA] Add --speculative-dsa-topk-backend (#36313) 2026-08-25 23:35:03 -07:00
Tan TrinhandKhoa Pham 04c1036bb3 [Kernel] Skip reserved writes in MLA KV cache (#36003)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
2026-08-25 22:42:23 -07:00
34de1fb47f fix(test): stabilize nightly precision regression (#34668)
Co-authored-by: Alison Shao <54658187+alisonshao@users.noreply.github.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-08-25 20:04:52 -07:00
HuangJi cc3b61873f [Diffusion][minimax-h3] Restrict MiniMax-H3 SubBlock sparsity to video queries (#35850) 2026-08-26 10:55:09 +08:00
Alison Shao 4382947b58 Fix DSV4 shared-fusion CPU unit test after the EP guard landed (#36424) 2026-08-25 19:52:05 -07:00
Shuwen WangandClaude Opus 5 303227951a fix: use a bf16-relative tolerance in the DSA indexer K kernel test (#35795)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-25 19:50:29 -07:00
Bingxu Chen 07a9de25b4 [AMD][CI] Fix shared-KV verify tests for multi-head GQA (#36296) 2026-08-25 19:46:27 -07:00
Yuanle Liu 4ae30dc736 fix: detect cross-node multimodal transport by nnodes (#35646) 2026-08-26 10:31:48 +08:00
2d8484740d Support deepseek v4 and kimi k3 on ssd (#35314)
Co-authored-by: 1BIN4 <1741738350@qq.com>
Co-authored-by: L-Ark <fliangae@connect.ust.hk>
Co-authored-by: Chikati <jxudn@connect.ust.hk>
Co-authored-by: mengzili <zilim@ust.hk>
2026-08-26 10:05:12 +08:00
Zhangheng bec6248272 [Unified Cache]: add glm5.2 per commit ci (#36281) 2026-08-26 10:04:19 +08:00
Mick 223dfce917 fix: bound CUDA memory for fast image preprocessing (#36295) 2026-08-26 09:02:08 +08:00
Baizhou ZhangandRyan Stewart 41e7612dee [Model] Support Nemotron 3.5 Lightning speculative decoding (#36186)
Co-authored-by: Ryan Stewart <rystewart@nvidia.com>
2026-08-25 16:43:58 -07:00
Baizhou Zhang 2d88c79b3e [CI] Add Kimi-K3 MMMU-Pro accuracy coverage (#36284) 2026-08-25 16:33:46 -07:00
cctry aa718f7343 Refactor HiCache host pool management (#36232) 2026-08-25 16:31:57 -07:00
0c42a44cd7 Add Spark3 Model (#35963)
Co-authored-by: Yaowj <yaowj@MacBook-Air.local>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
2026-08-25 16:24:00 -07:00
Leon Gao f7a56494b1 Fix SWA ownership across grouped frees (#36381) 2026-08-25 14:57:30 -07:00