Commit Graph
17925 Commits
Author SHA1 Message Date
Liangsheng Yin b23d835048 [Scheduler] Unify per-iteration request intake into ingest_requests() (#38389) 2026-09-07 20:02:02 -07:00
Xinguo Zhu 2bf04f3a67 [Diffusion][CPU] Enable MiniMax-H3 on Xeon CPU (#35147) 2026-09-08 10:56:42 +08:00
huangtingwei 73c4cdb795 update codeowners (#38394) 2026-09-08 10:54:26 +08:00
EdwardXuyandEdwardXuy 7d2d6624b1 [NPU] Enable L1 prefix cache for Kimi-K3 W4A8 accuracy test (gpqa) (#38125)
Co-authored-by: EdwardXuy <EdwardXuy@users.noreply.github.com>
2026-09-08 10:39:58 +08:00
Polisetty V R K Jyothendra Varma cf35384fe4 [Intel GPU] Add MLA support to Intel XPU Attention backend for Prefill (#35866)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
2026-09-08 10:29:28 +08:00
HZY 8656901504 [Fix][DSA] Bound prefill Triton specializations for page-table stride (#37093) 2026-09-08 10:23:51 +08:00
Chao Shiandhuangtingwei9988 e31e5319a0 HiCache: Reduce the number of all_reduce in check_hicache_events for PP (#37562)
Co-authored-by: huangtingwei9988 <huangtingwei.htw@antgroup.com>
2026-09-08 10:13:22 +08:00
fba967ed9c [diffusion] Support diffusion decoder parallel tiling for LTX-2.5 (#36026)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-08 10:01:06 +08:00
Siju Samuel 2358916d5a [Feature][Intel XPU] Add memory saver support for Intel XPU via upstream torch_memory_saver (#29935) 2026-09-08 09:38:51 +08:00
Liangsheng Yin b8a81f055d [CI] Replace the Lark queue-digest card with a daily queue-timeline chart (#38380) 2026-09-07 18:28:34 -07:00
qyb233 c72cae201e [NPU] Fix ViT graph key layout handling (#37758) 2026-09-08 09:21:02 +08:00
5aa913e156 [AMD][GLM-5.2] Keep GlmMoeDsa MoE e_score_correction_bias in fp32 (#37133)
Co-authored-by: JohnQinAMD <yanyuan.qin@amd.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Zhang, Jiejing <jiejing.zhang@amd.com>
2026-09-07 18:17:54 -07:00
Kedar PotdarandPo-Han Huang f4bbf12423 docs(cookbook): Qwen3.5 FP8 on B200/B300 — trtllm-gen MoE + symm mem (#38374)
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
2026-09-08 09:12:49 +08:00
Kamil 792543f98c [Scheduler] Make request-timeout aborts rank-consistent to fix TP collective hangs (#37143) 2026-09-07 18:01:25 -07:00
Liangsheng Yin 4dcecc7891 Revert "[kernel] add fused silu mul quant fp8" (#38381) 2026-09-07 17:36:10 -07:00
Ziang Li 20ca564bf7 Add zianglih as online NVFP4 and DSA Top-K code owner (#33624) 2026-09-07 16:08:11 -07:00
Baizhou Zhang 85d39401c8 [CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293) 2026-09-07 15:39:34 -07:00
f4b75b5c36 docs(cookbook): Qwen3.8-Flash-Next NVFP4 recipes for DGX Spark (1x, 2x) and RTX PRO 6000 (#37995)
Co-authored-by: Jiminator <rdxa@rdxa-int-spark-01.yvb.moe>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-09-07 15:33:03 -07:00
Bingxu Chen 5a5d8e47c5 [AMD][CI] Remove obsolete split-dim check from Kimi-K3 prefill test (#38288) 2026-09-07 14:42:53 -07:00
amd-danli103andThomas Wang e9e9e37ddc [AMD] Restore SWA reprefill-tail on UnifiedRadixCache when HiCache is off (#32759)
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-09-07 14:27:53 -07:00
570087ceda [AMD][DSV4] Reland unified-KV pool sizing and SWA ring accounting, fully gated (#38192)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-09-07 13:13:04 -07:00
jiaryang 6287ebf43a [AMD] Fix EAGLE crash when no kv_index_translator is bound on the DSA fp8 read door (#38318) 2026-09-07 13:03:10 -07:00
Mohammad Miadh AngkadandMohammad Angkad a711785475 [Kernel] Drop the vendored dense BF16 GEMM port in favor of FlashInfer 0.6.18 (#38124)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-09-07 12:59:33 -07:00
bf68369a18 [ray] Support Ray metric backend for engine metrics (#31415)
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
2026-09-07 12:43:19 -07:00
Aurick Qiao 8392c36bce [Bugfix][Mamba] Clear deferred init metadata before speculative decode (#37165) 2026-09-07 12:41:03 -07:00
Chan ahn dcebe8c473 [Kernel] Add fused MoE Triton configs for Qwen3.8-Flash-Next FP8 on NVIDIA H200 NVL (TP2+EP2) (#38116) 2026-09-07 10:17:55 -07:00
Brayden ZhongandBrayden Zhong c99d906eff Drop the routing bias casts in flashinfer trtllm MoE (#33591)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-09-07 09:04:33 -07:00
Shuwen Wang 62bca081a3 [CI] Fix request receiver EP scale joiner test patch (#38342) 2026-09-07 23:52:32 +08:00
f3ccd1c0e4 [diffusion] CI: baseline the e2e of ten unguarded perf cases (#38335)
Co-authored-by: Mick Qian <mickqian@radixark.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
2026-09-07 23:13:14 +08:00
zijiexiaandXinyuan Tong b5c9b68f03 [Kimi-K3] Recover the reply when the model skips the think channel (#37743)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-09-07 14:08:42 +00:00
zijiexiaandClaude Opus 5 e4008de757 Add MiniCPM5-2B cookbook (#38295)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
2026-09-07 21:30:17 +08:00
62a4a6ea0e [NPU] Add NPU arch35 support and enhance DSV4 processing in DeepSeek-V4 (#37373)
Co-authored-by: AndyLi429 <AndyLi429@noreply.gitcode.com>
Co-authored-by: Kailong Lu <kelonlu@163.com>
Co-authored-by: cx <chengxin65@huawei.com>
Co-authored-by: ranjiewen <ranjiewen@huawei.com>
Co-authored-by: HEX1A0A <1a0ahex@gmail.com>
Co-authored-by: vstone-w <374330057@qq.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: ClownBin <chaobin1993@126.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-09-07 21:08:06 +08:00
Shuwen Wangandhuangtingwei df623d3cbd fix: keep queued Mooncake linker loads after abort (#38195)
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
2026-09-07 20:25:13 +08:00
Mohammad Miadh Angkad c5367fa964 [CI] Fix stale ServerArgs fake in chunked-SGMV LoRA test (#38315) 2026-09-07 04:25:12 -07:00
Shuwen Wang 755f97c622 [CI] Fix the DSpark dp-tier unit test fixture after #34919 (#38314) 2026-09-07 03:16:00 -07:00
Carrie ChenandBrayden Zhong 8ae962021d Use fp32 in TRTLLM all reduce buffers (#36143)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2026-09-07 16:57:07 +08:00
BingjiaWang 861d40f3ee Fix DSpark CUDA graph replay with MegaMoE TP attention (#34919) 2026-09-07 01:35:35 -07:00
Mick ba6d3df69a [diffusion] doc: document verified GB300 and derived GB200 H3 recipes (#38296) 2026-09-07 16:32:29 +08:00
Cheng Wan b5766336d4 [Perf] Unified memory: close the DCP decode gap on Blackwell (#37926) 2026-09-07 01:10:44 -07:00
lixiufei-leoandlixiufei-leo a8edafff7c [AMD][gfx95] DSV4 wo_b (dp-attention): route to tuned bpreshuffle GEMM instead of triton (#38227)
Co-authored-by: lixiufei-leo <lixiufei-leo@users.noreply.github.com>
2026-09-07 00:36:15 -07:00
billishyahaoandHAI 644841c50c [AMD] Support aiter fa mha chunked kv for Kimi-K3 (#37691)
Co-authored-by: HAI <hixiao@gmail.com>
2026-09-07 00:31:24 -07:00
Xiaoyu ZhangandMick Qian 4d23a4fa6d [Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-07 15:13:59 +08:00
Ma Mingfei 6a1ff90f2d [CPU] use CustomTestCase for registered CPU tests (#38244) 2026-09-07 15:09:52 +08:00
Byron HsuandByron Hsu a88e852fab [Sampling] Allow sampling-mask replay with DisallowedTokensLogitsProcessor (#38279)
Co-authored-by: Byron Hsu <24364830+ByronHsu@users.noreply.github.com>
2026-09-06 23:56:16 -07:00
Mick 15d2cbcc90 [diffusion] CI: validate every repeated server request (#38185) 2026-09-07 14:36:50 +08:00
Mohammad Miadh Angkad cfa989b7af [CI] Fix stale CP-v1 mock patches in NextN mm-embed test (#38280) 2026-09-06 23:20:29 -07:00
Kotthagattu Meher Sai 97dcbf9410 [XPU] Re-add intel xpu on triton paths in diffusion platforms (#36654) 2026-09-07 13:30:22 +08:00
e24e31efd9 Fix/whisper xpu varlen encoder decoder (#36298)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
Co-authored-by: Singh <rohitsi2@iil-gnrap02.iind.intel.com>
Co-authored-by: Pramod Kumar <144990617+pramodkumar-habanalabs@users.noreply.github.com>
2026-09-07 13:21:29 +08:00
Baizhou Zhang 503e36cbae Tiny Update CI Permission (#38278) 2026-09-06 22:17:48 -07:00
Lianmin Zheng 7d37b86ff2 Remove obsolete CUDA graph buffer population methods (#37886) 2026-09-06 22:09:49 -07:00