Commit Graph
6055 Commits
Author SHA1 Message Date
b421e60eed 【NPU】【bugfix】fix server error when mtp unquant (#26389)
Co-authored-by: cen121212 <luochen23@huawei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
2026-05-30 15:01:19 +03:00
Haichuan Hu acd689b407 feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667)
Signed-off-by: Haichuan Hu <kaisennhu@gmail.com>
2026-05-30 02:19:50 -07:00
a952e9174f [MLX] Support Qwen3.5 (dense) Model (#25754)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-05-30 17:05:02 +08:00
Yuan Luoandluoyuan.luo 0d9a2a9de3 [MoE Refactor] Migrate SM90 Cutlass W4A16 to MoeRunner (#26489)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-05-30 02:02:56 -07:00
Jimmy Shong 716e670d3d [bugfix]: size CuteDSL MoE allgather buffers for the worst-case forward (#26696) 2026-05-30 00:27:20 -07:00
Zhangheng 7662210406 [UnifiedTree]: Support eviction priority (#26549) 2026-05-30 15:19:43 +08:00
Zhangheng c048ebd10d [Hicache]: skip flaky test (#26764) 2026-05-30 15:16:12 +08:00
Liangsheng Yin 1c79015434 Drop dead ScheduleBatch return_routed_experts/return_indexer_topk fields (#26760) 2026-05-29 23:16:09 -07:00
6f1c9fc77b [RL] Fix crash when the reqs in a batch have a mix of return_routed_experts = True and False. (#26423)
Co-authored-by: root <root@slurm-h200-209-231.slurm-compute.tenant-slurm.svc.cluster.local>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-05-29 20:46:10 -07:00
Liangsheng Yin 1f850e67f2 [core] Fix crashes on the gpu_only spec_v2 path (#26738) 2026-05-29 19:12:03 -07:00
Erik Wijmans 95cd2fd29f [lora] More efficient pinned memory (#20876) 2026-05-30 09:04:59 +09:00
Lianmin Zhengandcctry 4ff1296f5e Optimize get load calls (/v1/loads) using shared-memory load snapshots (#26348)
Co-authored-by: cctry <cctry@meta.com>
2026-05-29 13:40:26 -07:00
Cheng WanandClaude Sonnet 4.6 ff8ed7a302 [refactor] unify cuda-graph capture/replay across attention backends (#26665)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-05-29 12:46:42 -07:00
Cheng WanandClaude Sonnet 4.6 ec075d8bc5 Fix DRAFT_EXTEND_V2 CG metadata: align test fixture and Triton with production seq_lens convention (#26651)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-29 02:46:45 -07:00
Zhangheng eb5d4827e8 [UnifiedTree]: Split unified tree kl ci into multiple files to reduce GPU usage. (#26666) 2026-05-29 02:46:34 -07:00
Teng Ma 544f3039d5 [PD] Fix IB device validation for JSON mappings (#26114) 2026-05-29 16:44:49 +08:00
blzheng a722b1a437 [CPU] fix incorrect index of b_ptr in fused_sigmoid_gating_delta_rule… (#26634) 2026-05-29 16:08:12 +08:00
3ecf2c76ad [CPU] Add GPT-OSS model optimization for CPU (#16775)
Co-authored-by: mingfeima <mingfei.ma@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
2026-05-29 16:05:26 +08:00
Niko Ma 4d1163e6a9 [PD][MoRI] Align hybrid state transfer with per-component schema (#26539) 2026-05-29 00:54:46 -07:00
Thomas Wang 6e9bd82714 [AMD][CI] Update v4 CI setting and move the task to main branch (#26662) 2026-05-29 00:12:40 -07:00
Yuan Luoandluoyuan.luo 08ec19872c [HotFix][Ling 2.6] Fix HybridLinearAttn dispatcher for Ling-2.6 (#26474)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-05-29 14:50:15 +08:00
Cheng WanandClaude Sonnet 4.6 0fb0ea7aac test: add trtllm_mha EAGLE-draft CG runner coverage (chain) (#26669)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-28 23:46:06 -07:00
Cheng WanandClaude Sonnet 4.6 2dfbc3d781 test: strengthen CG-replay coverage with prod-fill padding, metadata invariants, and pad-ratio sweep (#26658)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-28 22:43:29 -07:00
Shangming Cai fba083c80f [CI] Split PP tests into base and extra suites (#26648)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-05-29 12:15:27 +08:00
Cheng Wan 84698b21e7 rename unittest as unittests (#26654) 2026-05-28 21:14:06 -07:00
Khoa PhamandCursor 621a79728c test: stabilize Gemma4 26B-A4B MTP GSM8K test with deterministic inference + tuned threshold (#26653)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-28 20:58:48 -07:00
Xinyuan Tong 79c844527c Upgrade xgrammar to 0.2.1 (#25676) 2026-05-29 11:40:07 +08:00
LucQueenandZhengWG 36d0a6e08e [EPD] Optimize the Mooncake backend (#22587)
Co-authored-by: ZhengWG <zwg0606@gmail.com>
2026-05-29 10:42:24 +08:00
Erik Wijmans 54b06f199c [lora] Share MoE LoRA Info (#24160) 2026-05-29 11:01:47 +09:00
Cheng WanandClaude Sonnet 4.6 e381312664 Revert "Fix FA DRAFT_EXTEND_V2 cache extent" (#26628)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-28 18:45:33 -07:00
liuxianglong17 6258947039 NPU Nightly Pipeline Skip Test Case Adaptation and Recovery Testing (#26353) 2026-05-29 09:29:25 +08:00
Cheng WanandClaude Opus 4.7 f66f56c6bd Add attention-backend unit-test suite under test/registered/attention/unittest (#26517)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-28 17:30:31 -07:00
Liangsheng Yin 407106300e test/disaggregation: dp-attention keeps total_tokens e2e, simpler LB algos -> unit tests (#26617) 2026-05-28 16:50:46 -07:00
Liangsheng Yin ec78fa6518 test/registered: cleanup pure model e2e tests (moves, splits, dedup, kit) (#26610) 2026-05-28 15:41:46 -07:00
Baizhou Zhang 435c4ffb30 [CI] Clean DeepSeek V4 tests and installation scripts (#26609) 2026-05-28 15:22:59 -07:00
Jimmy Shong f838adb7d4 bench_serving: add Zipfian shared-prefix sampling to generated-shared-prefix (#26378) 2026-05-28 14:39:46 -07:00
97d129f8c6 # feat(bench): add SPEED-Bench dataset support to bench_serving (#24149)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
2026-05-28 14:37:00 -07:00
Baizhou Zhang cd65be98df [CP] Add back qwen 30b test (#26604) 2026-05-28 14:34:41 -07:00
Cameron Quilici 3ca8cb470f [BugFix] preserve cached token details in multi-tokenizer output (#26590) 2026-05-28 13:31:55 -07:00
Vladislav Nosivskoy 34ea682a07 [UnifiedTree] gate load back pre-evict on full-attn availability only (#26302)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
2026-05-29 00:30:03 +08:00
Liangsheng Yin 8e0ed75f2d Remove dead fields and always-False plumbing across SB / FB / LogitsMetadata (#26551) 2026-05-28 03:15:04 -07:00
Xinyuan Tong bed20249f1 fix(tool_call): reland schema type normalization (#26433) 2026-05-28 14:31:18 +08:00
Khoa PhamandClaude Opus 4.7 9040feebd8 [Gemma4] Add test for MTP models (#24552)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-27 21:36:28 -07:00
MingxuZh 21ba329dac [Xeon] CPU CI enhancement for Intel Xeon platforms (#24649) 2026-05-28 10:49:04 +08:00
Bingxu ChenandCursor 81663cb5f1 [AMD] [CI] Register MI35x GSM8K nightly tests (#26478)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-05-28 10:31:43 +08:00
Baizhou ZhangandClaude Opus 4.7 68e5b4fdd6 [NemotronH] Fix weight-loading unit test broken by Puzzle support (#26522)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-27 17:44:45 -07:00
+2 deaba74745 [AMD][DSV4] DSV4 MTP graph + sparse triton attn optimizations (#26383)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: amd-danli103 <danli103@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
Co-authored-by: yichiche@amd.com <jacky.cheng>
Co-authored-by: yctseng0211 <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-05-27 15:23:35 -07:00
19663aafcd Support batch size > 1 when enable CP (#23269)
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-05-27 14:11:17 -07:00
Kaixi Hou ddf0627254 [NVIDIA] [GDN] Add FlashInfer prefill support for SM100+ (Blackwell) (#22921) 2026-05-27 13:58:05 -07:00
Sam HandYihao Wang a95b4e2e09 [Feature] WebSocket streaming audio input for ASR (#22848)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
2026-05-27 22:44:55 +08:00