Commit Graph
13927 Commits
Author SHA1 Message Date
Xinyuan Tong 9f6b2339f9 docs(minimax-m3): warm-steady-state benchmark numbers (#28062) 2026-06-12 08:42:23 -07:00
Yuhao YangandXinyuan Tong 50815d54a7 docs (#28061)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-06-12 21:19:40 +08:00
Xinyuan Tong dba617f2ec doc: update docs for new model (#28060) 2026-06-12 21:14:35 +08:00
qiaozpandishandhanani fcae6767d5 Add bucketed multi-dir layout for NIXL file storage (#27672)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-06-12 05:34:55 -07:00
luoroger37 18989f3d48 [PD] Fix resource leak on prealloc/transfer abort and idle check (#28022) 2026-06-12 18:20:24 +08:00
ming_wang f308abc052 Revise the mimo-v2-flash best practice (#28016) 2026-06-12 17:12:33 +08:00
liuxproandunknown 83c0007f8d examples: add Chain-of-Verification (CoVe) hallucination reduction demo (#27866)
Co-authored-by: unknown <liuxiao.209@360buyad.local>
2026-06-12 01:57:33 -07:00
Xinyi Song 371b96e210 [AMD] Fix DeepSeek-V4-Flash-FP8 on MI300 (#27972) 2026-06-12 01:51:32 -07:00
Joectwm 694cea8656 Add EPD disaggregated encode tracing (#25994) 2026-06-12 16:16:14 +08:00
iridiumine 60e4f14953 [NPU][Bugfix] Fix accuracy issue in no-graph with MTP (#27752) 2026-06-12 16:05:06 +08:00
Liangsheng Yin a52ccd2179 [Spec] Install EagleDraftExtendInput as the V2 draft-extend spec_info (#24860) 2026-06-12 00:46:16 -07:00
Bingxu Chen 1cd5cb1220 [AMD] [CI] Add dsv4 accuracy PR gate to pr-test-amd-rocm720 (#27149) 2026-06-11 23:42:16 -07:00
Xinyuan Tong 66ab5c9c7a fix(gateway): make sgl-model-gateway a cargo workspace so maturin 1.14 accepts the parent README (#27997) 2026-06-11 23:37:29 -07:00
ashwini rathi fe887e6935 test(xpu): add multi-feature and embedding stage-b tests (#27861) 2026-06-12 14:36:28 +08:00
Bi Xueandispobock 3c1f9eafa5 [sgl] proactively release out-of-window SWA slots after chunked prefill (#27402)
Co-authored-by: ispobock <ispobaoke@gmail.com>
2026-06-12 14:17:18 +08:00
Xinyi SongandThomas Wang 36d61613a1 [AMD] Cache unified_kv swa_loc once per step instead of per layer (#27978)
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
2026-06-11 23:13:15 -07:00
Jumiar ca17bd8347 perf: eliminate CUDA syncs in VLM embed path (#26082) 2026-06-12 13:15:56 +08:00
Alan Kao cce35ee2e5 Remove outdated patch (#27994) 2026-06-11 22:14:55 -07:00
Thomas Wang ddbe5ff2f1 [AMD] Pin maturin<1.14 to fix ROCm image build failure (#27999) 2026-06-11 22:13:27 -07:00
Mick 8038806557 [diffusion] optimize: optimize flux1 tensor parallel sharding (#27826) 2026-06-12 13:13:18 +08:00
0a1fb0da86 add LRU eviction for mooncacke embedding cache (#25954)
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: siyu <liusy58@linux.alibaba.com>
Co-authored-by: Yuang Chen <1131578721@qq.com>
2026-06-12 12:38:13 +08:00
Liangsheng Yin e1164a6dfc [Spec] Remove dead prepare_for_verify / prepare_extend_after_decode + extend-decode kernel (#27761) 2026-06-11 20:59:30 -07:00
syy-hw 3a3a759464 [NPU] Add Gemma4 Sliding Window Attention support on Ascend backend (#26147) 2026-06-12 11:44:38 +08:00
Brayden ZhongandBrayden Zhong 8bfcc0c39c Use the correct wrapper for fp4_quantize (#27956)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-06-11 20:23:09 -07:00
Yi Zhong 40894be3c3 add lfm2.5 to new cookbook. (#27409) 2026-06-11 20:08:19 -07:00
Yihao Wang f5c9f88ee2 [plugin][distributed] use active platform's backend in get_default_distributed_backend (#23969) 2026-06-11 20:05:17 -07:00
7074704c0c [Spec] Dedup post-verify mamba state commit into shared spec_utils helpers (#27966)
Co-authored-by: xbfs <xuebf1@lenovo.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-11 18:33:40 -07:00
Liangsheng Yin 3ffe72517f [Spec] Remove the dead spec V1 scheduler paths (#27977) 2026-06-11 18:31:13 -07:00
Cheng Wan 2e74ff192c [DSV4] Use int64 for compressor out_loc tensors (#27973) 2026-06-11 17:45:34 -07:00
Cheng Wan 97a0031799 [lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984) 2026-06-11 17:38:05 -07:00
Liangsheng Yin c0480a88be [Spec] Retire Spec V1 (#27964) 2026-06-11 16:15:15 -07:00
Oguz Ulgen 949326d922 Add SGLANG_ENABLE_WAR_BARRIER to force-enable the overlap scheduler WAR barrier on non-CUDA (e.g. AMD) (#27967) 2026-06-11 15:38:37 -07:00
Brayden ZhongandBrayden Zhong 493f828bfa Add DeepGEMM prerelease wheel tests (#27075)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-06-11 15:14:50 -07:00
d71e9bede6 [bugfix] commit Mamba states after NGRAM target verify (#26351)
Co-authored-by: xbfs <xuebf1@lenovo.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-06-11 15:11:18 -07:00
Yueming Yuan cd075d1f64 [RL] convert DeepSeek V4 APE layout through weight loader (#27307) 2026-06-11 15:05:27 -07:00
Trevor Morris 0bac184425 [NVIDIA] Update Minimax-M2.5,M2.7 docs with flags for performance (#24465) 2026-06-11 14:58:44 -07:00
Liangsheng Yin fee717f303 [Spec] Fold the DFLASH worker base into DFlashWorkerV2 on BaseSpecWorker (#27950) 2026-06-11 14:54:28 -07:00
Liangsheng Yin acdb39edd2 [Spec] Remove the DFLASH V1 worker path (#27959) 2026-06-11 14:37:58 -07:00
Wang, FangYuan 6e885c844f Revert "[AMD] Fix DeepSeek V4 Pro c128 state tensor dtype mismatch error and c4_sparse_raw_indices attribute error in cuda graph phase" (#27919) 2026-06-11 14:25:32 -07:00
Michael 12d3f02be8 [AMD] Fix DSA device-to-host direct test on rocm720 (page_size%16 assert) (#27850) 2026-06-11 14:24:23 -07:00
Liangsheng Yin df5055e00f Bump spec logprob match delta for the bf16 eagle fixture (#27952) 2026-06-11 14:21:07 -07:00
Liangsheng Yin 1ac75c3463 [CI] Fix GB300 TestDummyWithSBO crash: disable NaN assert and coredump for dummy weights (#27955) 2026-06-11 14:17:03 -07:00
Baizhou Zhang d26b90cf70 Add weireweire to CI permissions (#27957) 2026-06-11 14:10:45 -07:00
ec0eb6cce8 Support MiMo v2 ASR (#26278)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: yanyihan <yanyihan@xiaomi.com>
Co-authored-by: zhuqingchao <zhuqingchao@xiaomi.com>
2026-06-11 13:43:13 -07:00
Jackey Hua 24c5d76f74 fix: per-sequence last-token embedding in EAGLE3/MTP draft for batched multimodal spec decoding (#27846) 2026-06-11 13:33:16 -07:00
cctryandcctry 10219bd9d6 [PD] Fix negative prefill kv_transfer_alloc_ms under optimistic prefill (#27885)
Co-authored-by: cctry <cctry@fb.com>
2026-06-11 13:12:25 -07:00
Yuwei An 880e6f66fc [BCG] Share output buffers across capture sizes + typed ShapeKey (#27857) 2026-06-11 11:58:05 -07:00
Brian Chao 7f57b344c9 [diffusion] feat: progressive resolution growing for Ideogram 4 via GPU DCT upsampling with up to 1.56× speedup (#27736) 2026-06-11 23:16:53 +08:00
Chi McIsaacandMick b2728bda9d [diffusion] feat: use fused w8a8 kernel for Ideogram4 weight-only linear as an opt-in (#27590)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-06-11 23:15:27 +08:00
Xiaoyu ZhangandBBuf 06e0df5899 Optimize Qwen3 Next FP8 MoE on H200 (#26204)
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
2026-06-11 22:18:43 +08:00