Xinyuan Tong
|
9f6b2339f9
|
docs(minimax-m3): warm-steady-state benchmark numbers (#28062)
|
2026-06-12 08:42:23 -07:00 |
|
 Yuhao YangandXinyuan Tong
|
50815d54a7
|
docs (#28061)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-06-12 21:19:40 +08:00 |
|
Xinyuan Tong
|
dba617f2ec
|
doc: update docs for new model (#28060)
|
2026-06-12 21:14:35 +08:00 |
|
 qiaozpandishandhanani
|
fcae6767d5
|
Add bucketed multi-dir layout for NIXL file storage (#27672)
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-06-12 05:34:55 -07:00 |
|
luoroger37
|
18989f3d48
|
[PD] Fix resource leak on prealloc/transfer abort and idle check (#28022)
|
2026-06-12 18:20:24 +08:00 |
|
ming_wang
|
f308abc052
|
Revise the mimo-v2-flash best practice (#28016)
|
2026-06-12 17:12:33 +08:00 |
|
 liuxproandunknown
|
83c0007f8d
|
examples: add Chain-of-Verification (CoVe) hallucination reduction demo (#27866)
Co-authored-by: unknown <liuxiao.209@360buyad.local>
|
2026-06-12 01:57:33 -07:00 |
|
Xinyi Song
|
371b96e210
|
[AMD] Fix DeepSeek-V4-Flash-FP8 on MI300 (#27972)
|
2026-06-12 01:51:32 -07:00 |
|
Joectwm
|
694cea8656
|
Add EPD disaggregated encode tracing (#25994)
|
2026-06-12 16:16:14 +08:00 |
|
iridiumine
|
60e4f14953
|
[NPU][Bugfix] Fix accuracy issue in no-graph with MTP (#27752)
|
2026-06-12 16:05:06 +08:00 |
|
Liangsheng Yin
|
a52ccd2179
|
[Spec] Install EagleDraftExtendInput as the V2 draft-extend spec_info (#24860)
|
2026-06-12 00:46:16 -07:00 |
|
Bingxu Chen
|
1cd5cb1220
|
[AMD] [CI] Add dsv4 accuracy PR gate to pr-test-amd-rocm720 (#27149)
|
2026-06-11 23:42:16 -07:00 |
|
Xinyuan Tong
|
66ab5c9c7a
|
fix(gateway): make sgl-model-gateway a cargo workspace so maturin 1.14 accepts the parent README (#27997)
|
2026-06-11 23:37:29 -07:00 |
|
ashwini rathi
|
fe887e6935
|
test(xpu): add multi-feature and embedding stage-b tests (#27861)
|
2026-06-12 14:36:28 +08:00 |
|
 Bi Xueandispobock
|
3c1f9eafa5
|
[sgl] proactively release out-of-window SWA slots after chunked prefill (#27402)
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-06-12 14:17:18 +08:00 |
|
 Xinyi SongandThomas Wang
|
36d61613a1
|
[AMD] Cache unified_kv swa_loc once per step instead of per layer (#27978)
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
|
2026-06-11 23:13:15 -07:00 |
|
Jumiar
|
ca17bd8347
|
perf: eliminate CUDA syncs in VLM embed path (#26082)
|
2026-06-12 13:15:56 +08:00 |
|
Alan Kao
|
cce35ee2e5
|
Remove outdated patch (#27994)
|
2026-06-11 22:14:55 -07:00 |
|
Thomas Wang
|
ddbe5ff2f1
|
[AMD] Pin maturin<1.14 to fix ROCm image build failure (#27999)
|
2026-06-11 22:13:27 -07:00 |
|
Mick
|
8038806557
|
[diffusion] optimize: optimize flux1 tensor parallel sharding (#27826)
|
2026-06-12 13:13:18 +08:00 |
|
  
|
0a1fb0da86
|
add LRU eviction for mooncacke embedding cache (#25954)
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: siyu <liusy58@linux.alibaba.com>
Co-authored-by: Yuang Chen <1131578721@qq.com>
|
2026-06-12 12:38:13 +08:00 |
|
Liangsheng Yin
|
e1164a6dfc
|
[Spec] Remove dead prepare_for_verify / prepare_extend_after_decode + extend-decode kernel (#27761)
|
2026-06-11 20:59:30 -07:00 |
|
syy-hw
|
3a3a759464
|
[NPU] Add Gemma4 Sliding Window Attention support on Ascend backend (#26147)
|
2026-06-12 11:44:38 +08:00 |
|
 Brayden ZhongandBrayden Zhong
|
8bfcc0c39c
|
Use the correct wrapper for fp4_quantize (#27956)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-11 20:23:09 -07:00 |
|
Yi Zhong
|
40894be3c3
|
add lfm2.5 to new cookbook. (#27409)
|
2026-06-11 20:08:19 -07:00 |
|
Yihao Wang
|
f5c9f88ee2
|
[plugin][distributed] use active platform's backend in get_default_distributed_backend (#23969)
|
2026-06-11 20:05:17 -07:00 |
|
 
|
7074704c0c
|
[Spec] Dedup post-verify mamba state commit into shared spec_utils helpers (#27966)
Co-authored-by: xbfs <xuebf1@lenovo.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-11 18:33:40 -07:00 |
|
Liangsheng Yin
|
3ffe72517f
|
[Spec] Remove the dead spec V1 scheduler paths (#27977)
|
2026-06-11 18:31:13 -07:00 |
|
Cheng Wan
|
2e74ff192c
|
[DSV4] Use int64 for compressor out_loc tensors (#27973)
|
2026-06-11 17:45:34 -07:00 |
|
Cheng Wan
|
97a0031799
|
[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984)
|
2026-06-11 17:38:05 -07:00 |
|
Liangsheng Yin
|
c0480a88be
|
[Spec] Retire Spec V1 (#27964)
|
2026-06-11 16:15:15 -07:00 |
|
Oguz Ulgen
|
949326d922
|
Add SGLANG_ENABLE_WAR_BARRIER to force-enable the overlap scheduler WAR barrier on non-CUDA (e.g. AMD) (#27967)
|
2026-06-11 15:38:37 -07:00 |
|
 Brayden ZhongandBrayden Zhong
|
493f828bfa
|
Add DeepGEMM prerelease wheel tests (#27075)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-06-11 15:14:50 -07:00 |
|
 
|
d71e9bede6
|
[bugfix] commit Mamba states after NGRAM target verify (#26351)
Co-authored-by: xbfs <xuebf1@lenovo.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-06-11 15:11:18 -07:00 |
|
Yueming Yuan
|
cd075d1f64
|
[RL] convert DeepSeek V4 APE layout through weight loader (#27307)
|
2026-06-11 15:05:27 -07:00 |
|
Trevor Morris
|
0bac184425
|
[NVIDIA] Update Minimax-M2.5,M2.7 docs with flags for performance (#24465)
|
2026-06-11 14:58:44 -07:00 |
|
Liangsheng Yin
|
fee717f303
|
[Spec] Fold the DFLASH worker base into DFlashWorkerV2 on BaseSpecWorker (#27950)
|
2026-06-11 14:54:28 -07:00 |
|
Liangsheng Yin
|
acdb39edd2
|
[Spec] Remove the DFLASH V1 worker path (#27959)
|
2026-06-11 14:37:58 -07:00 |
|
Wang, FangYuan
|
6e885c844f
|
Revert "[AMD] Fix DeepSeek V4 Pro c128 state tensor dtype mismatch error and c4_sparse_raw_indices attribute error in cuda graph phase" (#27919)
|
2026-06-11 14:25:32 -07:00 |
|
Michael
|
12d3f02be8
|
[AMD] Fix DSA device-to-host direct test on rocm720 (page_size%16 assert) (#27850)
|
2026-06-11 14:24:23 -07:00 |
|
Liangsheng Yin
|
df5055e00f
|
Bump spec logprob match delta for the bf16 eagle fixture (#27952)
|
2026-06-11 14:21:07 -07:00 |
|
Liangsheng Yin
|
1ac75c3463
|
[CI] Fix GB300 TestDummyWithSBO crash: disable NaN assert and coredump for dummy weights (#27955)
|
2026-06-11 14:17:03 -07:00 |
|
Baizhou Zhang
|
d26b90cf70
|
Add weireweire to CI permissions (#27957)
|
2026-06-11 14:10:45 -07:00 |
|
  ![github-actions[bot]](/assets/img/avatar_default.png)
|
ec0eb6cce8
|
Support MiMo v2 ASR (#26278)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: yanyihan <yanyihan@xiaomi.com>
Co-authored-by: zhuqingchao <zhuqingchao@xiaomi.com>
|
2026-06-11 13:43:13 -07:00 |
|
Jackey Hua
|
24c5d76f74
|
fix: per-sequence last-token embedding in EAGLE3/MTP draft for batched multimodal spec decoding (#27846)
|
2026-06-11 13:33:16 -07:00 |
|
 cctryandcctry
|
10219bd9d6
|
[PD] Fix negative prefill kv_transfer_alloc_ms under optimistic prefill (#27885)
Co-authored-by: cctry <cctry@fb.com>
|
2026-06-11 13:12:25 -07:00 |
|
Yuwei An
|
880e6f66fc
|
[BCG] Share output buffers across capture sizes + typed ShapeKey (#27857)
|
2026-06-11 11:58:05 -07:00 |
|
Brian Chao
|
7f57b344c9
|
[diffusion] feat: progressive resolution growing for Ideogram 4 via GPU DCT upsampling with up to 1.56× speedup (#27736)
|
2026-06-11 23:16:53 +08:00 |
|
 Chi McIsaacandMick
|
b2728bda9d
|
[diffusion] feat: use fused w8a8 kernel for Ideogram4 weight-only linear as an opt-in (#27590)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-06-11 23:15:27 +08:00 |
|
 Xiaoyu ZhangandBBuf
|
06e0df5899
|
Optimize Qwen3 Next FP8 MoE on H200 (#26204)
Co-authored-by: BBuf <xiaoyu.zhang@radixark.net>
|
2026-06-11 22:18:43 +08:00 |
|