 Alison Shao
|
696e8f80d1
|
[CI] Graceful teardown in kl_mamba hicache tests to release pinned host pool (#31871)
|
2026-07-21 02:09:26 -07:00 |
|
|
wenxuewuhd
|
c0ed009f5b
|
[NPU] Fix LLaDA2 MoE OOM after the FRACTAL_NZ cast, re-enabling the NZ speedup (#31772)
|
2026-07-21 16:09:34 +08:00 |
|
|
Lianmin Zheng
|
429f6b6d15
|
Turn on breakable prefill cuda graph for dp attention by default (#31682)
|
2026-07-21 00:03:43 -07:00 |
|
|
Yuhao Yang
|
37a830b667
|
[Feature] Add DWDP (Distributed Weight Data Parallelism) for MoE prefill (#29778)
|
2026-07-20 23:59:54 -07:00 |
|
|
Michael
|
c4c405a46b
|
[AMD] batch 3: register newly-added JIT kernel benchmarks for jit-kernel-benchmark-test-amd (#31615)
|
2026-07-20 23:51:51 -07:00 |
|
|
iridiumine
|
d6ef68881e
|
[NPU] Adapt MiMo-V2.5-W8A8 (#29131)
|
2026-07-21 09:16:48 +08:00 |
|
|
Rahul Vijayaraghavan
|
fa0ced195e
|
[XPU] Enable breakable prefill CUDA graph on XPU (#30273)
|
2026-07-21 09:09:40 +08:00 |
|
|
paulzhang-tm
|
d093c6a4bb
|
[FullCG] Preserve attention LSE through the custom-op boundary (#31050)
|
2026-07-21 09:01:40 +08:00 |
|
|
Yang Liu
|
9462c303a5
|
Fix stop boundaries for grammar-constrained speculative decoding (#31738)
|
2026-07-20 17:55:27 -07:00 |
|
|
Mick
|
4682ded472
|
vlm: parallelize multimodal preprocessing with customized worker num (#31438)
|
2026-07-21 08:44:58 +08:00 |
|
|
Lianmin ZhengandJason Park
|
e7e8aaa73c
|
Overlap grammar (constrained decoding) with speculative decode verify (#31488)
Co-authored-by: Jason Park <jasonjk@fb.com>
|
2026-07-20 17:36:05 -07:00 |
|
|
zijiexia
|
8905cbd42f
|
Fix MiniMax-M3 crash on ROCm by making its override fields resolvable (#31837)
|
2026-07-20 16:14:12 -07:00 |
|
|
Mohammad Miadh Angkad
|
a82ead53bd
|
Make Q contiguous before TRT-LLM MHA decode (#31667)
|
2026-07-20 15:21:00 -07:00 |
|
|
Liangsheng Yin
|
ff6c755952
|
[Refactor] Unify logprob results into a single LogprobResult and rename chunk env vars (#31733)
|
2026-07-20 12:44:27 -07:00 |
|
|
Ke Bao
|
5ab3d90b81
|
Fix dropped Inkling reasoning at stream end (#31787)
|
2026-07-20 23:23:15 +08:00 |
|
|
|
fafa302e41
|
[XPU][NIGHTLY] Add 8 XPU nightly tests, enable 1-gpu suite (#30246)
Co-authored-by: arathi-hlab <arathi-hlab@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-20 16:15:50 +08:00 |
|
|
Baizhou Zhang
|
9668d9ea72
|
Support GPT-OSS zigzag CP with TRTLLM-MHA (#31732)
|
2026-07-20 00:48:04 -07:00 |
|
|
|
02236fa38c
|
Add Inkling model support (#31681)
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Qiaolin Yu <qiaolin.yu@radixark.ai>
Co-authored-by: Zhichen Zeng <zczeng@uw.edu>
Co-authored-by: Aurick Qiao <aurick@thinkingmachines.ai>
Co-authored-by: Joseph <jk@thinkingmachines.ai>
|
2026-07-19 22:57:37 -07:00 |
|
|
Xiaoyu Zhang
|
829e9ce9d5
|
Lower AutoRound quantization MMLU threshold (#31748)
|
2026-07-20 13:40:48 +08:00 |
|
|
Chenchen HongandXiaoyu Zhang
|
49b9c46f41
|
[dLLM] Reuse block KV/req slots in place across FDFO rounds (#27877)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-07-20 13:36:13 +08:00 |
|
|
Liangsheng Yin
|
b15a83983c
|
[Fix] Release hierarchical cache host pool on graceful shutdown (#31746)
|
2026-07-19 22:27:29 -07:00 |
|
|
Mick
|
2eed35d738
|
perf: avoid temporary VLM encoder gather padding (#31301)
|
2026-07-20 12:54:29 +08:00 |
|
|
gaopengff
|
bab1dd0d12
|
[Intel XPU] Enable (biased) grouped topk for xpu (#31126)
|
2026-07-20 09:35:08 +08:00 |
|
|
Mick
|
6a25dd7b5f
|
fix: warm up Kimi VLM vision encoder at startup (#31298)
|
2026-07-20 08:50:57 +08:00 |
|
|
Liangsheng Yin
|
b3570a4531
|
[Refactor] Unify input logprob processing on a single chunked path (#31655)
|
2026-07-19 16:03:23 -07:00 |
|
|
Alison Shao
|
1a317839d7
|
ci: lower VL PP gsm8k threshold to 0.60 (0.65 has zero margin on H100) (#31702)
|
2026-07-19 15:41:12 -07:00 |
|
|
Mick
|
d4801be447
|
fix: fix vlm cuda graph shape stability (#30868)
|
2026-07-19 22:35:51 +08:00 |
|
|
Yuhao Yang
|
a03ca46a28
|
Fix KDA prefix caching under mamba extra_buffer and enable it for kimi_linear (#31474)
|
2026-07-19 20:09:03 +08:00 |
|
|
Baizhou Zhang
|
7a03d30149
|
Support MiMo V2.5 with zigzag context parallelism (#29972)
|
2026-07-19 02:36:40 -07:00 |
|
|
Feng Yao
|
942bf04ef9
|
[Scheduler] Add SGLANG_FORCE_COARSE_WAR_BARRIER opt-in for a whole-forward WAR barrier (#29353)
|
2026-07-19 00:28:49 -07:00 |
|
|
|
b8ec544946
|
[DSA] Integrate Q8KV8 FP8 Sparse MLA Prefill into the DSA Backend (DeepSeek-V3.2) (#30514)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-07-19 11:58:16 +08:00 |
|
|
Lucia Fang
|
99f5a6f46b
|
[flashinfer] Pass window_left at plan time for the SWA paged prefill wrapper (#31501)
|
2026-07-18 13:33:24 -07:00 |
|
|
Liangsheng Yin
|
10908a6793
|
[Fix] Respect cache_protected_len in ChunkCache and disabled-radix release paths (#31662)
|
2026-07-18 12:04:25 -07:00 |
|
|
Ke Bao
|
5609f8e509
|
Reset only the used mamba state on radix cache hit (#31643)
|
2026-07-19 00:40:02 +08:00 |
|
|
Ke Bao
|
48ae829f6e
|
Reset only the used mamba state on unified radix cache (#31648)
|
2026-07-18 21:43:13 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
216b750c8f
|
[Kernel] Sweep decoupled scattered kernels into sglang.kernels.ops (RFC #29630) (#31582)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-18 19:07:07 +08:00 |
|
|
|
9306278fbc
|
vlm: batch cross-request vit encoding and reuse attention metadata (#24013)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-07-18 18:50:33 +08:00 |
|
|
Mick
|
573c075fef
|
CI: synchronize prefill graph test fixtures (#31665)
|
2026-07-18 18:48:05 +08:00 |
|
|
Gabriel Wu
|
faf6894093
|
Implement SM120 DeepSeek V4 flashinfer_mxfp4 moe runner backend + TP2 (#30272)
|
2026-07-18 03:01:06 -07:00 |
|
|
Mick
|
6c6175fabd
|
perf: avoid excessive prefill CUDA graph padding (#31487)
|
2026-07-18 16:25:30 +08:00 |
|
|
Baizhou Zhang
|
38b29dcd6c
|
Fix SM120 NVFP4 KV cache test OOM (#31653)
|
2026-07-18 00:53:47 -07:00 |
|
|
ThanhhaoandHao Phan
|
72c4ed1a3f
|
[Spec] DFlash: remove per-step host syncs so the CPU runs a full step ahead (spec-v2 overlap) (#31468)
Co-authored-by: Hao Phan <htphan@nvidia.com>
|
2026-07-17 23:22:07 -07:00 |
|
|
Michael
|
7fbe91c6ea
|
[AMD] register 8 JIT kernel benchmarks to jit-kernel-benchmark-test-amd (#31492)
|
2026-07-17 23:00:00 -07:00 |
|
|
Liangsheng Yin
|
19c53c44a0
|
[Fix] Account zero-logprob sequences correctly in chunked logprob stitching (#31639)
|
2026-07-17 22:33:27 -07:00 |
|
|
xdtbynd
|
359009fa00
|
[Bugfix][NPU] Fix/Refactor routed scaling factor application in MoE routing (#31449)
|
2026-07-18 10:59:13 +08:00 |
|
|
Baizhou Zhang
|
304a529558
|
Revert "Bump FlashInfer to 0.6.15 and revert regressions" (#31625)
|
2026-07-17 16:46:33 -07:00 |
|
|
Lianmin Zheng
|
c95026aed3
|
Upgrade llguidance to 1.7.6 (#31484)
|
2026-07-17 16:31:44 -07:00 |
|
|
Sam (Kesen Li)
|
ec6a3163b7
|
[Feature] Add FP4 KV Cache Design and support SM120 GPUs (#21601)
|
2026-07-17 14:49:43 -07:00 |
|
|
Liangsheng Yin
|
2c856abbe3
|
[Fix] Enable chunked input-logprob processing by default to cap peak memory (#31498)
|
2026-07-17 13:19:03 -07:00 |
|
|
Bingxu Chen
|
53229e88da
|
[AMD] Fix stale imports in test_fused_fp8_kv_write.py (#31515)
|
2026-07-17 09:03:44 -07:00 |
|