Cheng Wan
|
3f20738846
|
[Fix] State the configured MoE-DP width in the weight-cache fingerprint (#41806)
|
2026-09-30 13:25:19 -07:00 |
|
Cheng Wan
|
e27b6e0971
|
[Fix] Read TensorCast's WORLD placement under its current names (#41805)
|
2026-09-30 13:25:03 -07:00 |
|
YAMY
|
4407a21f3c
|
[Spec][PP] Fix hybrid recurrent-state commit and micro-batch pairing under PP x speculative decoding (#40001)
|
2026-09-30 13:05:39 -07:00 |
|
 
|
547286bb5a
|
[Deps] Bump transformers to 5.17.0 (#39012)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-30 12:52:02 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
eae808903f
|
[Deps] Bump FlashInfer to 0.7.0.post1 (#40709)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-30 12:42:19 -07:00 |
|
 
|
4dfc0ac131
|
[BugFix] Pass token-major Q/K tensors from Gemma-3 to RadixAttention (#37984)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
|
2026-09-30 12:05:41 -07:00 |
|
 Kevin MiandKevin Mi
|
3a398442bf
|
dsv4.1-amd: serve DeepSeek-V4.1 on gfx950 (#41308)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
|
2026-09-30 11:47:14 -07:00 |
|
 
|
9f9f9e702a
|
[HiCache] Attribute buffer-mode storage hits against the joint device match (#41758)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-09-30 11:46:30 -07:00 |
|
 Shuwen WangandShangming Cai
|
aec4b799e6
|
[PD][Mamba] fix: free the COW mamba slot of decode requests dropped before preallocation (#41451)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-30 17:50:44 +00:00 |
|
jain-ria
|
21ed9fbf44
|
[Rust] Extract shared runtime.v1 protobuf bindings (#41726)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
|
2026-09-30 10:13:08 -07:00 |
|
 Sohom chakrabortyandShuwen Wang
|
28c5e7f5cb
|
[Fix] Stop PD-decode queue_time from counting decode time before a retraction (#41380)
Signed-off-by: Sohom Chakraborty <sohomchakraborty.iitkgp@gmail.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-09-30 23:17:03 +08:00 |
|
 
|
bd66ce343e
|
[diffusion] nightly: measure every framework with one client end-to-end methodology (#41689)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-30 19:52:20 +08:00 |
|
 Yuan Luoandluoyuan.luo
|
57c81258d4
|
[KDA] Enable the ptx_kda prefill backend on SM100 (B200 / GB200) (#41445)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-09-30 17:24:51 +08:00 |
|
 Yuan Luoandluoyuan.luo
|
c0296186b7
|
[KDA] Fix ptx_kda prefill NaN without a gate lower bound and workspace growth (#41572)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-09-30 17:23:54 +08:00 |
|
 paulzhang-tmandKe Bao
|
8055ccd2cd
|
[Linear Attention] Expose GDN/KDA prefill hooks and auxiliary cache accounting (#40227)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-09-30 17:19:02 +08:00 |
|
jiaryang
|
e9b0d0c0a3
|
[AMD] Gate flashinfer and TRT-LLM DSA paths on CUDA (#40911)
|
2026-09-30 02:10:02 -07:00 |
|
Michael
|
d7cce54885
|
[AMD] Resolve QSA packed-varlen decode to aiter on HIP (#41513)
|
2026-09-30 02:01:15 -07:00 |
|
 
|
45c8ddddd3
|
[diffusion] feat: check the final MP4 in-process instead of spawning ffprobe (#41825)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-30 16:26:39 +08:00 |
|
WenhaoZhang
|
0931a72eb2
|
[diffusion] feat: support MiniMax H3 RL (#34365)
|
2026-09-30 16:23:56 +08:00 |
|
 
|
682f4ef32f
|
[ROCm] Select DSA indexer top-k wave size by arch (wave32 on gfx1250) (#41687)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-09-30 00:47:04 -07:00 |
|
Shuwen Wang
|
51cae5f303
|
[HiCache][PD] fix: clamp the decode restore to the prefix promised to prefill (#41450)
|
2026-09-30 15:26:15 +08:00 |
|
 heziiopandsglang-npu-bot
|
ec0006673a
|
[NPU] Add decode context parallel support for dsa models (#37787)
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
|
2026-09-30 15:22:16 +08:00 |
|
 
|
eb9c9ee99d
|
[Qwen4-Exp] Optional fp8 (e4m3) storage for the compressed QSA indexer cache (#39614)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: YAMY1234 <74099316+YAMY1234@users.noreply.github.com>
|
2026-09-29 22:11:46 -07:00 |
|
Qiaolin Yu
|
88f95f4b87
|
[qwen next] Fuse QSA KV preparation and sparse block expansion (#40972)
|
2026-09-29 21:54:34 -07:00 |
|
Qiaolin Yu
|
b660100c00
|
[qwen 3.8 next] Fuse QSA graph replay metadata across draft steps (#41173)
|
2026-09-29 21:52:28 -07:00 |
|
 JohnQinAMDandClaude Opus 5.5
|
964fd6af92
|
[ROCm] GLM-5.2: gfx950 four-kernel fused DSA indexer decode path (#38583)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-29 21:52:00 -07:00 |
|
Cheng Wan
|
d41904f05e
|
[Refactor] Build seven more decoders from stage boundaries (#41779)
|
2026-09-29 21:16:45 -07:00 |
|
Cheng Wan
|
113e6a1496
|
[Refactor] Simplify layer boundary internals (#41778)
|
2026-09-29 21:15:58 -07:00 |
|
Wenfei (Charles) Qi
|
7fb85a9d88
|
[MLX] Fix startup after logical token capacity change (#41314)
|
2026-09-29 21:15:56 -07:00 |
|
Cheng Wan
|
9ee065e49a
|
[Fix] Step-3.5: build the shared expert without TP under all-to-all MoE backends (#41754)
|
2026-09-29 21:11:37 -07:00 |
|
Cheng Wan
|
faa5064f6e
|
[Refactor] Send producer-written residual streams through to_pp (#41753)
|
2026-09-29 21:11:02 -07:00 |
|
Cheng Wan
|
843f50f5c1
|
[Fix] Reduce the Sarvam dense MLP through its row-parallel projection (#41752)
|
2026-09-29 21:10:17 -07:00 |
|
Cheng Wan
|
ea855f0daf
|
[Refactor] Leave decoder stacks through final_norm(skip_empty=True) (#41751)
|
2026-09-29 21:08:19 -07:00 |
|
Cheng Wan
|
01b5f572b7
|
[Refactor] Rename layer boundary protocols, contracts and helpers (#41750)
|
2026-09-29 21:05:48 -07:00 |
|
   ![github-actions[bot]](/assets/img/avatar_default.png)
|
cb3ba2f2b7
|
[XPU] Add dynamic_expert_bias and track_state support (#39618)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
Co-authored-by: Singh <rohitsi2@iil-gnrap01.iind.intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-30 12:05:35 +08:00 |
|
 
|
fc9bdc8a3e
|
[MoE] Keep the moe_align_block_size pad fill inside sorted_token_ids (#41759)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: oulgen <oulgen@users.noreply.github.com>
|
2026-09-29 17:43:17 -07:00 |
|
Baizhou Zhang
|
e5cec303ae
|
[Fix] Restore deferred layer dumps and pin SentencePiece for InternVL (#41777)
|
2026-09-29 17:28:30 -07:00 |
|
sglang-bot
|
cae69be584
|
chore: bump sgl-kernel version to 0.4.8 (#41784)
|
2026-09-29 17:19:21 -07:00 |
|
DarkSharpness
|
57d4adeb83
|
[Kernel] Expose FlashMLA kv_format in sgl-kernel sparse decode (#41336)
|
2026-09-29 17:16:52 -07:00 |
|
Cheng Wan
|
8d2d874758
|
[Fix] Release consumed residual contributions (#41749)
|
2026-09-29 16:38:05 -07:00 |
|
 Jiajun LiandShi Dong
|
3d4953839c
|
[Fix] MoE: require TopK layer_id to ensure routed expert captures (#40980)
Co-authored-by: Shi Dong <hello@dongshi.me>
|
2026-09-29 16:29:27 -07:00 |
|
Jiajun Li
|
f0e4001930
|
[Fix] Allocate SWA KV pools inside the memory-saver region (#40979)
|
2026-09-29 16:29:02 -07:00 |
|
Yuwei An
|
d3f8a8f4f5
|
[Spec/Prefill Coordination] Dspark support (#41623)
|
2026-09-29 16:08:01 -07:00 |
|
Liangsheng Yin
|
211b1d9784
|
[Refactor] Share PD routing fields across request models (#41756)
|
2026-09-29 15:11:18 -07:00 |
|
  
|
37a47737c8
|
[Perf] Tune SM90 GDN recurrent verify launch for small batches (#41486)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-09-29 15:03:33 -07:00 |
|
 Mohammad Miadh Angkadandhnyls2002
|
4885b563c3
|
[Test] Demote PD test RDMA openability check to a warning (#41681)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-29 14:52:31 -07:00 |
|
 
|
84523d6785
|
[Spec] Reuse K3 auxiliary outputs across decode CUDA graph sizes (#40159)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-29 14:24:51 -07:00 |
|
 James LiuandClaude Opus 5.5
|
77a81996ce
|
[PD] Preserve bootstrap metadata in native Messages requests (#39711)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 13:32:54 -07:00 |
|
  
|
3c4653b6a3
|
[Metrics] Fix PD latency histogram accounting (#39706)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-09-29 13:12:09 -07:00 |
|
 
|
51ace48387
|
[Metrics] Add request-level TPOT histogram (sglang:request_time_per_output_token_seconds) (#40275)
Co-authored-by: Gilford Ting <gilford@modal.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-29 12:20:22 -07:00 |
|