 
|
5d385007b3
|
[diffusion] kernels: take the Wan VAE decoder's remaining first-decode work off the request path (#41830)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-06 09:05:29 +08:00 |
|
Liangsheng Yin
|
ad7a9b53cc
|
[mem_cache] Make release_kv_cache's final checkpoint an explicit checkpoint flag (#42270)
|
2026-10-05 17:32:07 -07:00 |
|
Po-Han Huang (NVIDIA)
|
62af5f56a5
|
[CI] Drop the redundant and broken tc_piecewise tests (#42571)
|
2026-10-05 17:29:32 -07:00 |
|
Liangsheng Yin
|
c01d59eb90
|
[Session] Let a streaming session own its KV record and tree lock from the first turn (#42537)
|
2026-10-05 17:28:09 -07:00 |
|
Liangsheng Yin
|
f3fe753475
|
[misc] Rename SGLANG_OPT_SWA_RELEASE_LEAF_LOCK_AFTER_WINDOW to SGLANG_OPT_RELEASE_PREFILL_SWA (#42657)
|
2026-10-05 17:24:15 -07:00 |
|
Yuwei An
|
18ec2ecce3
|
[Refactor][TCPCG] Relocate shared graph tensor and DSA head-gate helpers (1/9) (#42285)
|
2026-10-05 17:06:52 -07:00 |
|
ADiL
|
968726f3ce
|
[HiCache] Route --file-storage-path to the file storage backend (#33883)
Signed-off-by: adlashab <adlashab@amd.com>
|
2026-10-05 15:33:49 -07:00 |
|
 
|
61ba98443d
|
[DSA] k-pool: 256-token logical page so index page id = logical page id (#42178)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-10-05 15:02:44 -07:00 |
|
 
|
c765f8818a
|
[DFlash2] Keep the greedy selector walk in range for all-NaN score rows (#41737)
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
|
2026-10-05 14:29:13 -07:00 |
|
maocheng23
|
57826a62ea
|
[Speculative] Add opt-in block verification (#42297)
|
2026-10-05 11:49:23 -07:00 |
|
 
|
150f568900
|
[diffusion] kernels: stop specializing on per-request sequence lengths (#41710)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 22:21:01 +08:00 |
|
 WenhaoZhangandMick Qian
|
284cda01fb
|
[diffusion] optimization: fuse the video VAE decoder's RMSNorm and QK RoPE for MiniMax-H3 (#41906)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-05 17:30:39 +08:00 |
|
 elvischenvandClaude Opus 5.5
|
55dcf3254f
|
Fix XQA draft extend with FP8 KV cache in trtllm_mha (#41656)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-05 01:37:54 -07:00 |
|
 
|
438d9d2074
|
[Feature] DeepEP v2: expanded (do_expand=True) prefill dispatch (#37261)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-10-05 00:02:10 -07:00 |
|
 
|
cafb37a10d
|
[JIT] Fuse FP8 KV-cache quantization into the prefix-valid commit kernel (#40785)
Co-authored-by: Jayden Yu <jaydenyu@fb.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-05 14:47:54 +08:00 |
|
 
|
520d6d0229
|
[DSv4.1] Prefill indexer: raw selection, row-pair schedule ids, no host syncs (#41659)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-10-05 14:33:37 +08:00 |
|
Liangsheng Yin
|
503b898540
|
[Session] Count streaming session KV by owner in pool accounting (#42539)
|
2026-10-04 22:15:57 -07:00 |
|
ashwini rathi
|
b1bbd74f28
|
[XPU][CI] Disable test_xpu_graph until tc_piecewise is removed (#41634) (#42524)
|
2026-10-05 11:09:26 +08:00 |
|
Xiaoyu Zhang
|
f385390be5
|
[Refactor] Simplify GDN, vision RoPE and MLA kernel dispatch (#42506)
|
2026-10-05 09:37:53 +08:00 |
|
 
|
734cf3cf3b
|
[PD] Reload NIXL peer metadata after the peer is invalidated (#41691)
Co-authored-by: agent <agent@local>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
|
2026-10-05 00:49:26 +00:00 |
|
Yuwei An
|
f70e8c68fc
|
[Dsv4.1] Bounded replay with sparse mla path (#42273)
|
2026-10-04 17:19:14 -07:00 |
|
 Eric.Chin.AMDandBingxu Chen
|
b792228b35
|
[ROCm] topk v2: split one long row across blocks, the CDNA cluster-path equivalent (#39931)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
|
2026-10-04 16:54:37 -07:00 |
|
Cheng Wan
|
1f299e9f2f
|
[Refactor] Build layer stacks in order with append_stages (#42481)
|
2026-10-04 16:40:24 -07:00 |
|
Cheng Wan
|
a99567ab74
|
[Fix] GigaChat 3.5: build the stage boundaries once (#42480)
|
2026-10-04 16:39:34 -07:00 |
|
Cheng Wan
|
5c8fb9e938
|
[Fix] Offer the fused MoE finalize all-reduce only to a block that owes the sum (#42479)
|
2026-10-04 16:39:06 -07:00 |
|
Cheng Wan
|
f07c1a398e
|
[Refactor] Build the Qwen4 experimental decoders from stage boundaries (#42478)
|
2026-10-04 16:38:36 -07:00 |
|
Cheng Wan
|
92d60351e2
|
[Refactor] Build the Hunyuan V4 decoder from stage boundaries (#42477)
|
2026-10-04 16:38:03 -07:00 |
|
 Lianmin Zhengandjiayisuse
|
f5ccc4d7d9
|
[Kernel] Use explicit reciprocal scaling for recurrent Q/K normalization (#42486)
Co-authored-by: jiayisuse <jiayisuse@users.noreply.github.com>
|
2026-10-04 15:30:03 -07:00 |
|
Aditya Sharma
|
caf96324fc
|
[Apple Silicon] Add an Apple Silicon (MPS) platform to the standard Torch model runner (#36780)
|
2026-10-04 15:03:40 -07:00 |
|
 SuperSongandCheng Wan
|
bab04cd791
|
fix(unified-memory): propagate unified-memory lazy checkpoint policy and handle unallocated session slots (#42072)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-04 12:51:22 -07:00 |
|
 Zhang, Jiejingandkyle-256
|
aa0ce20201
|
[ROCm] GLM-5.2 decode path: decode-shaped MoE/MLA tiles, split speculative softmax, and bf16 GEMM routing (#41725)
Co-authored-by: kyle-256 <Kyle.Zhao@amd.com>
|
2026-10-04 11:19:37 -07:00 |
|
Xiaoyu Zhang
|
7a719e9a65
|
[AMD] Fix RoPE cache dtype and diffusion CI failures (#42494)
|
2026-10-05 00:36:26 +08:00 |
|
Shuwen Wang
|
137c084000
|
[HiCache] refactor: retire in-flight storage prefetches through one helper (#41453)
|
2026-10-05 00:13:07 +08:00 |
|
 Shangming CaiandClaude Opus 5
|
148da8e77d
|
[PD] Validate decode state layout once at registration (#42051)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-10-04 18:32:30 +08:00 |
|
Xiaoyu Zhang
|
bc5a055dd7
|
[diffusion] move kernel validation into launchers and simplify dispatch (#42391)
|
2026-10-04 18:23:29 +08:00 |
|
 SuperSongandCheng Wan
|
6cec8f98ce
|
[Bugfix] Fix unified-memory compaction gates and pending page reuse (#39982)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-04 02:48:08 -07:00 |
|
 SuperSongandCheng Wan
|
1d02a36bb7
|
fix(inkling): translate unified-memory checkpoint destinations to physical slots (#38229)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-04 02:45:45 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
0bdd0cc8dc
|
[Deps] Upgrade the CUDA PyTorch stack to 2.14 (#38641)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-04 00:48:02 -07:00 |
|
Kotthagattu Meher Sai
|
9631f6f2d0
|
[XPU] Enable fused QK-norm + RoPE for Qwen3-MoE (#40190)
|
2026-10-04 15:45:18 +08:00 |
|
Baizhou Zhang
|
55c5415c17
|
[CP] Support scattered interleave CP inputs with expert parallelism (#42041)
|
2026-10-04 00:43:31 -07:00 |
|
    
|
937c0a6cfe
|
Fix unified HiCache physical transfers (#39479)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yonghao Zhuang <yhzhuang@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
|
2026-10-04 00:38:56 -07:00 |
|
Liangsheng Yin
|
048b2a07f3
|
[Session] Release aborted streaming turns through the normal release path (#42330)
|
2026-10-03 22:30:25 -07:00 |
|
 Brayden ZhongandMohammad Angkad
|
a3275295c4
|
[MoE] Use FlashInfer A2A for prefill instead of AG+RS (#39818)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-03 21:09:00 -07:00 |
|
Baizhou Zhang
|
fccc61c1c5
|
[CP] Support DP x TP x CP for attention with interleave CP strategy (#42038)
|
2026-10-03 20:57:36 -07:00 |
|
Aurick Qiao
|
f24db66729
|
[PD] Publish prefill DP rank whenever forced lookup is enabled (#41786)
|
2026-10-04 11:46:20 +08:00 |
|
 metamergebotandmetamergebot
|
169e6223ef
|
[PD] Drop the removed MooncakeKVSender args from test_prefill_complete_integration (#42454)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
|
2026-10-03 20:29:06 -07:00 |
|
 
|
4611ea365e
|
[HiCache]: Fix host lock ownership across radix splits (#38480)
Signed-off-by: Lukas Humbel <lhumbel@nvidia.com>
Co-authored-by: Jialin Ouyang <jialino@meta.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-10-04 11:16:04 +08:00 |
|
  
|
5606fb8592
|
[Fix] HiCache: carry registered Mamba slot side states (Qwen4-Exp PLE) through the host tier (#39862)
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-10-04 10:15:59 +08:00 |
|
Michael
|
f2385314b2
|
[AMD] Add DeepSeek-V4.1-Flash MI35x nightly accuracy test (#41476)
|
2026-10-03 18:16:44 -07:00 |
|
trebladev
|
295a53c90e
|
[diffusion] optimization: fuse Flux3 rowwise FP8 quantization with triton (#41671)
|
2026-10-04 09:01:17 +08:00 |
|