 SuperSongandCheng Wan
|
1d02a36bb7
|
fix(inkling): translate unified-memory checkpoint destinations to physical slots (#38229)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-04 02:45:45 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
0bdd0cc8dc
|
[Deps] Upgrade the CUDA PyTorch stack to 2.14 (#38641)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-04 00:48:02 -07:00 |
|
Kotthagattu Meher Sai
|
9631f6f2d0
|
[XPU] Enable fused QK-norm + RoPE for Qwen3-MoE (#40190)
|
2026-10-04 15:45:18 +08:00 |
|
Baizhou Zhang
|
55c5415c17
|
[CP] Support scattered interleave CP inputs with expert parallelism (#42041)
|
2026-10-04 00:43:31 -07:00 |
|
    
|
937c0a6cfe
|
Fix unified HiCache physical transfers (#39479)
Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Yonghao Zhuang <yhzhuang@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
|
2026-10-04 00:38:56 -07:00 |
|
Liangsheng Yin
|
048b2a07f3
|
[Session] Release aborted streaming turns through the normal release path (#42330)
|
2026-10-03 22:30:25 -07:00 |
|
 Brayden ZhongandMohammad Angkad
|
a3275295c4
|
[MoE] Use FlashInfer A2A for prefill instead of AG+RS (#39818)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-03 21:09:00 -07:00 |
|
Baizhou Zhang
|
fccc61c1c5
|
[CP] Support DP x TP x CP for attention with interleave CP strategy (#42038)
|
2026-10-03 20:57:36 -07:00 |
|
Aurick Qiao
|
f24db66729
|
[PD] Publish prefill DP rank whenever forced lookup is enabled (#41786)
|
2026-10-04 11:46:20 +08:00 |
|
 metamergebotandmetamergebot
|
169e6223ef
|
[PD] Drop the removed MooncakeKVSender args from test_prefill_complete_integration (#42454)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
|
2026-10-03 20:29:06 -07:00 |
|
 
|
4611ea365e
|
[HiCache]: Fix host lock ownership across radix splits (#38480)
Signed-off-by: Lukas Humbel <lhumbel@nvidia.com>
Co-authored-by: Jialin Ouyang <jialino@meta.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-10-04 11:16:04 +08:00 |
|
  
|
5606fb8592
|
[Fix] HiCache: carry registered Mamba slot side states (Qwen4-Exp PLE) through the host tier (#39862)
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
Co-authored-by: alphabetc1 <2508695655@qq.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-10-04 10:15:59 +08:00 |
|
Michael
|
f2385314b2
|
[AMD] Add DeepSeek-V4.1-Flash MI35x nightly accuracy test (#41476)
|
2026-10-03 18:16:44 -07:00 |
|
trebladev
|
295a53c90e
|
[diffusion] optimization: fuse Flux3 rowwise FP8 quantization with triton (#41671)
|
2026-10-04 09:01:17 +08:00 |
|
 
|
71dc292b97
|
[AMD] Use AITER ASM prefill for MiniMax-M3 HD128 attention (#41707)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-10-03 17:54:49 -07:00 |
|
  
|
4ab720e655
|
[HiCache] Fix cgroup page-cache accounting and the sizing fallback when cgroup discovery fails (#42420)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
Co-authored-by: nvjullin <nvjullin@users.noreply.github.com>
|
2026-10-03 16:01:32 -07:00 |
|
Cheng Wan
|
10edb05e72
|
[Refactor] Let the remaining placement consumers read the parallel context (#42348)
|
2026-10-03 14:59:32 -07:00 |
|
Cheng Wan
|
b2aa993cb8
|
[Fix] Skip a draft's decode recapture when it owns no decode graph (#42347)
|
2026-10-03 14:54:12 -07:00 |
|
Cheng Wan
|
1a18de4b29
|
[Fix] Load a draft's tensor weight update from its deployment TP rank (#42346)
|
2026-10-03 14:52:25 -07:00 |
|
Liangsheng Yin
|
df53c978f1
|
[mem_cache] Run mamba models on UnifiedRadixCache when the radix cache is disabled (#42354)
|
2026-10-03 14:11:13 -07:00 |
|
 
|
8bf780dda5
|
feat(metrics): expose deferred decode KV release metrics (#41128)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-10-04 04:52:21 +08:00 |
|
Yanbin Jiang
|
749a89abd6
|
[LoRA] Reorganize kernels and add CODEOWNERS (#42299)
|
2026-10-03 13:43:40 -07:00 |
|
 
|
aaf7ebe077
|
Advertise the KV-event replay endpoint in /server_info (#42274)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-04 04:42:33 +08:00 |
|
AMD-yanfeiwang
|
e83c95b650
|
[AMD] Fix AITER weight slicing for CP decode TP (#39950)
|
2026-10-03 12:09:08 -07:00 |
|
AMD-yanfeiwang
|
f327f92424
|
[AMD] Port CP V2 to the DeepSeek-V4 HIP backend (#34200)
|
2026-10-03 12:08:17 -07:00 |
|
 
|
6acf2f4736
|
[PD] Keep ingesting requests while a prefill forward result is pending (#42035)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: Jialin <Jialin@users.noreply.github.com>
|
2026-10-03 12:02:21 -07:00 |
|
 
|
b016ca406f
|
Support post-capture KV sizing for the unified hybrid-SWA pool (#41961)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: ZYHowell <ZYHowell@users.noreply.github.com>
|
2026-10-03 09:54:20 -07:00 |
|
 
|
2bae12b9b3
|
[HiCache] Fix write-back SWA insert backups tripping the write-through pending-ack assert (#42264)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: 842974287 <842974287@users.noreply.github.com>
|
2026-10-03 09:45:56 -07:00 |
|
   
|
5b5d721239
|
[PD] Add opt-in prefill-complete decode KV allocation (#40703)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-03 21:03:09 +08:00 |
|
 
|
5916999afb
|
[DSv4.1] Fused c1/c2 compress for eager extend, faster c2 decode (#41660)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-10-03 19:31:05 +08:00 |
|
 
|
d75d5b33f7
|
[DSv4.1] Faster fp4 index-K gather and combine_topk_swa_indices (#41658)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-10-03 18:25:22 +08:00 |
|
 DarkSharpnessandClaude Opus 5
|
379ec90fb2
|
[DSv4.1] Fold q_rope_store into fused_q_norm_rope (#41657)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-03 18:24:41 +08:00 |
|
Cheng Wan
|
7be5e3473c
|
[Refactor] Drop the reduction-skip mechanisms stage boundaries no longer use (#42312)
|
2026-10-03 02:21:55 -07:00 |
|
Cheng Wan
|
71b04e02cf
|
[Refactor] Build the ZAYA1, IQuest-Q1 and Gemma 4 decoders from stage boundaries (#42311)
|
2026-10-03 02:21:34 -07:00 |
|
Cheng Wan
|
e4554fd5e5
|
[Refactor] Build the Llama and Nemotron-NAS decoders from stage boundaries (#42308)
|
2026-10-03 02:20:18 -07:00 |
|
Cheng Wan
|
740a4d5955
|
[Refactor] Build the Qwen2 decoders from stage boundaries (#42307)
|
2026-10-03 02:19:56 -07:00 |
|
Cheng Wan
|
b157d548bb
|
[Refactor] Let stage boundaries complete every stage-output sum (#42301)
|
2026-10-03 02:17:48 -07:00 |
|
Liangsheng Yin
|
122b59152c
|
[mem_cache] Replace is_chunk_cache / is_tree_cache with supports_prefix_sharing (#42362)
|
2026-10-03 02:07:55 -07:00 |
|
Banruo Liu
|
8293f9af54
|
[PD] Centralize drain-aware abort acknowledgements (#37077)
|
2026-10-03 16:51:11 +08:00 |
|
Yanbin Jiang
|
254aa41f78
|
[Fix] Guard DeepSeek NVFP4 shared-expert fusion for LoRA and FP4 backends (#42203)
|
2026-10-03 00:37:57 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
00bcc25f6c
|
[HiCache] Fix DeepSeek-V4 storage backend crash from missing storage_format_tag (#42215)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-02 22:27:57 -07:00 |
|
 Jacob0226andThomas Wang
|
af1bef3eaf
|
[AMD] GLM-5.3-Flash: fuse shared expert and KDA projections on Quark MXFP4 (#41870)
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-10-02 20:47:47 -07:00 |
|
 Richard WangandRichard Wang
|
482b062d28
|
[Feature] serve pplx-decider decision checkpoints on /v1/systemone (#42183)
Co-authored-by: Richard Wang <11150595+rwang5203@users.noreply.github.com>
|
2026-10-03 10:18:53 +08:00 |
|
Xiaoyu Zhang
|
391e665dab
|
[Perf] Optimize DeepSeek V4.1 Flash Hopper paths and Blackwell prefill selection (#41251)
|
2026-10-03 10:04:48 +08:00 |
|
Liangsheng Yin
|
a8b54f138e
|
[Session] Run streaming sessions only on UnifiedRadixCache; reject unverified tree caches (#42295)
|
2026-10-02 18:15:59 -07:00 |
|
 
|
8ff02f5820
|
[QSA] Enable breakable prefill CUDA graphs for text-only Qwen3.8 Flash-Next (capture-safe metadata, MTP side-channel padding) (#41729)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2026-10-02 17:57:42 -07:00 |
|
 Kevin MiandClaude Opus 5
|
65f759144d
|
[HiCache] Let the MiniMax-M3 K-only host pool join a host pool group (#42166)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-02 17:00:13 -07:00 |
|
Baizhou Zhang
|
3bde8eb2d8
|
[CP 1/5] Remove the CP adapter and separate interleave transport from boundary reduction (#42036)
|
2026-10-02 16:50:20 -07:00 |
|
   
|
b69a5f296a
|
[AMD] Add opt-in MiniMax-M3 TP4 indexer context partitioning (#41488)
Co-authored-by: ThomasNing <thomas.ning@amd.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
|
2026-10-02 15:34:29 -07:00 |
|
 
|
e8fab85a02
|
[KDA] Add an opt-in decode-parity mode to the Triton multi-token recurrence (#42251)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: jiayisuse <jiayisuse@users.noreply.github.com>
|
2026-10-02 14:59:56 -07:00 |
|