Cheng Wan
|
986cb8268b
|
[Refactor] Enter draft TP scopes by attention ownership and drop ModelRunner.tp_group (#41817)
|
2026-09-30 13:28:50 -07:00 |
|
Cheng Wan
|
e7f6a99313
|
[Refactor] Add make_pp_layers so models stop handing their PP position down (#41816)
|
2026-09-30 13:28:34 -07:00 |
|
Cheng Wan
|
00659ac099
|
[Refactor] Stop passing models' layers the placement they already read (#41815)
|
2026-09-30 13:28:17 -07:00 |
|
Cheng Wan
|
c7fa37a5ca
|
[Refactor] Let FusedMoE's weight-loading helpers read the layer's MoE-TP rank (#41814)
|
2026-09-30 13:27:58 -07:00 |
|
Cheng Wan
|
499e86db98
|
[Refactor] Keep only the TP and PP groups on the model runner (#41813)
|
2026-09-30 13:27:31 -07:00 |
|
Cheng Wan
|
a09aedf1ca
|
[Refactor] Drop model placement attributes and parameters nothing reads (#41812)
|
2026-09-30 13:27:11 -07:00 |
|
Cheng Wan
|
b0cc246ff8
|
[Refactor] Drop placement values nothing reads (#41811)
|
2026-09-30 13:26:51 -07:00 |
|
Cheng Wan
|
4f3ee94d25
|
[Fix] Make the Solar model constructible and runnable (#41810)
|
2026-09-30 13:26:32 -07:00 |
|
Cheng Wan
|
a659e6461f
|
[Fix] Size the prefill delayer's gather buffer to its TP group (#41809)
|
2026-09-30 13:26:12 -07:00 |
|
Cheng Wan
|
ecc0f0dec2
|
[Fix] Pass the draft's attention ownership to DFLASH's eager LiLiCorr scope (#41808)
|
2026-09-30 13:25:54 -07:00 |
|
Cheng Wan
|
e289989933
|
[Fix] Shard MoE WNA16 and Quark INT4-FP8 weights by the MoE placement (#41807)
|
2026-09-30 13:25:38 -07:00 |
|
Cheng Wan
|
3f20738846
|
[Fix] State the configured MoE-DP width in the weight-cache fingerprint (#41806)
|
2026-09-30 13:25:19 -07:00 |
|
Cheng Wan
|
e27b6e0971
|
[Fix] Read TensorCast's WORLD placement under its current names (#41805)
|
2026-09-30 13:25:03 -07:00 |
|
YAMY
|
4407a21f3c
|
[Spec][PP] Fix hybrid recurrent-state commit and micro-batch pairing under PP x speculative decoding (#40001)
|
2026-09-30 13:05:39 -07:00 |
|
 
|
547286bb5a
|
[Deps] Bump transformers to 5.17.0 (#39012)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-09-30 12:52:02 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
036a3b3e14
|
[Test] Lower the SM120 NVFP4 KV GSM8K threshold to 0.60 (#41799)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-30 12:50:42 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
eae808903f
|
[Deps] Bump FlashInfer to 0.7.0.post1 (#40709)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-30 12:42:19 -07:00 |
|
 
|
4dfc0ac131
|
[BugFix] Pass token-major Q/K tensors from Gemma-3 to RadixAttention (#37984)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
|
2026-09-30 12:05:41 -07:00 |
|
 Kevin MiandKevin Mi
|
3a398442bf
|
dsv4.1-amd: serve DeepSeek-V4.1 on gfx950 (#41308)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
|
2026-09-30 11:47:14 -07:00 |
|
 
|
9f9f9e702a
|
[HiCache] Attribute buffer-mode storage hits against the joint device match (#41758)
Co-authored-by: merrymercy <merrymercy@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-09-30 11:46:30 -07:00 |
|
zijiexia
|
d26ec4690d
|
docs: remove unreliable DeepWiki badge (#41851)
|
2026-09-30 10:51:36 -07:00 |
|
 Shuwen WangandShangming Cai
|
aec4b799e6
|
[PD][Mamba] fix: free the COW mamba slot of decode requests dropped before preallocation (#41451)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-09-30 17:50:44 +00:00 |
|
jain-ria
|
21ed9fbf44
|
[Rust] Extract shared runtime.v1 protobuf bindings (#41726)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
|
2026-09-30 10:13:08 -07:00 |
|
 Sohom chakrabortyandShuwen Wang
|
28c5e7f5cb
|
[Fix] Stop PD-decode queue_time from counting decode time before a retraction (#41380)
Signed-off-by: Sohom Chakraborty <sohomchakraborty.iitkgp@gmail.com>
Co-authored-by: Shuwen Wang <47200617+alphabetc1@users.noreply.github.com>
|
2026-09-30 23:17:03 +08:00 |
|
 
|
bd66ce343e
|
[diffusion] nightly: measure every framework with one client end-to-end methodology (#41689)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-30 19:52:20 +08:00 |
|
 
|
4b3f63ec70
|
[Router] Prove a bootstrapped replica answers like the one it copied (11/13) (#40697)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-30 19:19:26 +08:00 |
|
 
|
4c930125c7
|
[Router] Ask the fleet when a graft's splice goes unwitnessed (10/13) (#40696)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-30 18:59:21 +08:00 |
|
Cheng Wan
|
53225fadf4
|
[Fix] Stop the namespace census at the leaf a read names (#41838)
|
2026-09-30 03:27:51 -07:00 |
|
 
|
f8500474c9
|
[Router] Share one fleet-wide fetch across a discovery burst (9/13) (#40695)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-30 18:07:51 +08:00 |
|
jacky.cheng
|
47dcde70f4
|
[Docs] Add MI355X FP8 agentic recipe to the Qwen3.5 cookbook (#41849)
|
2026-09-30 17:44:19 +08:00 |
|
 Yuan Luoandluoyuan.luo
|
57c81258d4
|
[KDA] Enable the ptx_kda prefill backend on SM100 (B200 / GB200) (#41445)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-09-30 17:24:51 +08:00 |
|
 Yuan Luoandluoyuan.luo
|
c0296186b7
|
[KDA] Fix ptx_kda prefill NaN without a gate lower bound and workspace growth (#41572)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-09-30 17:23:54 +08:00 |
|
 paulzhang-tmandKe Bao
|
8055ccd2cd
|
[Linear Attention] Expose GDN/KDA prefill hooks and auxiliary cache accounting (#40227)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2026-09-30 17:19:02 +08:00 |
|
 EdwardXuyandEdwardXuy
|
9b7464c8dd
|
ci: temporarily disable A5 (950) nightly job during power maintenance (#41856)
Co-authored-by: EdwardXuy <EdwardXuy@users.noreply.github.com>
|
2026-09-30 17:17:39 +08:00 |
|
jiaryang
|
e9b0d0c0a3
|
[AMD] Gate flashinfer and TRT-LLM DSA paths on CUDA (#40911)
|
2026-09-30 02:10:02 -07:00 |
|
Michael
|
d7cce54885
|
[AMD] Resolve QSA packed-varlen decode to aiter on HIP (#41513)
|
2026-09-30 02:01:15 -07:00 |
|
amote-i
|
964c45cf31
|
[NPU] [DOC]: add Kimi-K3 NPU PD disaggregation recipes (#41717)
|
2026-09-30 16:42:46 +08:00 |
|
 
|
4d4d3f2e5c
|
[Router] Sweep the fleet for a peer snapshot and hand it to the pump (8/13) (#40694)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
|
2026-09-30 16:34:12 +08:00 |
|
 
|
45c8ddddd3
|
[diffusion] feat: check the final MP4 in-process instead of spawning ffprobe (#41825)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-30 16:26:39 +08:00 |
|
WenhaoZhang
|
0931a72eb2
|
[diffusion] feat: support MiniMax H3 RL (#34365)
|
2026-09-30 16:23:56 +08:00 |
|
Michael
|
b87a241a6f
|
[AMD] Add Qwen3.8-Flash-Next-FP8 nightly validation (#36901)
|
2026-09-30 00:54:36 -07:00 |
|
 
|
682f4ef32f
|
[ROCm] Select DSA indexer top-k wave size by arch (wave32 on gfx1250) (#41687)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-09-30 00:47:04 -07:00 |
|
Shuwen Wang
|
51cae5f303
|
[HiCache][PD] fix: clamp the decode restore to the prefix promised to prefill (#41450)
|
2026-09-30 15:26:15 +08:00 |
|
 heziiopandsglang-npu-bot
|
ec0006673a
|
[NPU] Add decode context parallel support for dsa models (#37787)
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
|
2026-09-30 15:22:16 +08:00 |
|
Shangming Cai
|
8c75ad9e62
|
chore: bump mooncake version to 0.3.13.post1 (#41678)
|
2026-09-30 15:16:54 +08:00 |
|
Zhaoyi Li
|
3b537e96e2
|
[AMD][DI][CI] Leave the GLM-5.2 MTP decode room to load its Triton kernels (#41135)
|
2026-09-30 00:02:42 -07:00 |
|
Zhaoyi Li
|
25de118ae3
|
[AMD][DI][CI] Give the dsv4pro-fp4 MTP decode more memory headroom (#41238)
|
2026-09-29 23:57:25 -07:00 |
|
Zhaoyi Li
|
4207f1ae23
|
[AMD][DI][CI] Record the commit the MI355X nightly tested (#41099)
|
2026-09-29 23:55:38 -07:00 |
|
Zhaoyi Li
|
f85ca901e2
|
[AMD][DI][CI] Fix four failures in the MI355X disaggregation nightly (#41025)
|
2026-09-29 23:54:40 -07:00 |
|
 
|
24ee67d2fa
|
Readme refresh (#41787)
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
|
2026-09-29 23:48:38 -07:00 |
|