Martin Hua
|
52d5faed5b
|
[Bugfix] Llama4 local attention: read page ids from the graph tables in CUDA-graph capture/replay (page_size > 1) (#38187)
|
2026-10-01 14:42:22 -07:00 |
|
 Jiajun LiandClaude Fable 5.1
|
dcf4e18283
|
fix(nccl): disable graph buffer registration for pausable graph pools (#40648)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-01 12:34:23 -07:00 |
|
  
|
3f4bfda13c
|
[Bugfix] Fix DeepSeek V4 Pro TP24 vocabulary-padding failure on Hopper (#31801)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 11:11:18 -07:00 |
|
 
|
a0fcebb3bb
|
NIXL: Use stride desc API (#37827)
Signed-off-by: Ilia Yastrebov <iyastrebov@nvidia.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-10-01 10:53:00 -07:00 |
|
jain-ria
|
fb92ba1127
|
[Rust] Wire the gRPC server into the frontend lifecycle (#41964)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
|
2026-10-01 10:44:56 -07:00 |
|
 JoeandAlex Nails
|
3031091c36
|
[Kimi-K3] Guard optimized paths by platform (#40269)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-01 08:53:05 -07:00 |
|
 Aurick QiaoandAurick Qiao
|
1a0250c5b6
|
[Disagg] Validate state strides before Mooncake transfers (#41607)
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
|
2026-10-01 18:47:41 +08:00 |
|
 
|
d669efba84
|
[AMD][V4.1][*/N] Greedy dspark draft/accept under SGLANG_SIMULATE_ACC_LEN (#41981)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-01 03:35:28 -07:00 |
|
 
|
3c4e218779
|
[AMD][V4.1][*/N] OPUS sparse prefill on gfx950 through layout conversion (#42017)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: thomawan <thomawan@amd.com>
|
2026-10-01 03:21:25 -07:00 |
|
 kkandwunhuang
|
f45c004e18
|
[AMD][V4.1][*/N] Build DSpark draft metadata inside the CUDA graph on ROCm (#42014)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-01 02:17:13 -07:00 |
|
Xinyi Song
|
73ba6513f4
|
[AMD][V4.1][*/N] Switch the fp8 dense GEMMs on gfx950 to aiter's MXFP8 GEMM (#41970)
|
2026-10-01 02:04:39 -07:00 |
|
Xinyi Song
|
0224fcbd1c
|
[AMD][V4.1][*/N] Route low-ratio indexer and candidate-block top-k through top-k v2 (#41947)
|
2026-10-01 01:56:31 -07:00 |
|
Shunkangz
|
266d9d1fa7
|
[Qwen3.8 CP 1/4] Context parallelism for QSA attention and the sparse indexer (#39721)
|
2026-10-01 01:28:55 -07:00 |
|
 
|
b51d4a04f0
|
[DFlash] Keep grouped-conv taps inside each request's block so NaN/Inf cannot leak across requests (#41736)
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
|
2026-10-01 00:18:37 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
42f2e4fcb7
|
[DSA] Stop forcing the per-step CPU seq_lens sync for the k-pool indexer (#41987)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-01 00:16:28 -07:00 |
|
DarkSharpness
|
3ed6367d3f
|
[DSV4/DSA] Name the FlashMLA KV format and drop the V4.1 support probe (#41337)
|
2026-10-01 00:02:18 -07:00 |
|
amd-danli103
|
9c3262d855
|
[AMD][DSV4] feat: enable PD-disagg with fp8 unified_kv on gfx950 (#39166)
|
2026-09-30 23:42:31 -07:00 |
|
Eric Zhang
|
947fee9384
|
[PD] Fix block scale registration for mixed full/SWA KV dtypes (#41924)
|
2026-10-01 14:25:04 +08:00 |
|
Peng Wu
|
11500701f1
|
[DSV4] Reserve the FULL logical page in the c4 indexer pool like its KV pool (#41163)
|
2026-09-30 23:19:27 -07:00 |
|
chien-an-chen
|
99c9d65b32
|
[AMD] AITER MLA DCP decode ASM path (opt-in) (#40750)
|
2026-09-30 22:47:55 -07:00 |
|
billishyahao
|
dc7defd294
|
[Kimi-K3][DCP][DSpark] fix eager mode nonetype crash due to no extend_prefix_lens (#38991)
|
2026-09-30 22:35:25 -07:00 |
|
Ke Bao
|
5733bcaad3
|
Declare HiCache host pools for DSA indexer (#40913)
|
2026-10-01 13:08:26 +08:00 |
|
  
|
f02828ea39
|
fix(dsv4): ship the fp8 unified_kv rope pool through the direct external linker (#40471)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: billishyahao <bill.he@amd.com>
|
2026-09-30 21:46:56 -07:00 |
|
   
|
ebdeba2fee
|
[Fix] Emit Responses reasoning content-part events (#41789)
Co-authored-by: ai-jz <ai-jz@users.noreply.github.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-10-01 11:15:24 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
99c59a2ea6
|
Drop the GLM-5.3-Flash breakable prefill chunk-size pin (#41837)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-09-30 19:26:58 -07:00 |
|
Shuwen Wang
|
bb62f125aa
|
[HiSparse] fix: return HiSparse slots on PD decode waiting abort and DeepSeek V4 free (#41346)
|
2026-10-01 10:24:51 +08:00 |
|
Shuwen Wang
|
c9d6c966d0
|
[HiSparse] fix: reject speculative decoding and mixed chunk at startup (#41347)
|
2026-10-01 10:24:15 +08:00 |
|
 stanleys12andClaude Opus 5
|
3fb721917d
|
[Fix] Require admin auth for /load_lora_adapter_from_tensors and /set_trace_level (#41322)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
|
2026-10-01 10:23:12 +08:00 |
|
Shuwen Wang
|
b62b21e7f4
|
[HiCache][PD] fix: keep decode load-back polling out of rank-local collectives (#41393)
|
2026-10-01 10:22:30 +08:00 |
|
 zijieandZijie Chen
|
0148d9a2fd
|
[AMD] Fix MiniMax-M3 EAGLE3 verification on ROCm (#41497)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
|
2026-09-30 19:05:49 -07:00 |
|
 Shafeeq IbraheemandYanbin Jiang
|
b4df214948
|
Fix LoRA usage-counter accounting across request lifecycle paths (#31808)
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
|
2026-09-30 18:37:53 -07:00 |
|
 Yu-Yun Changandkk
|
6af651ea0c
|
[AMD][Quark] Serve the Kimi-K3 MXFP4 checkpoint on ROCm (#40811)
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
|
2026-09-30 18:14:15 -07:00 |
|
 leonardHONGandlianghougong
|
a702970ecb
|
[Perf] Use FA4 by default for MiMo on SM100 (#41886)
Co-authored-by: lianghougong <lianghouhong@xiaohongshu.com>
|
2026-10-01 09:05:12 +08:00 |
|
Liangsheng Yin
|
63321e3693
|
[Scheduler] Move internal-state readback and updates into a collaborator (#41950)
|
2026-09-30 16:40:57 -07:00 |
|
 Jan Bernlöhrandjbernloehr
|
488869c2d0
|
[Fix] Keep MiMo-V2 processor available without TorchCodec (#41667)
Co-authored-by: jbernloehr <janbernloehr@users.noreply.github.com>
|
2026-09-30 15:28:16 -07:00 |
|
  
|
826f15bf9c
|
[Fix] Preserve inline instructions for Responses and Kimi K3 Messages (#40077)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-09-30 15:20:52 -07:00 |
|
 
|
f050ab194a
|
fix(spec): enable Qwen3.5 EAGLE3 capture and streaming overlap (#41154)
Co-authored-by: Yuhao Wang <59914901+jin-chuan@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
|
2026-09-30 14:41:46 -07:00 |
|
Cheng Wan
|
a9c97c9f69
|
[Feature] Add --attn-dp-size and deprecate --enable-dp-attention (#41818)
|
2026-09-30 13:34:18 -07:00 |
|
 Jason Mancusoandhnyls2002
|
201c4b9b2a
|
[RL, Spec] Introduce top-p mask capture for spec and add DFlash/DSpark impl (#34201)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-30 13:32:26 -07:00 |
|
Cheng Wan
|
986cb8268b
|
[Refactor] Enter draft TP scopes by attention ownership and drop ModelRunner.tp_group (#41817)
|
2026-09-30 13:28:50 -07:00 |
|
Cheng Wan
|
e7f6a99313
|
[Refactor] Add make_pp_layers so models stop handing their PP position down (#41816)
|
2026-09-30 13:28:34 -07:00 |
|
Cheng Wan
|
00659ac099
|
[Refactor] Stop passing models' layers the placement they already read (#41815)
|
2026-09-30 13:28:17 -07:00 |
|
Cheng Wan
|
c7fa37a5ca
|
[Refactor] Let FusedMoE's weight-loading helpers read the layer's MoE-TP rank (#41814)
|
2026-09-30 13:27:58 -07:00 |
|
Cheng Wan
|
499e86db98
|
[Refactor] Keep only the TP and PP groups on the model runner (#41813)
|
2026-09-30 13:27:31 -07:00 |
|
Cheng Wan
|
a09aedf1ca
|
[Refactor] Drop model placement attributes and parameters nothing reads (#41812)
|
2026-09-30 13:27:11 -07:00 |
|
Cheng Wan
|
b0cc246ff8
|
[Refactor] Drop placement values nothing reads (#41811)
|
2026-09-30 13:26:51 -07:00 |
|
Cheng Wan
|
4f3ee94d25
|
[Fix] Make the Solar model constructible and runnable (#41810)
|
2026-09-30 13:26:32 -07:00 |
|
Cheng Wan
|
a659e6461f
|
[Fix] Size the prefill delayer's gather buffer to its TP group (#41809)
|
2026-09-30 13:26:12 -07:00 |
|
Cheng Wan
|
ecc0f0dec2
|
[Fix] Pass the draft's attention ownership to DFLASH's eager LiLiCorr scope (#41808)
|
2026-09-30 13:25:54 -07:00 |
|
Cheng Wan
|
e289989933
|
[Fix] Shard MoE WNA16 and Quark INT4-FP8 weights by the MoE placement (#41807)
|
2026-09-30 13:25:38 -07:00 |
|