 
|
4c4e352a4b
|
[unified-memory] Mark the write loc physical and check it at every write door (4/7) (#40328)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:10:37 -07:00 |
|
 
|
cdadb1c79a
|
[unified-memory] Token-major dense views for the unified memory pool (3/7) (#38592)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:09:38 -07:00 |
|
 caihuali95andCheng Wan
|
5df52e6382
|
[unified-memory] Build paged KV views through one helper (2/7) (#40327)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:08:42 -07:00 |
|
 caihuali95andCheng Wan
|
d3dbb71e5a
|
[unified-memory] Derive KV row addresses from strides, not shapes (1/7) (#40326)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:07:47 -07:00 |
|
 shyeh25andBrayden Zhong
|
5423a4d885
|
[MegaMoE] Preserve W13 layout for ModelOpt NVFP4 experts (#39388)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-10-01 16:12:34 -07:00 |
|
       
|
f17f7705a5
|
[AMD] [GLM-5.3-Flash] Enable FP8 and MXFP4 serving on gfx950 (#39273)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: long10024070 <long10024070@users.noreply.github.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: sunxxuns <126995791+sunxxuns@users.noreply.github.com>
Co-authored-by: Long Luong <long.luong2+personal@onemount.com>
|
2026-10-01 15:59:44 -07:00 |
|
 Jan Bernlöhrandjbernloehr
|
80bb3fb651
|
[Fix] Select the MXFP4 MoE runner for MiMo-V2 packed experts on SM100 (#41668)
Co-authored-by: jbernloehr <janbernloehr@users.noreply.github.com>
|
2026-10-01 15:33:30 -07:00 |
|
 Kan WuandKan Wu
|
a21dcbd320
|
[sgl-router] Support engines started with --api-key (--worker-api-key) (#41996)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-01 14:54:59 -07:00 |
|
 Kan WuandKan Wu
|
d7565215ec
|
[sgl-router] Route to a specific DP rank inside multi-rank workers (--dp-aware) (#41974)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-01 14:50:59 -07:00 |
|
Martin Hua
|
52d5faed5b
|
[Bugfix] Llama4 local attention: read page ids from the graph tables in CUDA-graph capture/replay (page_size > 1) (#38187)
|
2026-10-01 14:42:22 -07:00 |
|
 
|
bf2d686a82
|
Add triton autotune on the Mamba2 SSD kernels (#39130)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-01 14:25:37 -07:00 |
|
 Jiajun LiandClaude Fable 5.1
|
dcf4e18283
|
fix(nccl): disable graph buffer registration for pausable graph pools (#40648)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-01 12:34:23 -07:00 |
|
 Shangming CaiandClaude Fable 5
|
a71c7d19e7
|
[Router] Document peer bootstrap: flags, RBAC, downward API, probe implications (#42049)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-10-02 02:20:36 +08:00 |
|
  
|
3f4bfda13c
|
[Bugfix] Fix DeepSeek V4 Pro TP24 vocabulary-padding failure on Hopper (#31801)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 11:11:18 -07:00 |
|
 
|
a0fcebb3bb
|
NIXL: Use stride desc API (#37827)
Signed-off-by: Ilia Yastrebov <iyastrebov@nvidia.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-10-01 10:53:00 -07:00 |
|
jain-ria
|
fb92ba1127
|
[Rust] Wire the gRPC server into the frontend lifecycle (#41964)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
|
2026-10-01 10:44:56 -07:00 |
|
 JoeandAlex Nails
|
f03a183719
|
Fix Kimi-K3 MLA output gate dispatch on non-CUDA devices (#36406)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-01 08:53:31 -07:00 |
|
 JoeandAlex Nails
|
3031091c36
|
[Kimi-K3] Guard optimized paths by platform (#40269)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-01 08:53:05 -07:00 |
|
Артем Савкин
|
1bbce57d9e
|
[NPU] [Diffusion] Fix NPU multimodal-gen CI (#41528)
|
2026-10-01 18:02:37 +03:00 |
|
   
|
41cbe65de0
|
[sgl-router] Enforce compatible PD version groups (#41613)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 20:24:20 +08:00 |
|
  
|
3b2ad1c6ae
|
[sgl-router] Fail fast and cancel decode when prefill fails (#41612)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 19:35:56 +08:00 |
|
 Aurick QiaoandAurick Qiao
|
1a0250c5b6
|
[Disagg] Validate state strides before Mooncake transfers (#41607)
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
|
2026-10-01 18:47:41 +08:00 |
|
 
|
d669efba84
|
[AMD][V4.1][*/N] Greedy dspark draft/accept under SGLANG_SIMULATE_ACC_LEN (#41981)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-01 03:35:28 -07:00 |
|
  
|
46637965ab
|
[sgl-router] Allow load-only routing without a tokenizer (#41611)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 18:30:35 +08:00 |
|
 
|
3c4e218779
|
[AMD][V4.1][*/N] OPUS sparse prefill on gfx950 through layout conversion (#42017)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: thomawan <thomawan@amd.com>
|
2026-10-01 03:21:25 -07:00 |
|
 kkandwunhuang
|
f45c004e18
|
[AMD][V4.1][*/N] Build DSpark draft metadata inside the CUDA graph on ROCm (#42014)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-01 02:17:13 -07:00 |
|
黄孝君
|
7be0e85658
|
[CI][NPU][Diffusion] Bump ascend consistency GT to the CANN 9.1.0 baseline (#41500)
|
2026-10-01 17:13:28 +08:00 |
|
Xinyi Song
|
73ba6513f4
|
[AMD][V4.1][*/N] Switch the fp8 dense GEMMs on gfx950 to aiter's MXFP8 GEMM (#41970)
|
2026-10-01 02:04:39 -07:00 |
|
Xinyi Song
|
0224fcbd1c
|
[AMD][V4.1][*/N] Route low-ratio indexer and candidate-block top-k through top-k v2 (#41947)
|
2026-10-01 01:56:31 -07:00 |
|
Cheng Wan
|
5fab1f0f51
|
[Fix] Let the aiter DCP ASM decode test run without aiter (#42018)
|
2026-10-01 16:55:15 +08:00 |
|
Thomas Wang
|
69240ba7d6
|
[AMD][V4.1][*/N] Pick the gfx950 wo_a batched gemm tile by row count (#41971)
|
2026-10-01 01:52:39 -07:00 |
|
Thomas Wang
|
ffb134188b
|
[AMD] Update aiter version for v41 (#42023)
|
2026-10-01 01:49:45 -07:00 |
|
Shunkangz
|
266d9d1fa7
|
[Qwen3.8 CP 1/4] Context parallelism for QSA attention and the sparse indexer (#39721)
|
2026-10-01 01:28:55 -07:00 |
|
 
|
b51d4a04f0
|
[DFlash] Keep grouped-conv taps inside each request's block so NaN/Inf cannot leak across requests (#41736)
Co-authored-by: Rahul Chalamala <22563365+rchalamala@users.noreply.github.com>
Co-authored-by: Devin AI <158243242+devin-ai-integration[bot]@users.noreply.github.com>
|
2026-10-01 00:18:37 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
42f2e4fcb7
|
[DSA] Stop forcing the per-step CPU seq_lens sync for the k-pool indexer (#41987)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-01 00:16:28 -07:00 |
|
DarkSharpness
|
3ed6367d3f
|
[DSV4/DSA] Name the FlashMLA KV format and drop the V4.1 support probe (#41337)
|
2026-10-01 00:02:18 -07:00 |
|
 
|
d010e50ad6
|
[PPU][1/N] CI: Add backend registration and runner preflight (#39788)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-01 00:01:17 -07:00 |
|
amd-danli103
|
9c3262d855
|
[AMD][DSV4] feat: enable PD-disagg with fp8 unified_kv on gfx950 (#39166)
|
2026-09-30 23:42:31 -07:00 |
|
   
|
315080a0de
|
[sgl-router] Exclude portless prefills and retry bootstrap discovery (#41610)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 14:32:14 +08:00 |
|
 Shangming CaiandClaude Fable 5
|
c78fa09290
|
[Router] Drop the snapshot client's redirect-following fallback (#42010)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-10-01 14:31:53 +08:00 |
|
Eric Zhang
|
947fee9384
|
[PD] Fix block scale registration for mixed full/SWA KV dtypes (#41924)
|
2026-10-01 14:25:04 +08:00 |
|
 Xiaoyu Zhangandkernel-design-agents
|
77b64e353f
|
[KDA+Kimi K3] Speed up LTX-2.3 QK norm and split RoPE on H200 (#41459)
Co-authored-by: kernel-design-agents <334018530+kernel-design-agents@users.noreply.github.com>
|
2026-10-01 14:21:31 +08:00 |
|
Peng Wu
|
11500701f1
|
[DSV4] Reserve the FULL logical page in the c4 indexer pool like its KV pool (#41163)
|
2026-09-30 23:19:27 -07:00 |
|
 Shangming CaiandClaude Fable 5
|
047be72a8c
|
[Router] Harden peer-bootstrap edges: refuse redirects and metric docs (#41999)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-10-01 14:15:42 +08:00 |
|
chien-an-chen
|
99c9d65b32
|
[AMD] AITER MLA DCP decode ASM path (opt-in) (#40750)
|
2026-09-30 22:47:55 -07:00 |
|
billishyahao
|
dc7defd294
|
[Kimi-K3][DCP][DSpark] fix eager mode nonetype crash due to no extend_prefix_lens (#38991)
|
2026-09-30 22:35:25 -07:00 |
|
ashwini rathi
|
86807b87dd
|
[XPU] Fix test_qsa_indexer_xpu after defer_expansion change (#41915)
|
2026-09-30 22:34:10 -07:00 |
|
Ke Bao
|
5733bcaad3
|
Declare HiCache host pools for DSA indexer (#40913)
|
2026-10-01 13:08:26 +08:00 |
|
  
|
f02828ea39
|
fix(dsv4): ship the fp8 unified_kv rope pool through the direct external linker (#40471)
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: billishyahao <bill.he@amd.com>
|
2026-09-30 21:46:56 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
40e1bb0f36
|
[Docs] Add NVIDIA NVFP4 checkpoint to GLM-5.3-Flash cookbook (#41986)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-01 12:15:30 +08:00 |
|