Xiaoyu Zhang
|
1a2eb6c426
|
[Kernel] Use Cake softmax for qualified SM103 sampling workloads (#42004)
|
2026-10-02 23:06:43 +08:00 |
|
 
|
bb9a820f09
|
[diffusion] chore: make perf dump one writer per replica with no first-request NCCL setup (#41711)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 21:44:10 +08:00 |
|
Michael
|
2cd92d10b9
|
[AMD] Skip the AITER #6042/#5967 patches on gfx1250 (#42219)
|
2026-10-02 21:10:01 +08:00 |
|
 
|
edee4308bc
|
[sgl-router] Add OpenAI /v1/embeddings (#42191)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 20:18:24 +08:00 |
|
 
|
1330e437e1
|
[sgl-router] Add native /generate endpoint (#42147)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 20:09:04 +08:00 |
|
Michael
|
e020b389b6
|
[AMD][CI] Partition stage-b-test-1-gpu-small-amd-mi35x to stop the 30-min timeout (#41973)
|
2026-10-02 19:29:20 +08:00 |
|
 MickandMick Qian
|
0f71ec8656
|
[diffusion] UX: deduplicate SM120 FP8 fallback warnings across layers (#41542)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-02 19:25:15 +08:00 |
|
Michael
|
544e46c080
|
[AMD][CI] Fix VLM MMMU nightly max_tokens for CoT prompt (#41979)
|
2026-10-02 18:59:05 +08:00 |
|
 YAMYandPo-Han Huang
|
895525f062
|
[Mamba] Warm cache COW kernel before serving (#36266)
Signed-off-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-02 18:52:37 +08:00 |
|
Alex
|
1db33bc367
|
[PD][NIXL] Fix prepared dlists for KV entries of different lengths (DeepSeek-V4) (#42005)
|
2026-10-02 17:59:31 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
41bd213c5f
|
[Test] Add get_swa_key_page_size to the Q8KV8 sparse-prefill fake KV pool (#42211)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 16:00:15 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
d954c88a4f
|
[Fix] Update stale source-patch match in dumper comparator e2e test (#42179)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-02 00:37:37 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
e7d9c0299b
|
[Docs] Keep the last CUDA 12 image tag fixed during install version bumps (#42201)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-02 00:17:13 -07:00 |
|
 sglang-botandsglang-bot
|
d61a9c28ba
|
chore: bump docs install version to 0.5.21 (#42013)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-10-01 23:16:26 -07:00 |
|
Liangsheng Yin
|
50be533d09
|
[mem_cache] Rename cache_unfinished_req to checkpoint_req and count cache hits only when a request finishes (#41520)
|
2026-10-01 21:41:45 -07:00 |
|
 MingyiandMick Qian
|
b906cd3f45
|
doc: refresh README (#41967)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-02 12:11:33 +08:00 |
|
saatwiknagpal
|
bf8adf9602
|
[diffusion] fix: fix int32 offset overflow in SubBlock router kernels (#41965)
|
2026-10-02 11:22:53 +08:00 |
|
Khoa Pham
|
6be84e1b72
|
[Fix] Select the Marlin MoE runner for MiMo-V2 packed MXFP4 experts on SM90 (#42172)
|
2026-10-01 20:01:03 -07:00 |
|
Yuwei An
|
ef867fa40d
|
[Fix][DSV4.1] SWA page size with bounded replay (#42128)
|
2026-10-01 18:50:43 -07:00 |
|
 jiaryangandThomas Wang
|
58f0d250ec
|
[ROCm] Use the fused MLA absorb + RoPE + KV-write kernel for decode-sized forward modes only (#41533)
Co-authored-by: Thomas Wang <thomawan@amd.com>
|
2026-10-01 18:45:29 -07:00 |
|
 kkandwunhuang
|
29f6d408c0
|
[AMD][V4.1][*/N] Fix shared-expert fusion accuracy and speed up MoE routing on ROCm (#42011)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2026-10-01 18:19:06 -07:00 |
|
 Kedar PotdarandClaude Opus 5.5
|
8acd36b56b
|
[Docs] GLM-5.2 GB300 NVFP4: add env vars from InferenceX AgentX recipe (#42109)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-02 09:11:29 +08:00 |
|
Qiaolin Yu
|
67eab57057
|
[qwen 3.8 next] Fuse NEXTN verify and draft graph input preparation (#41175)
|
2026-10-01 17:17:34 -07:00 |
|
 caihuali95andCheng Wan
|
2a3655fea1
|
[unified-memory] Name the fused KV translate for what it computes (7/7) (#40331)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:14:03 -07:00 |
|
 
|
df530479c6
|
[unified-memory] Stride the KV translate kernel and route every translate through it (6/7) (#40330)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:12:14 -07:00 |
|
 
|
9855e9c6f8
|
[unified-memory] Remove the kernel-page multiplier plumbing (5/7) (#40329)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:11:25 -07:00 |
|
 
|
4c4e352a4b
|
[unified-memory] Mark the write loc physical and check it at every write door (4/7) (#40328)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:10:37 -07:00 |
|
 
|
cdadb1c79a
|
[unified-memory] Token-major dense views for the unified memory pool (3/7) (#38592)
Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:09:38 -07:00 |
|
 caihuali95andCheng Wan
|
5df52e6382
|
[unified-memory] Build paged KV views through one helper (2/7) (#40327)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:08:42 -07:00 |
|
 caihuali95andCheng Wan
|
d3dbb71e5a
|
[unified-memory] Derive KV row addresses from strides, not shapes (1/7) (#40326)
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
|
2026-10-01 17:07:47 -07:00 |
|
 shyeh25andBrayden Zhong
|
5423a4d885
|
[MegaMoE] Preserve W13 layout for ModelOpt NVFP4 experts (#39388)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-10-01 16:12:34 -07:00 |
|
       
|
f17f7705a5
|
[AMD] [GLM-5.3-Flash] Enable FP8 and MXFP4 serving on gfx950 (#39273)
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: long10024070 <long10024070@users.noreply.github.com>
Co-authored-by: Kevin Mi <45493463+kevin-mii@users.noreply.github.com>
Co-authored-by: Kevin Mi <mikevin920@yahoo.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: sunxxuns <126995791+sunxxuns@users.noreply.github.com>
Co-authored-by: Long Luong <long.luong2+personal@onemount.com>
|
2026-10-01 15:59:44 -07:00 |
|
 Jan Bernlöhrandjbernloehr
|
80bb3fb651
|
[Fix] Select the MXFP4 MoE runner for MiMo-V2 packed experts on SM100 (#41668)
Co-authored-by: jbernloehr <janbernloehr@users.noreply.github.com>
|
2026-10-01 15:33:30 -07:00 |
|
 Kan WuandKan Wu
|
a21dcbd320
|
[sgl-router] Support engines started with --api-key (--worker-api-key) (#41996)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-01 14:54:59 -07:00 |
|
 Kan WuandKan Wu
|
d7565215ec
|
[sgl-router] Route to a specific DP rank inside multi-rank workers (--dp-aware) (#41974)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
|
2026-10-01 14:50:59 -07:00 |
|
Martin Hua
|
52d5faed5b
|
[Bugfix] Llama4 local attention: read page ids from the graph tables in CUDA-graph capture/replay (page_size > 1) (#38187)
|
2026-10-01 14:42:22 -07:00 |
|
 
|
bf2d686a82
|
Add triton autotune on the Mamba2 SSD kernels (#39130)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-01 14:25:37 -07:00 |
|
 Jiajun LiandClaude Fable 5.1
|
dcf4e18283
|
fix(nccl): disable graph buffer registration for pausable graph pools (#40648)
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-01 12:34:23 -07:00 |
|
 Shangming CaiandClaude Fable 5
|
a71c7d19e7
|
[Router] Document peer bootstrap: flags, RBAC, downward API, probe implications (#42049)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-10-02 02:20:36 +08:00 |
|
  
|
3f4bfda13c
|
[Bugfix] Fix DeepSeek V4 Pro TP24 vocabulary-padding failure on Hopper (#31801)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-01 11:11:18 -07:00 |
|
 
|
a0fcebb3bb
|
NIXL: Use stride desc API (#37827)
Signed-off-by: Ilia Yastrebov <iyastrebov@nvidia.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-10-01 10:53:00 -07:00 |
|
jain-ria
|
fb92ba1127
|
[Rust] Wire the gRPC server into the frontend lifecycle (#41964)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
|
2026-10-01 10:44:56 -07:00 |
|
 JoeandAlex Nails
|
f03a183719
|
Fix Kimi-K3 MLA output gate dispatch on non-CUDA devices (#36406)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-01 08:53:31 -07:00 |
|
 JoeandAlex Nails
|
3031091c36
|
[Kimi-K3] Guard optimized paths by platform (#40269)
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-10-01 08:53:05 -07:00 |
|
Артем Савкин
|
1bbce57d9e
|
[NPU] [Diffusion] Fix NPU multimodal-gen CI (#41528)
|
2026-10-01 18:02:37 +03:00 |
|
   
|
41cbe65de0
|
[sgl-router] Enforce compatible PD version groups (#41613)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kan Wu <kan.wu@MacBook-Pro.local>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 20:24:20 +08:00 |
|
  
|
3b2ad1c6ae
|
[sgl-router] Fail fast and cancel decode when prefill fails (#41612)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 19:35:56 +08:00 |
|
 Aurick QiaoandAurick Qiao
|
1a0250c5b6
|
[Disagg] Validate state strides before Mooncake transfers (#41607)
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
|
2026-10-01 18:47:41 +08:00 |
|
 
|
d669efba84
|
[AMD][V4.1][*/N] Greedy dspark draft/accept under SGLANG_SIMULATE_ACC_LEN (#41981)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-01 03:35:28 -07:00 |
|
  
|
46637965ab
|
[sgl-router] Allow load-only routing without a tokenizer (#41611)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-01 18:30:35 +08:00 |
|