Commit Graph
20367 Commits
Author SHA1 Message Date
Charles Chenandalphabetc1 d3dc14eb38 [mem_cache][PD] Fix decode radix cache ownership and allow EAGLE/EAGLE3 with decode radix cache (#40857)
Co-authored-by: alphabetc1 <2508695655@qq.com>
2026-10-14 14:19:51 -07:00
Rain Jiang 12dc623102 [Chore] rust: Remove the sglang-renderer crate (#43451) 2026-10-14 11:43:37 -07:00
Shuwen Wang b67785153a [Fix] glm5.2: Align HiSparse warmup backends and move test to nightly (#44303) 2026-10-15 01:28:03 +08:00
Yoray Zack 87ed1b9526 [4/N] elastic-ep: Scale at DP-attention replica granularity (#33728) 2026-10-15 01:17:01 +08:00
c964d9ba20 [Feat] sgl-router: Separate LoRA block IDs from prompt lookup keys (#42818)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-15 00:50:19 +08:00
amote-i 3a9cae27ed [Doc] [NPU] docs: Update NPU CANN version to 9.1.0 (#44177) 2026-10-15 00:27:18 +08:00
Michael 1737251730 [Test] [AMD] diffusion: Run the IPC all-to-all transport tests only on CUDA (#44096) 2026-10-14 23:04:23 +08:00
010776e94f [KV events] Publish opaque LoRA block IDs and adapter names (#42817)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-14 22:56:28 +08:00
Xinyuan Tong ed40c7fc66 [Doc] cookbook: add Ling-3.1-flash (#44301) 2026-10-14 22:40:01 +08:00
Kan WuandClaude Opus 5.5 d2a436446c [Feat] sgl-router: Fix cache-aware routing for MTP/EAGLE on hybrid (Mamba/KDA) models (#44252)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 21:21:01 +08:00
204644c2dc [Fix] sglang-processor: Follow Python's OpenAI layer through #43027, #37577, #43006, #43026, #43005 (#44243)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-14 21:06:13 +08:00
triple-mu 5e90312eb1 [diffusion] perf: support bit-exact norm/bias fusions and channels_last decode for Qwen-Image 2.1(#41340) 2026-10-14 20:47:46 +08:00
Shuwen Wang 7b53a13401 [Fix] glm5.2: Align PD HiSparse prefill KV layout (#44256) 2026-10-14 20:40:28 +08:00
bab9c81fea fix: FA4 paged-KV zero-size page-table registers on SM90 (#35757)
Co-authored-by: razorback16 <razorback16@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
2026-10-14 19:10:15 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 3b72b70ef4 [CI] vlm: Pin baidu/Unlimited-OCR revision in test_unlimited_ocr_server (#44235)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 17:50:18 +08:00
Mohammad Miadh AngkadandMohammad Angkad c82e8bd5fe [Fix] DeepSeek-V4.1: Align paged indexer score rows for DeepSelect decode (#44210)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-14 17:31:19 +08:00
df1a089cd3 [Spec] Fix DFLASH verify mask policy for wrapped attention backends (#43054)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
2026-10-14 17:15:36 +08:00
817781b828 [Feat] sgl-router: Render Qwen3.8 (Max, 27B, Flash-Next) through sglang-processor (#43689)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-10-14 17:09:35 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 72730d6360 [Doc] cookbook: Mirror SA cluster NCCL_CUMEM_ENABLE in AgentX launches, fix GPU counts (#44228)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 16:07:40 +08:00
c54ba66cd4 [Perf] Enable native MXFP4 routing and CuTeDSL fusion for MiMo (#43639)
Co-authored-by: lianghougong <lianghouhong@xiaohongshu.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-14 15:39:44 +08:00
Mohammad Miadh AngkadandMohammad Angkad 6daae9c98e [Perf] Bind scheduler CPUs to the GPU's NUMA node when memory policy is not permitted (#44023)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-14 00:01:32 -07:00
58f2c923ed [Feat] sgl-router: skip engines at an admission cap in power-of-two; forward x-sglext headers (#44218)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>
2026-10-14 14:59:06 +08:00
Kan WuandClaude Opus 5.5 53a24c448e [Feat] sgl-router: Render Kimi-K3 through sglang-processor (#43608)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-13 23:40:18 -07:00
Michael 6f646563a2 [AMD] diffusion: expect the residual-gate fast path to be off on ROCm in test_modulate (#40660) 2026-10-13 23:34:31 -07:00
Ma Mingfei 68c18a5701 Revert "[XPU] Support Gemma-3 bidirectional image attention in XPUAttentionBackend" (#44216) 2026-10-14 14:27:46 +08:00
desmond-intel b87d62e581 [XPU] Support Gemma-3 bidirectional image attention in XPUAttentionBackend (#39805) 2026-10-14 14:24:04 +08:00
Shunkangz 0d130f1915 [Qwen3.8 CP 4/4] Prefill context parallel E2E support of Qwen3.8 (#39724) 2026-10-13 23:19:46 -07:00
7ca4cbfcef [Disagg] Return prompt routed experts from the PD prefill server (#44002)
Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-10-13 23:13:44 -07:00
AndyLi429andAndyLi429 05bb5afb62 [NPU][Bugfix] use CANN libdevice for DSpark Markov sampling (#43849)
Co-authored-by: AndyLi429 <AndyLi429@noreply.gitcode.com>
2026-10-14 14:12:22 +08:00
Zhaoyi Li e29eee18df [AMD][DI][CI] nightly mi355x disagg: stage packed logs under RUNNER_TEMP, not /tmp (#43945) 2026-10-14 13:53:40 +08:00
Kan WuandClaude Opus 5.5 4560da58ee [sgl-router] Render GLM-5.3 and GLM-5.3-Flash through sglang-processor (#43625)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 13:19:44 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 d5f80aa3c3 [Test] dsv4: Fix Hopper indexer replay test after DeepSelect decode (#41561) (#44193)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 13:15:35 +08:00
ANSHUMAN TRIPATHY 30bdd09aed DSPARK enable for XPU (#33739) 2026-10-14 13:10:24 +08:00
Po-Han Huang (NVIDIA)andClaude Opus 5.5 721953c6f6 [Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main (GLM-5.2 NVFP4 B300 agg TP4, Dynamo frontend counts) (#44065)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 13:03:51 +08:00
Khoa Pham e00754bab1 [DSV4.1] Derive the late-layer DP geometry from the captured shape under the breakable prefill graph (#44144) 2026-10-13 21:54:35 -07:00
Mohammad Miadh AngkadandMohammad Angkad ff8d964cf5 [CI] glm5.2: Temporarily disable PD HiSparse+MTP B300 test (#44192)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-13 21:53:58 -07:00
chenxb002andchenxiaobing 491d4ef178 [MLU][CI] Bootstrap MLU runner workflows (#41005)
Co-authored-by: chenxiaobing <chenxiaobing@cambricon.com>
2026-10-13 21:40:49 -07:00
Chetan Kumar VermaandClaude Opus 5.5 2c1e85964e [diffusion] cache-dit: respect CFG parallel for dual-transformer models (#43704)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-14 12:25:07 +08:00
xinchen9andMa Mingfei 2428d0f531 [XPU] Use the shared fused decode-metadata kernel in the intel_xpu ba… (#42122)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-10-14 12:10:12 +08:00
16176278d0 [diffusion] perf: replay small Triton wrappers' launches per operand signature (#43859)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 11:18:19 +08:00
Mohammad Miadh AngkadandMohammad Angkad 4f751da975 [Agents] Add a rule to prefer sgl-eval for accuracy evals (#44040)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-13 20:17:04 -07:00
53fe21cdfd [diffusion] perf: replace padded rows without a host sync for Z-Image (#44069)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-14 11:15:28 +08:00
xiaofei-zhengandXiaoyu Zhang 7e226b1b71 [AMD] Use the preallocated EAGLE topk=1 draft chain on HIP (#43640)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-14 11:06:07 +08:00
5efb7384c1 [diffusion] comfyui: consolidate 6 unrelated plugin fixes (#43493)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: niehen6174 <1639206518@qq.com>
2026-10-14 10:56:09 +08:00
Cheng Wan c053fc71d3 [CI] pr-title: Validate pull request title format (#44165) 2026-10-13 19:53:52 -07:00
Ziyi XuandClaude Opus 5.5 4f5fcbfef5 [JIT] Clean up kernel headers: move runtime helpers, add once.h (#41147)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-10-14 10:46:51 +08:00
yuyu5333andClaude Code b50fdeb0ef [DeepSeek V4.1] Use DeepSelect for Hopper full top-k decode. (#41561)
Co-authored-by: Claude Code <noreply@anthropic.com>
2026-10-14 10:46:12 +08:00
Ma MingfeiandMingxuZh 87beb3a052 [CPU] Temporarily disable subblock sparse attention test on Xeon CI (#43468)
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
2026-10-14 10:44:24 +08:00
13a6dee99b [Fix] moe_sum_reduce: gate the bf16 vectorized path on hidden % 16 (#42837)
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
2026-10-14 10:32:50 +08:00
Mohammad Miadh AngkadandMohammad Angkad 7f0434e4af [GLM-5.3-Flash] Drop the NextN layer from the KDA state pool (#44098)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
2026-10-13 19:31:02 -07:00