  
|
e7d6a88bfc
|
[HiCache] Buffer-only L3 for an auxiliary SWA window; load back only missing window rows (#43932)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: houseroad <houseroad@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-14 16:43:24 -07:00 |
|
 
|
aa8793f33b
|
[Rust] Serve scheduler metrics on the Rust frontend's /metrics (#43942)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:43:06 -07:00 |
|
 
|
2a9f6a25a7
|
[Core] Add subclass hooks for the generation request class and optimistic prefill eligibility (#44113)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: CuiCoco <CuiCoco@users.noreply.github.com>
|
2026-10-14 16:42:30 -07:00 |
|
 
|
5f2861bf59
|
[Perf] session: Cache multimodal prompt token counts across turns (#44112)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-14 16:41:34 -07:00 |
|
 
|
9732188a58
|
[Rust] Serve /weights_checker from the Rust frontend (#43926)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:41:10 -07:00 |
|
 FREETRUMPandhnyls2002
|
97d3150a6a
|
[Perf] Cache msgspec struct fields in the batch splitter (#43520)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-14 14:51:26 -07:00 |
|
  
|
4273814771
|
[Perf] detokenizer: Group return IPC sends by tokenizer worker (#44288)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-14 14:26:51 -07:00 |
|
 Charles Chenandalphabetc1
|
d3dc14eb38
|
[mem_cache][PD] Fix decode radix cache ownership and allow EAGLE/EAGLE3 with decode radix cache (#40857)
Co-authored-by: alphabetc1 <2508695655@qq.com>
|
2026-10-14 14:19:51 -07:00 |
|
Rain Jiang
|
12dc623102
|
[Chore] rust: Remove the sglang-renderer crate (#43451)
|
2026-10-14 11:43:37 -07:00 |
|
Shuwen Wang
|
b67785153a
|
[Fix] glm5.2: Align HiSparse warmup backends and move test to nightly (#44303)
|
2026-10-15 01:28:03 +08:00 |
|
Yoray Zack
|
87ed1b9526
|
[4/N] elastic-ep: Scale at DP-attention replica granularity (#33728)
|
2026-10-15 01:17:01 +08:00 |
|
  
|
c964d9ba20
|
[Feat] sgl-router: Separate LoRA block IDs from prompt lookup keys (#42818)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-15 00:50:19 +08:00 |
|
amote-i
|
3a9cae27ed
|
[Doc] [NPU] docs: Update NPU CANN version to 9.1.0 (#44177)
|
2026-10-15 00:27:18 +08:00 |
|
Michael
|
1737251730
|
[Test] [AMD] diffusion: Run the IPC all-to-all transport tests only on CUDA (#44096)
|
2026-10-14 23:04:23 +08:00 |
|
  
|
010776e94f
|
[KV events] Publish opaque LoRA block IDs and adapter names (#42817)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 22:56:28 +08:00 |
|
Xinyuan Tong
|
ed40c7fc66
|
[Doc] cookbook: add Ling-3.1-flash (#44301)
|
2026-10-14 22:40:01 +08:00 |
|
 Kan WuandClaude Opus 5.5
|
d2a436446c
|
[Feat] sgl-router: Fix cache-aware routing for MTP/EAGLE on hybrid (Mamba/KDA) models (#44252)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 21:21:01 +08:00 |
|
 
|
204644c2dc
|
[Fix] sglang-processor: Follow Python's OpenAI layer through #43027, #37577, #43006, #43026, #43005 (#44243)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 21:06:13 +08:00 |
|
triple-mu
|
5e90312eb1
|
[diffusion] perf: support bit-exact norm/bias fusions and channels_last decode for Qwen-Image 2.1(#41340)
|
2026-10-14 20:47:46 +08:00 |
|
Shuwen Wang
|
7b53a13401
|
[Fix] glm5.2: Align PD HiSparse prefill KV layout (#44256)
|
2026-10-14 20:40:28 +08:00 |
|
  
|
bab9c81fea
|
fix: FA4 paged-KV zero-size page-table registers on SM90 (#35757)
Co-authored-by: razorback16 <razorback16@users.noreply.github.com>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
|
2026-10-14 19:10:15 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
3b72b70ef4
|
[CI] vlm: Pin baidu/Unlimited-OCR revision in test_unlimited_ocr_server (#44235)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 17:50:18 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
c82e8bd5fe
|
[Fix] DeepSeek-V4.1: Align paged indexer score rows for DeepSelect decode (#44210)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-14 17:31:19 +08:00 |
|
 
|
df1a089cd3
|
[Spec] Fix DFLASH verify mask policy for wrapped attention backends (#43054)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-14 17:15:36 +08:00 |
|
 
|
817781b828
|
[Feat] sgl-router: Render Qwen3.8 (Max, 27B, Flash-Next) through sglang-processor (#43689)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 17:09:35 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
72730d6360
|
[Doc] cookbook: Mirror SA cluster NCCL_CUMEM_ENABLE in AgentX launches, fix GPU counts (#44228)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 16:07:40 +08:00 |
|
 
|
c54ba66cd4
|
[Perf] Enable native MXFP4 routing and CuTeDSL fusion for MiMo (#43639)
Co-authored-by: lianghougong <lianghouhong@xiaohongshu.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-14 15:39:44 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
6daae9c98e
|
[Perf] Bind scheduler CPUs to the GPU's NUMA node when memory policy is not permitted (#44023)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-14 00:01:32 -07:00 |
|
 
|
58f2c923ed
|
[Feat] sgl-router: skip engines at an admission cap in power-of-two; forward x-sglext headers (#44218)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>
|
2026-10-14 14:59:06 +08:00 |
|
 Kan WuandClaude Opus 5.5
|
53a24c448e
|
[Feat] sgl-router: Render Kimi-K3 through sglang-processor (#43608)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 23:40:18 -07:00 |
|
Michael
|
6f646563a2
|
[AMD] diffusion: expect the residual-gate fast path to be off on ROCm in test_modulate (#40660)
|
2026-10-13 23:34:31 -07:00 |
|
Ma Mingfei
|
68c18a5701
|
Revert "[XPU] Support Gemma-3 bidirectional image attention in XPUAttentionBackend" (#44216)
|
2026-10-14 14:27:46 +08:00 |
|
desmond-intel
|
b87d62e581
|
[XPU] Support Gemma-3 bidirectional image attention in XPUAttentionBackend (#39805)
|
2026-10-14 14:24:04 +08:00 |
|
Shunkangz
|
0d130f1915
|
[Qwen3.8 CP 4/4] Prefill context parallel E2E support of Qwen3.8 (#39724)
|
2026-10-13 23:19:46 -07:00 |
|
 
|
7ca4cbfcef
|
[Disagg] Return prompt routed experts from the PD prefill server (#44002)
Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-10-13 23:13:44 -07:00 |
|
 AndyLi429andAndyLi429
|
05bb5afb62
|
[NPU][Bugfix] use CANN libdevice for DSpark Markov sampling (#43849)
Co-authored-by: AndyLi429 <AndyLi429@noreply.gitcode.com>
|
2026-10-14 14:12:22 +08:00 |
|
Zhaoyi Li
|
e29eee18df
|
[AMD][DI][CI] nightly mi355x disagg: stage packed logs under RUNNER_TEMP, not /tmp (#43945)
|
2026-10-14 13:53:40 +08:00 |
|
 Kan WuandClaude Opus 5.5
|
4560da58ee
|
[sgl-router] Render GLM-5.3 and GLM-5.3-Flash through sglang-processor (#43625)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:19:44 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
d5f80aa3c3
|
[Test] dsv4: Fix Hopper indexer replay test after DeepSelect decode (#41561) (#44193)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:15:35 +08:00 |
|
ANSHUMAN TRIPATHY
|
30bdd09aed
|
DSPARK enable for XPU (#33739)
|
2026-10-14 13:10:24 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
721953c6f6
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches to InferenceX main (GLM-5.2 NVFP4 B300 agg TP4, Dynamo frontend counts) (#44065)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:03:51 +08:00 |
|
Khoa Pham
|
e00754bab1
|
[DSV4.1] Derive the late-layer DP geometry from the captured shape under the breakable prefill graph (#44144)
|
2026-10-13 21:54:35 -07:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
ff8d964cf5
|
[CI] glm5.2: Temporarily disable PD HiSparse+MTP B300 test (#44192)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-13 21:53:58 -07:00 |
|
 chenxb002andchenxiaobing
|
491d4ef178
|
[MLU][CI] Bootstrap MLU runner workflows (#41005)
Co-authored-by: chenxiaobing <chenxiaobing@cambricon.com>
|
2026-10-13 21:40:49 -07:00 |
|
 Chetan Kumar VermaandClaude Opus 5.5
|
2c1e85964e
|
[diffusion] cache-dit: respect CFG parallel for dual-transformer models (#43704)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-14 12:25:07 +08:00 |
|
 xinchen9andMa Mingfei
|
2428d0f531
|
[XPU] Use the shared fused decode-metadata kernel in the intel_xpu ba… (#42122)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-10-14 12:10:12 +08:00 |
|
 
|
16176278d0
|
[diffusion] perf: replay small Triton wrappers' launches per operand signature (#43859)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 11:18:19 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
4f751da975
|
[Agents] Add a rule to prefer sgl-eval for accuracy evals (#44040)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-13 20:17:04 -07:00 |
|
 
|
53fe21cdfd
|
[diffusion] perf: replace padded rows without a host sync for Z-Image (#44069)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 11:15:28 +08:00 |
|
 xiaofei-zhengandXiaoyu Zhang
|
7e226b1b71
|
[AMD] Use the preallocated EAGLE topk=1 draft chain on HIP (#43640)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-14 11:06:07 +08:00 |
|