 
|
fa66e7d816
|
[NPU] [Bugfix] Fix rope sin cos pre-calculation for Qwen3.5 during Pipeline Parallelism (#29753)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Артем Савкин <58187114+OrangeRedeng@users.noreply.github.com>
|
2026-10-15 09:58:47 +03:00 |
|
Dayuxiaoshui
|
a50c17e979
|
[diffusion] perf: fuse the Wan VAE conv bias epilogue and tile the RMSNorm+SiLU kernel (#38650)
|
2026-10-15 13:39:27 +08:00 |
|
   
|
676c038aa5
|
[diffusion] fix: fix the load duration missing from subclassed server tests (#40657)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2026-10-15 13:38:23 +08:00 |
|
Liangsheng Yin
|
f9bdb74a5a
|
[Fix] scheduler: Count a request's held req_to_token row once at admission (#44401)
|
2026-10-14 22:29:10 -07:00 |
|
Yuxingwang-intel
|
93842f52fe
|
[CPU]: Add group-aware CPU SHM collective kernels (#35435)
|
2026-10-15 13:22:20 +08:00 |
|
Michael
|
4dc9b5c68c
|
[Test] [AMD] diffusion: Expect CUDA-only fast paths to be off on ROCm in kernel tests (#44311)
|
2026-10-15 13:18:01 +08:00 |
|
   
|
1d809bbbbd
|
[Fix] DSv4.1: Size the encoder-replay SWA pool by the DSpark draft's stages, and keep more prefix tails (#43502)
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Po-Han Huang <pohanh@nvidia.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-10-14 22:04:58 -07:00 |
|
 kkandroot
|
e573d91275
|
[CI] tests: Fix stale fakes in the CP strategy and request-class override unit tests (#44380)
Co-authored-by: root <root@crsuse2-m2m-223.us-east2-a.compute.internal>
|
2026-10-14 21:35:20 -07:00 |
|
Liangsheng Yin
|
3b5ae4ea86
|
[Fix] scheduler: Drop finished requests from the running batch before every admission (#44351)
|
2026-10-14 20:40:05 -07:00 |
|
 
|
9d68ecce2e
|
[DeepSeek-V4.1] DeepSelect cluster top-k for long rows and bf16 index logits (#44051)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-15 09:00:19 +08:00 |
|
xiaofei-zheng
|
c5c4bbbd25
|
[Perf] [AMD] dsa: Run DSA prefill under breakable CUDA graphs on HIP (#43642)
|
2026-10-15 08:59:34 +08:00 |
|
Yuwei An
|
64a0a08f0a
|
[DSv4.1] Support TRT-LLM decoder bounded replay with BCG (#44326)
|
2026-10-14 17:39:52 -07:00 |
|
 YAMYandYuwei An
|
c891c5c7ca
|
[DSv4.1] Fold encoder-SWA replay into the extend forward (#43166)
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
|
2026-10-14 17:27:07 -07:00 |
|
Shuwen Wang
|
3c28614f12
|
[Fix] hicache: Defer query beliefs until the rank-synchronized hit drain (#43108)
|
2026-10-14 17:25:08 -07:00 |
|
 Aditya Singhandhnyls2002
|
a6a8c56015
|
[Fix] detokenizer router: Route by rid without tokenizer worker ipcs and broadcast logging config (#33715)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-14 17:20:21 -07:00 |
|
   
|
0536cec73d
|
[Feat] metrics: Expose multi-detokenizer router CPU usage (#43323)
Co-authored-by: raghul chandramouli <raghul@c1xind0180-0243.local>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-14 17:17:22 -07:00 |
|
 Junnan Liandhnyls2002
|
0f36c8015c
|
[Bug] Fix multi-tokenizer BatchEmbeddingOutput repack dropping fields (#31892)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-14 16:56:56 -07:00 |
|
 
|
209f8220d6
|
[Fix] sglang-server: Honour extra_key on the Rust frontend's /generate (#44207)
Co-authored-by: fei-xx <fei-xx@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:44:31 -07:00 |
|
  
|
e7d6a88bfc
|
[HiCache] Buffer-only L3 for an auxiliary SWA window; load back only missing window rows (#43932)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: houseroad <houseroad@users.noreply.github.com>
Co-authored-by: xiezhq-hermann <xiezhq-hermann@users.noreply.github.com>
|
2026-10-14 16:43:24 -07:00 |
|
 
|
aa8793f33b
|
[Rust] Serve scheduler metrics on the Rust frontend's /metrics (#43942)
Co-authored-by: hanminglu <hanminglu@users.noreply.github.com>
Co-authored-by: shodoco <shodoco@users.noreply.github.com>
|
2026-10-14 16:43:06 -07:00 |
|
 
|
2a9f6a25a7
|
[Core] Add subclass hooks for the generation request class and optimistic prefill eligibility (#44113)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: CuiCoco <CuiCoco@users.noreply.github.com>
|
2026-10-14 16:42:30 -07:00 |
|
 
|
5f2861bf59
|
[Perf] session: Cache multimodal prompt token counts across turns (#44112)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: joshuadeng <joshuadeng@users.noreply.github.com>
|
2026-10-14 16:41:34 -07:00 |
|
 FREETRUMPandhnyls2002
|
97d3150a6a
|
[Perf] Cache msgspec struct fields in the batch splitter (#43520)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-14 14:51:26 -07:00 |
|
  
|
4273814771
|
[Perf] detokenizer: Group return IPC sends by tokenizer worker (#44288)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-10-14 14:26:51 -07:00 |
|
 Charles Chenandalphabetc1
|
d3dc14eb38
|
[mem_cache][PD] Fix decode radix cache ownership and allow EAGLE/EAGLE3 with decode radix cache (#40857)
Co-authored-by: alphabetc1 <2508695655@qq.com>
|
2026-10-14 14:19:51 -07:00 |
|
Shuwen Wang
|
b67785153a
|
[Fix] glm5.2: Align HiSparse warmup backends and move test to nightly (#44303)
|
2026-10-15 01:28:03 +08:00 |
|
Yoray Zack
|
87ed1b9526
|
[4/N] elastic-ep: Scale at DP-attention replica granularity (#33728)
|
2026-10-15 01:17:01 +08:00 |
|
  
|
010776e94f
|
[KV events] Publish opaque LoRA block IDs and adapter names (#42817)
Co-authored-by: Kan Wu <kan.wu@radixark.ai>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-10-14 22:56:28 +08:00 |
|
triple-mu
|
5e90312eb1
|
[diffusion] perf: support bit-exact norm/bias fusions and channels_last decode for Qwen-Image 2.1(#41340)
|
2026-10-14 20:47:46 +08:00 |
|
Shuwen Wang
|
7b53a13401
|
[Fix] glm5.2: Align PD HiSparse prefill KV layout (#44256)
|
2026-10-14 20:40:28 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
3b72b70ef4
|
[CI] vlm: Pin baidu/Unlimited-OCR revision in test_unlimited_ocr_server (#44235)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 17:50:18 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
c82e8bd5fe
|
[Fix] DeepSeek-V4.1: Align paged indexer score rows for DeepSelect decode (#44210)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-14 17:31:19 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
6daae9c98e
|
[Perf] Bind scheduler CPUs to the GPU's NUMA node when memory policy is not permitted (#44023)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-14 00:01:32 -07:00 |
|
Michael
|
6f646563a2
|
[AMD] diffusion: expect the residual-gate fast path to be off on ROCm in test_modulate (#40660)
|
2026-10-13 23:34:31 -07:00 |
|
Ma Mingfei
|
68c18a5701
|
Revert "[XPU] Support Gemma-3 bidirectional image attention in XPUAttentionBackend" (#44216)
|
2026-10-14 14:27:46 +08:00 |
|
desmond-intel
|
b87d62e581
|
[XPU] Support Gemma-3 bidirectional image attention in XPUAttentionBackend (#39805)
|
2026-10-14 14:24:04 +08:00 |
|
Shunkangz
|
0d130f1915
|
[Qwen3.8 CP 4/4] Prefill context parallel E2E support of Qwen3.8 (#39724)
|
2026-10-13 23:19:46 -07:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
d5f80aa3c3
|
[Test] dsv4: Fix Hopper indexer replay test after DeepSelect decode (#41561) (#44193)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 13:15:35 +08:00 |
|
ANSHUMAN TRIPATHY
|
30bdd09aed
|
DSPARK enable for XPU (#33739)
|
2026-10-14 13:10:24 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
ff8d964cf5
|
[CI] glm5.2: Temporarily disable PD HiSparse+MTP B300 test (#44192)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-13 21:53:58 -07:00 |
|
 xinchen9andMa Mingfei
|
2428d0f531
|
[XPU] Use the shared fused decode-metadata kernel in the intel_xpu ba… (#42122)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-10-14 12:10:12 +08:00 |
|
 
|
16176278d0
|
[diffusion] perf: replay small Triton wrappers' launches per operand signature (#43859)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-14 11:18:19 +08:00 |
|
 Ziyi XuandClaude Opus 5.5
|
4f5fcbfef5
|
[JIT] Clean up kernel headers: move runtime helpers, add once.h (#41147)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-10-14 10:46:51 +08:00 |
|
 yuyu5333andClaude Code
|
b50fdeb0ef
|
[DeepSeek V4.1] Use DeepSelect for Hopper full top-k decode. (#41561)
Co-authored-by: Claude Code <noreply@anthropic.com>
|
2026-10-14 10:46:12 +08:00 |
|
 Ma MingfeiandMingxuZh
|
87beb3a052
|
[CPU] Temporarily disable subblock sparse attention test on Xeon CI (#43468)
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
|
2026-10-14 10:44:24 +08:00 |
|
 JinandXinyuan Tong
|
44b44774c3
|
[Bugfix] Keep rope_theta when --json-model-override-args overrides rope_scaling (#43067)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-10-14 10:16:35 +08:00 |
|
Baizhou Zhang
|
536d065370
|
[CP] Automatically enable BCG for supported prefill CP configurations (#44022)
|
2026-10-13 19:00:42 -07:00 |
|
 
|
b3991b53da
|
GLM5.2 DSA Indexer Fallback (#32947)
Co-authored-by: Shu Wang <shuw@login-hecate03.hecate.clusters.nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-13 16:27:33 -07:00 |
|
 HEJIAN SANGandClaude Opus 5.5
|
a832609b92
|
[Feature] Return output top logprobs as flat base64 arrays on request (#42890)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-13 15:58:31 -07:00 |
|
 
|
baa632b049
|
[Score] Send stacked GPU embedding overrides through a CUDA IPC pool (#39730)
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-13 15:46:50 -07:00 |
|