 lixiufei-leoandXiufei Li
|
4ef9765e76
|
[Feat] sgl-router: Add --pd-stream-after-prefill (#45102)
Co-authored-by: Xiufei Li <294029388+lixiufei-leo@users.noreply.github.com>
|
2026-10-20 01:13:25 +08:00 |
|
chenyang08056032
|
716c9151f2
|
[CI] [NPU] npu-coverage: run only coverage-recommended tests on PRs (precise test selection) (#44019)
|
2026-10-20 00:57:27 +08:00 |
|
 Jan SchalkampandXiaoyu Zhang
|
8e7601ae4a
|
[Feat] paged-experts: Serve MoE models whose weights do not fit VRAM (#42557)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-19 23:10:04 +08:00 |
|
Monishver
|
806e7423af
|
[Perf] deepseek_v4: size the masked silu-mul-quant grid to the GPU, not the padded capacity (#44618)
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
|
2026-10-19 23:07:12 +08:00 |
|
Avaya Aggarwal
|
c04f9a61f0
|
[Fix] diffusion: Fix VMoBA chunk selection bugs (#44286)
|
2026-10-19 23:04:26 +08:00 |
|
 Siliang ChenandCursor
|
7c4cc5a51c
|
[Perf] [AMD] attention: Spread uneven Triton decode batches across XCDs (#41229)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-10-19 23:03:27 +08:00 |
|
Sam Shleifer
|
96ba108072
|
[Fix] dsa-eagle-topk: Copy token keys and scales when relocating index cache (#44564)
|
2026-10-19 22:54:08 +08:00 |
|
Sam Shleifer
|
417606527d
|
[Fix] nvfp4: Own streamed tensors while waiting for paired weights (#44500)
|
2026-10-19 22:41:53 +08:00 |
|
pllimax
|
8c4680cb65
|
[CI] npu: Move llada2-mini FDFO test to full test (#45153)
|
2026-10-19 22:29:30 +08:00 |
|
 lixiufei-leoandXiufei Li
|
62cee1b15c
|
[Fix] sgl-router: Keep the kv-indexer connection through bursts of cancelled prefix queries (#45100)
Co-authored-by: Xiufei Li <294029388+lixiufei-leo@users.noreply.github.com>
|
2026-10-19 21:41:03 +08:00 |
|
zhaozx-cn
|
ed0b8f433f
|
[Fix] [NPU] kimi-k3: skip fused gmm1 for situ activation in Ascend runner (#43837)
|
2026-10-19 19:30:41 +08:00 |
|
Shangming Cai
|
0025f93944
|
[Fix] sgl-router: Refuse prefill workers that cannot compute before bootstrap under --decode-dispatch-limit (#45120)
|
2026-10-19 18:24:17 +08:00 |
|
 Quanli Liand全力
|
e45cbce599
|
[Fix] diffusion: Prevent int32 overflow in Qwen-Image-2.1-Turbo VAE RMSNorm (#45118)
Co-authored-by: 全力 <liquanli.lql@antgroup.com>
|
2026-10-19 18:01:02 +08:00 |
|
 Niko Maandinkcherry
|
a90e9c5dd8
|
[Fix] [AMD] mhc: Bound the Triton fused post+pre buffer cache (#44443)
Co-authored-by: inkcherry <mingzhi.liu@amd.com>
|
2026-10-19 01:37:50 -07:00 |
|
 
|
8111841103
|
[Perf] deepseek-v4.1: Replay the breakable prefill CUDA graph at any context length (#43733)
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-10-19 01:29:14 -07:00 |
|
  
|
33dd8f6a2e
|
[Fix] hybrid-SSM: DP attention failures at low concurrency (#34535)
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-10-19 16:24:41 +08:00 |
|
Thomas Wang
|
5d9c956f8e
|
[Doc] [AMD] dsv4: Update amd cookbook 1016 (#45070)
|
2026-10-19 16:11:11 +08:00 |
|
 Po-Han Huang (NVIDIA)andClaude Opus 5.5
|
af9bb2a32d
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches with twelve open InferenceX PRs (#45111)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 15:24:08 +08:00 |
|
Bingxu Chen
|
3d588779e1
|
[CI] [AMD] test: Run UMBP HiCache E2E through standalone DRAM server (#40674)
|
2026-10-19 00:23:52 -07:00 |
|
AMD-yanfeiwang
|
f86a04a331
|
[Feat] sgl-router: Add --decode-dispatch-limit to pick decode DP ranks near KV arrival (#44402)
|
2026-10-19 15:11:40 +08:00 |
|
 
|
a5117beb11
|
[Perf] mhc: Parallelize small-batch post across hidden tiles (#44906)
Co-authored-by: leonardHONG <178642616+leonardHONG@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-19 15:07:13 +08:00 |
|
 ashwini rathiandClaude Opus 5.5
|
b6d3b7e163
|
[CI] [Intel] xpu: Disable L0 copy offload to fix first-H2D-copy hang (#45013)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 14:48:45 +08:00 |
|
 
|
97857f9f96
|
[Doc] cookbook: GB300 full-set accuracy and tool follow-up output for Ling-3.1-flash (#44307)
Co-authored-by: andyluo7 <andy.luo@amd.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-10-18 23:29:09 -07:00 |
|
desmond-intel
|
dc81f17b90
|
[Fix] [XPU] gemma3: Enable bidirectional image attention (#44225)
|
2026-10-19 14:08:24 +08:00 |
|
Liangsheng Yin
|
a3330237db
|
[Perf] deepseek-v4.1: Run decoder replay tail layers from CUDA graphs on eager prefill steps (#45059)
|
2026-10-18 23:07:50 -07:00 |
|
Trevor Morris
|
04c8c9703f
|
[Fix] docker: Install numactl in runtime images - needed for SGLANG_NUMA_BIND_V2 (#43883)
|
2026-10-18 22:55:58 -07:00 |
|
   
|
7c9a78efbe
|
[Feat] nemotron: Port Nemotron 3.5 Super serving changes (#44518)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Jimmy Shong <jimmy.shong@mac.attlocal.net>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-10-19 13:27:22 +08:00 |
|
Ziru
|
f726461287
|
[Feat] [CPU] model: Support LTX and MOVA models on CPU (#36632)
|
2026-10-19 13:25:13 +08:00 |
|
 ZiruandNiu Ziru
|
9a93a17c08
|
[Feat] [CPU] model: Support Muse models on CPU (#44624)
Co-authored-by: Niu Ziru <niuziru@gnr799217.jf.intel.com>
|
2026-10-19 13:12:32 +08:00 |
|
 MickandMick Qian
|
2b75048e2a
|
[CI] diffusion: tighten H100 baselines and enable B200 performance checks (#44996)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-10-19 12:54:54 +08:00 |
|
Avaya Aggarwal
|
58ad0748a6
|
[Fix] diffusion: Unmerge LoRA layers the next adapter does not cover (#44770)
|
2026-10-19 12:33:40 +08:00 |
|
 Xinyuan Tongand文贤
|
266550048a
|
[Fix] bailing: MoE gate dtype follows config.router_dtype (#44715)
Co-authored-by: 文贤 <luoyuan.luo@antgroup.com>
|
2026-10-19 12:21:29 +08:00 |
|
Liangsheng Yin
|
82c9a8b037
|
[Perf] deepseek-v4.1: Default PD to MegaAttention, with the KV layout in the PD handshake (#45075)
|
2026-10-18 21:16:45 -07:00 |
|
Yuwei An
|
834bfe4ef0
|
[Fix] attention: Opt FlashMLA scheduler into dynamic shared memory (#44580)
|
2026-10-18 20:31:39 -07:00 |
|
Duyi-Wang
|
8d3eee46a7
|
[Perf] [AMD] deepseek-v4: Skip top-k refinement for proven positive-zero ties (#44927)
|
2026-10-19 11:27:47 +08:00 |
|
  
|
06342acad2
|
[Perf] deepseek-v4.1: Stage late-layer DP row counts through pinned memory (#45062)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-10-18 20:19:26 -07:00 |
|
 
|
f02458fff1
|
[Fix] [CPU] memory: Honor cgroup memory.max when sizing CPU memory (#40066)
Co-authored-by: Zhang, Mingxu <mingxu.zhang@intel.com>
Co-authored-by: MingxuZh <109504044+MingxuZh@users.noreply.github.com>
|
2026-10-19 11:11:44 +08:00 |
|
Alexandr
|
617c8b67b1
|
[Fix] Z-Image: Synchronize device after warmup request (#44306)
|
2026-10-19 05:36:16 +03:00 |
|
 Ankur SinghandClaude Opus 5.5
|
7b1710324c
|
[Doc] cookbook: Refresh SemiAnalysis AgentX launches for Qwen3.8-Flash-Next H200 (v0.5.22, TP2 points) (#45039)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Force merge to unblock SA AgentX submission
|
2026-10-19 10:31:51 +08:00 |
|
Kotthagattu Meher Sai
|
7f96dc6874
|
[Perf] [XPU] server_args: Enable fused QK-norm + RoPE by default (#43345)
|
2026-10-19 10:19:52 +08:00 |
|
 
|
642f43ce59
|
[Fix] diffusion: size the in-context slot from both input grids for wan-animate-2(#44090)
Co-authored-by: Ankit Dhall <8938083+ankitdhall@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-10-19 10:11:58 +08:00 |
|
Khoa Pham
|
a7fd2e1158
|
[Feat] dsv4.1: Return prompt logprobs under encoder SWA bounded replay (#45050)
|
2026-10-18 19:08:20 -07:00 |
|
 Wuhen DuanandEven Zhou
|
69076b9f9e
|
[CI] [NPU] tests: Reduce HiCache sizes and enable expandable pinned memory in focused tests (#41675)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2026-10-19 10:06:35 +08:00 |
|
  
|
fea48754de
|
[Feat] rust/grpc: Add ListModels, Detokenize, and Abort to api.v1 (#42118)
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
|
2026-10-19 09:53:56 +08:00 |
|
 Mohammad Miadh AngkadandMohammad Angkad
|
377cd867fd
|
[Perf] dsa: Route the k-pool indexer top-k through the top-k v2 kernel (#43775)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
|
2026-10-19 09:49:39 +08:00 |
|
Yuwei An
|
df078cc729
|
[Fix] DSv4.1: Support CUDA image requests with encoder bounded replay and CI Test (#45048)
|
2026-10-18 18:47:17 -07:00 |
|
 Emre AlbayrakandXiaoyu Zhang
|
10ec53ac2f
|
[Perf] [NVIDIA] fp8_fa_sm120: Use the block-scaled MMA encoding (#43390)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-10-19 09:36:21 +08:00 |
|
Jimmy Shong
|
0dc6de2e74
|
[Doc] nemotron-3.5-super: update H200 and Spark wizard recipes (#44587)
|
2026-10-18 18:22:05 -07:00 |
|
A&W
|
cff88d6eac
|
[Fix] diffusion: Invalidate merged LoRA cache after adapter rewrites (#44204)
|
2026-10-19 01:08:57 +00:00 |
|
Liangsheng Yin
|
299da60131
|
[CI] test-utils: Abort the test run when its server dies inside a CustomTestCase method (#45053)
|
2026-10-18 18:00:06 -07:00 |
|