Cheng Wan
|
d41904f05e
|
[Refactor] Build seven more decoders from stage boundaries (#41779)
|
2026-09-29 21:16:45 -07:00 |
|
Cheng Wan
|
113e6a1496
|
[Refactor] Simplify layer boundary internals (#41778)
|
2026-09-29 21:15:58 -07:00 |
|
Wenfei (Charles) Qi
|
7fb85a9d88
|
[MLX] Fix startup after logical token capacity change (#41314)
|
2026-09-29 21:15:56 -07:00 |
|
Cheng Wan
|
9ee065e49a
|
[Fix] Step-3.5: build the shared expert without TP under all-to-all MoE backends (#41754)
|
2026-09-29 21:11:37 -07:00 |
|
Cheng Wan
|
faa5064f6e
|
[Refactor] Send producer-written residual streams through to_pp (#41753)
|
2026-09-29 21:11:02 -07:00 |
|
Cheng Wan
|
843f50f5c1
|
[Fix] Reduce the Sarvam dense MLP through its row-parallel projection (#41752)
|
2026-09-29 21:10:17 -07:00 |
|
Cheng Wan
|
ea855f0daf
|
[Refactor] Leave decoder stacks through final_norm(skip_empty=True) (#41751)
|
2026-09-29 21:08:19 -07:00 |
|
Cheng Wan
|
01b5f572b7
|
[Refactor] Rename layer boundary protocols, contracts and helpers (#41750)
|
2026-09-29 21:05:48 -07:00 |
|
   ![github-actions[bot]](/assets/img/avatar_default.png)
|
cb3ba2f2b7
|
[XPU] Add dynamic_expert_bias and track_state support (#39618)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
Co-authored-by: Singh <rohitsi2@iil-gnrap01.iind.intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-30 12:05:35 +08:00 |
|
 
|
fc9bdc8a3e
|
[MoE] Keep the moe_align_block_size pad fill inside sorted_token_ids (#41759)
Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: oulgen <oulgen@users.noreply.github.com>
|
2026-09-29 17:43:17 -07:00 |
|
Baizhou Zhang
|
e5cec303ae
|
[Fix] Restore deferred layer dumps and pin SentencePiece for InternVL (#41777)
|
2026-09-29 17:28:30 -07:00 |
|
sglang-bot
|
cae69be584
|
chore: bump sgl-kernel version to 0.4.8 (#41784)
|
2026-09-29 17:19:21 -07:00 |
|
DarkSharpness
|
57d4adeb83
|
[Kernel] Expose FlashMLA kv_format in sgl-kernel sparse decode (#41336)
|
2026-09-29 17:16:52 -07:00 |
|
Cheng Wan
|
8d2d874758
|
[Fix] Release consumed residual contributions (#41749)
|
2026-09-29 16:38:05 -07:00 |
|
 Jiajun LiandShi Dong
|
3d4953839c
|
[Fix] MoE: require TopK layer_id to ensure routed expert captures (#40980)
Co-authored-by: Shi Dong <hello@dongshi.me>
|
2026-09-29 16:29:27 -07:00 |
|
Jiajun Li
|
f0e4001930
|
[Fix] Allocate SWA KV pools inside the memory-saver region (#40979)
|
2026-09-29 16:29:02 -07:00 |
|
Yuwei An
|
d3f8a8f4f5
|
[Spec/Prefill Coordination] Dspark support (#41623)
|
2026-09-29 16:08:01 -07:00 |
|
Liangsheng Yin
|
211b1d9784
|
[Refactor] Share PD routing fields across request models (#41756)
|
2026-09-29 15:11:18 -07:00 |
|
  
|
37a47737c8
|
[Perf] Tune SM90 GDN recurrent verify launch for small batches (#41486)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-09-29 15:03:33 -07:00 |
|
 Mohammad Miadh Angkadandhnyls2002
|
4885b563c3
|
[Test] Demote PD test RDMA openability check to a warning (#41681)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-29 14:52:31 -07:00 |
|
 
|
84523d6785
|
[Spec] Reuse K3 auxiliary outputs across decode CUDA graph sizes (#40159)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-29 14:24:51 -07:00 |
|
 James LiuandClaude Opus 5.5
|
77a81996ce
|
[PD] Preserve bootstrap metadata in native Messages requests (#39711)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-29 13:32:54 -07:00 |
|
  
|
3c4653b6a3
|
[Metrics] Fix PD latency histogram accounting (#39706)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-09-29 13:12:09 -07:00 |
|
 
|
51ace48387
|
[Metrics] Add request-level TPOT histogram (sglang:request_time_per_output_token_seconds) (#40275)
Co-authored-by: Gilford Ting <gilford@modal.com>
Co-authored-by: Claude Fable 5.1 <noreply@anthropic.com>
|
2026-09-29 12:20:22 -07:00 |
|
ashwini rathi
|
bf80732b92
|
Fix pip install: exclude multimodal_gen/.claude symlink from package data (#41703)
|
2026-09-29 11:35:11 -07:00 |
|
 
|
8f2a9638f7
|
[metrics] Fix non-streaming TTFT by flushing the first output through detokenization (#38600)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-29 11:24:52 -07:00 |
|
Colin Z
|
875dd41e6f
|
[AMD] Fix Load and Inference of MLA models with Quark PTPC FP8 attention on ROCm (#28734)
|
2026-09-29 11:20:10 -07:00 |
|
 
|
ced5e9fe49
|
[Kimi] Enable GB300 TP4 and GB200/GB300 TP16 SP collectives (#35330)
Co-authored-by: Ajit Mistry <ajmistry@amistry.nvidia.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
|
2026-09-29 10:18:11 -07:00 |
|
CYJiang
|
fa090f7755
|
[MUSA] Fix fused MoE GEMV registration and torchada pin (#41444)
|
2026-09-29 09:51:08 -07:00 |
|
 Rumit DesaiandXiaoyu Zhang
|
f731e82f09
|
Fix MUSA detection under torch.compile fullgraph (#41065)
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
|
2026-09-29 17:26:27 +08:00 |
|
 Carrie ChenandBrayden Zhong
|
0e586fd12d
|
fuse shared experts with routed experts in MegaMoE's DeepGEMM (#39313)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
|
2026-09-29 17:25:10 +08:00 |
|
 
|
c9cb32e310
|
[AMD] fix kda decode flydsl import (#40546)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
|
2026-09-29 02:20:42 -07:00 |
|
Liang Gong
|
34a1234d21
|
chore: expose agent skills via .agents directories (#40515)
|
2026-09-29 17:12:28 +08:00 |
|
Jiacong Fang
|
bd78095030
|
[Fix] Add name mapping in load_weights of nvidia/LocateAnything-3B (#41059)
|
2026-09-29 00:38:58 -07:00 |
|
 MickandMick Qian
|
dc1bd46802
|
[diffusion] feat: support bounded exact conditioning cache across native models (#40470)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-29 15:27:22 +08:00 |
|
eeecho
|
c7be3e935b
|
[SM120] Add optional FlashInfer PCIe-IPC all-reduce for switch-free hosts (#34528)
|
2026-09-28 23:08:44 -07:00 |
|
 Anupa SajikumarandMa Mingfei
|
2ff52e3ceb
|
[Intel][XPU]Enable chunked prefill scnearios for XPU with UT (#33804)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-29 13:28:25 +08:00 |
|
   ![github-actions[bot]](/assets/img/avatar_default.png)
|
9ae43b0eee
|
[XPU] Support compressed-tensors W4A16 by reusing the torch int4pack path (#40828)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Singh <rohitsi2@iil-gnrap01.iind.intel.com>
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-29 13:16:03 +08:00 |
|
Cheng Wan
|
5781206833
|
[PD] Give FakeKVReceiver ensure_abort_notified (#41618)
|
2026-09-28 21:59:17 -07:00 |
|
Cheng Wan
|
6dad152490
|
[Refactor] Document layer boundary contracts and integration (#41557)
|
2026-09-28 20:18:27 -07:00 |
|
Cheng Wan
|
de9f850b36
|
[Refactor] Rename the module to layer_boundary (#41555)
|
2026-09-28 20:17:50 -07:00 |
|
Cheng Wan
|
701213c867
|
[Refactor] Retire the layer facade and simplify boundary internals (#41554)
|
2026-09-28 20:17:33 -07:00 |
|
Cheng Wan
|
9b89b96230
|
[Refactor] Migrate specialized decoder and overlap boundaries (#41553)
|
2026-09-28 20:17:17 -07:00 |
|
Cheng Wan
|
49b5e76e45
|
[Refactor] Construct independent decoder stage boundaries (#41552)
|
2026-09-28 20:17:00 -07:00 |
|
Cheng Wan
|
acffb0d20d
|
[Refactor] Select reduction fusion at the consumer (#41551)
|
2026-09-28 20:16:44 -07:00 |
|
Cheng Wan
|
cb1fa3c399
|
[Refactor] Capture auxiliary states at residual reads (#41550)
|
2026-09-28 20:16:26 -07:00 |
|
Cheng Wan
|
42f58b4da7
|
[Refactor] Carry residual state across stage boundaries (#41549)
|
2026-09-28 20:15:03 -07:00 |
|
Cheng Wan
|
6f72cc3b64
|
[Refactor] Centralize decoder output access (#41548)
|
2026-09-28 20:14:04 -07:00 |
|
Cheng Wan
|
0a8ca85565
|
[Refactor] Group communicator fusion and CP adapters (#41547)
|
2026-09-28 20:10:50 -07:00 |
|
Liangsheng Yin
|
d9074f7943
|
[Test] Fail fast when PD test RDMA devices are not openable by ibverbs (#41600)
|
2026-09-28 19:34:58 -07:00 |
|