DarkSharpness
|
5d52cccbee
|
[DSv4.1] Faster fp4 index-K gather and combine_topk_swa_indices (#41658)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
(cherry picked from commit d75d5b33f7)
|
2026-10-19 10:14:28 +08:00 |
|
minke.yu
|
74d03143e2
|
PR #41098: H20 block-FP8 tuned GEMM configs
Source: https://github.com/sgl-project/sglang/pull/41098 (applied via GitHub .diff, 3way)
|
2026-10-19 10:13:59 +08:00 |
|
Xiaoyu Zhang
|
2b192aade6
|
[Perf] Optimize DeepSeek V4.1 Flash Hopper paths and Blackwell prefill selection (#41251)
(cherry picked from commit 391e665dab)
|
2026-10-19 10:13:35 +08:00 |
|
minke.yu
|
9247c97919
|
PR #40919: fix dspark folded result buffer reuse race
Source: https://github.com/sgl-project/sglang/pull/40919 (applied via GitHub .diff, 3way)
|
2026-10-19 10:12:23 +08:00 |
|
minke.yu
|
5e7190b87a
|
PR #40758: escape literal DSV4.1 image placeholder in user text
Source: https://github.com/sgl-project/sglang/pull/40758 (applied via GitHub .diff, 3way)
|
2026-10-19 10:12:16 +08:00 |
|
 
|
e00930c548
|
[Cherry-pick to release/v0.5.21] [Test] Demote PD test RDMA openability check to a warning (#41681) (#41802)
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-09-29 19:44:12 -07:00 |
|
 Kangyan-ZhouandBaizhou Zhang
|
d7ff74b984
|
[Cherry-pick to release/v0.5.21] [Fix] Restore deferred layer dumps and pin SentencePiece for InternVL (#41777) (#41788)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-09-29 17:30:38 -07:00 |
|
Jiacong Fang
|
bd78095030
|
[Fix] Add name mapping in load_weights of nvidia/LocateAnything-3B (#41059)
|
2026-09-29 00:38:58 -07:00 |
|
 MickandMick Qian
|
dc1bd46802
|
[diffusion] feat: support bounded exact conditioning cache across native models (#40470)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-29 15:27:22 +08:00 |
|
eeecho
|
c7be3e935b
|
[SM120] Add optional FlashInfer PCIe-IPC all-reduce for switch-free hosts (#34528)
|
2026-09-28 23:08:44 -07:00 |
|
 Anupa SajikumarandMa Mingfei
|
2ff52e3ceb
|
[Intel][XPU]Enable chunked prefill scnearios for XPU with UT (#33804)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-29 13:28:25 +08:00 |
|
   ![github-actions[bot]](/assets/img/avatar_default.png)
|
9ae43b0eee
|
[XPU] Support compressed-tensors W4A16 by reusing the torch int4pack path (#40828)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Singh <rohitsi2@iil-gnrap01.iind.intel.com>
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
|
2026-09-29 13:16:03 +08:00 |
|
Cheng Wan
|
5781206833
|
[PD] Give FakeKVReceiver ensure_abort_notified (#41618)
|
2026-09-28 21:59:17 -07:00 |
|
Cheng Wan
|
6dad152490
|
[Refactor] Document layer boundary contracts and integration (#41557)
|
2026-09-28 20:18:27 -07:00 |
|
Cheng Wan
|
de9f850b36
|
[Refactor] Rename the module to layer_boundary (#41555)
|
2026-09-28 20:17:50 -07:00 |
|
Cheng Wan
|
701213c867
|
[Refactor] Retire the layer facade and simplify boundary internals (#41554)
|
2026-09-28 20:17:33 -07:00 |
|
Cheng Wan
|
9b89b96230
|
[Refactor] Migrate specialized decoder and overlap boundaries (#41553)
|
2026-09-28 20:17:17 -07:00 |
|
Cheng Wan
|
49b5e76e45
|
[Refactor] Construct independent decoder stage boundaries (#41552)
|
2026-09-28 20:17:00 -07:00 |
|
Cheng Wan
|
acffb0d20d
|
[Refactor] Select reduction fusion at the consumer (#41551)
|
2026-09-28 20:16:44 -07:00 |
|
Cheng Wan
|
cb1fa3c399
|
[Refactor] Capture auxiliary states at residual reads (#41550)
|
2026-09-28 20:16:26 -07:00 |
|
Cheng Wan
|
42f58b4da7
|
[Refactor] Carry residual state across stage boundaries (#41549)
|
2026-09-28 20:15:03 -07:00 |
|
Cheng Wan
|
6f72cc3b64
|
[Refactor] Centralize decoder output access (#41548)
|
2026-09-28 20:14:04 -07:00 |
|
Cheng Wan
|
0a8ca85565
|
[Refactor] Group communicator fusion and CP adapters (#41547)
|
2026-09-28 20:10:50 -07:00 |
|
Liangsheng Yin
|
d9074f7943
|
[Test] Fail fast when PD test RDMA devices are not openable by ibverbs (#41600)
|
2026-09-28 19:34:58 -07:00 |
|
James
|
6e1df69623
|
[npu]support NPU 910C L2 memcache offload (#41527)
|
2026-09-29 10:30:01 +08:00 |
|
  
|
77091cea68
|
[Radix Cache] Sync Rust TreeCore and make it the default (#39627)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com>
|
2026-09-29 10:18:57 +08:00 |
|
WenhaoZhang
|
49d26ff0c2
|
[diffusion] model: support flux 3 action robot policies (#41066)
|
2026-09-29 10:17:19 +08:00 |
|
   
|
79cafec013
|
[Model] Add IQuest Q1 support and MTP draft (#41590)
Co-authored-by: zelong huang <yzhu@ubiquant.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: zelong518 <zelonghuang05@gmail.com>
Co-authored-by: chenwenxiaolive <cocoshirolive@gmail.com>
|
2026-09-28 17:21:31 -07:00 |
|
  
|
7889fbab9a
|
[PD] Keep EAGLE DP graph and token metadata consistent (#32196)
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
|
2026-09-28 17:15:51 -07:00 |
|
Shuwen Wang
|
89e1316eae
|
[mem cache] refactor: remove the index-K continuous getters orphaned by the CP v1 removal (#41469)
|
2026-09-28 16:41:07 -07:00 |
|
 Hrithvik AlexandHrithvik Alex
|
f124c5ceec
|
[Model Loader] Stop checkpoint prefetch after iterator completion (#41588)
Co-authored-by: Hrithvik Alex <hrithvik@baseten.co>
|
2026-09-28 16:27:09 -07:00 |
|
 
|
9654e5c4bc
|
dsv4.1-amd: fused mHC boundary and all-reduce + mHC post kernels (#41021)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
|
2026-09-28 16:15:08 -07:00 |
|
 Kevin MiandClaude Opus 5.5
|
096b066fb4
|
dsv4.1-amd: gfx950 sparse decode attention and sorted top-k (#41020)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
|
2026-09-28 16:14:28 -07:00 |
|
Nan Jiang
|
6fa3fe69e2
|
[PD] Keep the sampling mask of a replayed rebootstrap token (#41235)
|
2026-09-28 12:02:27 -07:00 |
|
 Shangming CaiandClaude Fable 5
|
2a1c477648
|
[PD] Defer decode KV release on every transfer failure, not only decode-initiated aborts (#41404)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-09-29 02:19:51 +08:00 |
|
YAMY
|
f209e67767
|
[Spec] Model-agnostic last-stage draft embedding under pipeline parallelism (#39643)
|
2026-09-28 10:22:40 -07:00 |
|
Kurkur
|
6624999385
|
[Fix][NPU] fix dp-attn hang when pin_mem is True on NPU (#40446)
|
2026-09-29 00:41:43 +08:00 |
|
triple-mu
|
2e7e0802f4
|
[diffusion] Qwen-Image 2.1: fuse Q/K RMSNorm + RoPE + KV packing into one CUDA kernel and project Q/K/V with one packed GEMM (#41339)
|
2026-09-28 21:45:39 +08:00 |
|
 DarkSharpnessandClaude Opus 5.5
|
8151378c1a
|
[DeepSelect] Add page-table transform to top-k and tighten the layout contract (#41364)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
|
2026-09-28 21:43:57 +08:00 |
|
Shuwen Wang
|
da3eb6db32
|
[Unified Memory] Fix Inkling conv-checkpoint track ids written to virtual slot numbers (#41144)
|
2026-09-28 05:19:19 -07:00 |
|
Shuwen Wang
|
bddeb61d94
|
[Unified Memory] fix: preserve FP8 dtype in unified MHA pool (#38133)
|
2026-09-28 05:19:03 -07:00 |
|
 MickandMick Qian
|
090439bf8f
|
[diffusion] docs: consolidate Qwen-Image 2.1 guidance in its cookbook (#41540)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-28 20:04:32 +08:00 |
|
 Raiden MakotoandRaiden-Makoto
|
fa443412c5
|
[AMD] [GLM5] Fuse shared expert into AITER MoE on gfx950 (#41161)
Signed-off-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
Co-authored-by: Raiden-Makoto <Raiden-Makoto@users.noreply.github.com>
|
2026-09-28 03:40:09 -07:00 |
|
karverma-amd
|
85be04978d
|
[AMD][DSV4] moe: enable shared-expert fusion on the grouped-topk path (megamoe) (#40943)
|
2026-09-28 03:21:57 -07:00 |
|
Denji-kk
|
6caf0ff4ae
|
perf(multimodal): offload CPU feature hashing with bounded admission (#39539)
|
2026-09-28 17:51:05 +08:00 |
|
 MickandMick Qian
|
c02eaadeb2
|
[diffusion] optimization: populate cpu weight stores before host registration to speedup layerwise-offload initialization (#40439)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
|
2026-09-28 17:45:58 +08:00 |
|
Peng Wu
|
6582425854
|
Let predicate-registered linear-attention models carry the mamba radix-cache leaves (#41165)
|
2026-09-28 17:07:35 +08:00 |
|
Peng Wu
|
546bfa7221
|
[Kimi-K3] Merge fused_qkvg_proj into the loader-seeded packed_modules_mapping (#41164)
|
2026-09-28 16:46:11 +08:00 |
|
 ashwini rathiandPramod Kumar
|
e8eeff2956
|
[XPU] Bump sglang-kernel-xpu wheel to v0.3.0 (#41220)
Co-authored-by: Pramod Kumar <144990617+pramodkumar-habanalabs@users.noreply.github.com>
|
2026-09-28 16:15:12 +08:00 |
|
Ke Bao
|
6405cf2881
|
Fix chat template cache key order (#41517)
|
2026-09-28 15:17:09 +08:00 |
|