minke.yu
6c1c54b514
fixup: import is_gfx95_supported for #41294 and #40860 ROCm branches
...
dsv41_sparse.py and graph_variants.py referenced is_gfx95_supported without
importing it (latent NameError on the ROCm path).
2026-10-19 10:37:08 +08:00
minke.yu
51624199b4
PR #41294 : use the fused low-ratio compressor on Hopper (sm90 gate)
...
Source: https://github.com/sgl-project/sglang/pull/41294 (applied via GitHub .diff, 3way)
Skipped: test_dsv41_fused_compress.py (file not in v0.5.21 base).
2026-10-19 10:35:29 +08:00
minke.yu
31b3758c99
PR #42365 : fuse Hopper prefill indexer scoring into one Triton kernel
...
Source: https://github.com/sgl-project/sglang/pull/42365 (applied via GitHub .diff, 3way)
Conflicts resolved: unioned env flags with #40945 SM90 flags; merged fused
scoring loop with #40860 candidate_blocks path (candidate > fused > torch priority).
2026-10-19 10:33:13 +08:00
minke.yu
740372bef0
PR #40945 : SM90 static verification indexing (grouped/length-aware indexer)
...
Source: https://github.com/sgl-project/sglang/pull/40945 (applied via GitHub .diff, 3way)
Adaptation: PR base predates #41659 which removed the Selection struct;
ported sm90_decode.py and call sites to the inputs.out_page_indices interface
(raw_indices=None on decode paths, reset via inputs.reset_outputs()).
2026-10-19 10:30:41 +08:00
minke.yu
19fe20baec
PR #40860 : SM90 candidate indexers (compact candidate dispatch)
...
Source: https://github.com/sgl-project/sglang/pull/40860 (applied via GitHub .diff, 3way)
Conflicts resolved: kept #41658 padded-return trim in fp4_index_logits_paged,
took PR side for candidate_blocks branches, SM90 graph gate, deep_select test param.
Skipped: test_dsv41_candidate_graph_variants.py (file not in v0.5.21 base).
2026-10-19 10:22:09 +08:00
yuyu5333
534842ac08
[DeepSeek V4.1] Use DeepSelect for Hopper full top-k decode. ( #41561 )
...
Co-authored-by: Claude Code <noreply@anthropic.com >
(cherry picked from commit b50fdeb0ef )
2026-10-19 10:16:18 +08:00
Yuwei An
4dd95a8817
[DSV4.1] Reduce eager Engram extend preparation ( #42159 )
...
Co-authored-by: Shangming Cai <csmthu@gmail.com >
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
(cherry picked from commit d434ea444d )
2026-10-19 10:16:08 +08:00
Yuwei An
656e00dcd3
[DSv4.1] mxfp8 dispatch cache ( #42156 )
...
Co-authored-by: Yuwei An <yuwei.an@MacBook-Pro-yuweian.local >
(cherry picked from commit 2d38934493 )
2026-10-19 10:15:46 +08:00
DarkSharpness
a4b1363bf4
[DSv4.1] Prefill indexer: raw selection, row-pair schedule ids, no host syncs ( #41659 )
...
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
Co-authored-by: BBuf <1182563586@qq.com >
(cherry picked from commit 520d6d0229 )
2026-10-19 10:15:46 +08:00
DarkSharpness
ad2acaa2df
[DSv4.1] Fold q_rope_store into fused_q_norm_rope ( #41657 )
...
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
(cherry picked from commit 379ec90fb2 )
2026-10-19 10:15:45 +08:00
Yuwei An
ecaaa37cb0
[Fix][DSV4.1] SWA page size with bounded replay ( #42128 )
...
(cherry picked from commit ef867fa40d )
2026-10-19 10:14:30 +08:00
DarkSharpness
1b70fc192c
[DSv4.1] Trim prefill model-entry overhead ( #41704 )
...
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
Co-authored-by: BBuf <1182563586@qq.com >
(cherry picked from commit 2f6e0ec45d )
2026-10-19 10:14:29 +08:00
DarkSharpness
3ebbb2d536
[DSv4.1] Fused c1/c2 compress for eager extend, faster c2 decode ( #41660 )
...
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
Co-authored-by: BBuf <1182563586@qq.com >
(cherry picked from commit 5916999afb )
2026-10-19 10:14:29 +08:00
DarkSharpness
5d52cccbee
[DSv4.1] Faster fp4 index-K gather and combine_topk_swa_indices ( #41658 )
...
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com >
Co-authored-by: BBuf <1182563586@qq.com >
(cherry picked from commit d75d5b33f7 )
2026-10-19 10:14:28 +08:00
minke.yu
74d03143e2
PR #41098 : H20 block-FP8 tuned GEMM configs
...
Source: https://github.com/sgl-project/sglang/pull/41098 (applied via GitHub .diff, 3way)
2026-10-19 10:13:59 +08:00
Xiaoyu Zhang
2b192aade6
[Perf] Optimize DeepSeek V4.1 Flash Hopper paths and Blackwell prefill selection ( #41251 )
...
(cherry picked from commit 391e665dab )
2026-10-19 10:13:35 +08:00
minke.yu
9247c97919
PR #40919 : fix dspark folded result buffer reuse race
...
Source: https://github.com/sgl-project/sglang/pull/40919 (applied via GitHub .diff, 3way)
2026-10-19 10:12:23 +08:00
minke.yu
5e7190b87a
PR #40758 : escape literal DSV4.1 image placeholder in user text
...
Source: https://github.com/sgl-project/sglang/pull/40758 (applied via GitHub .diff, 3way)
2026-10-19 10:12:16 +08:00
e00930c548
[Cherry-pick to release/v0.5.21] [Test] Demote PD test RDMA openability check to a warning ( #41681 ) ( #41802 )
...
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com >
Co-authored-by: hnyls2002 <lsyincs@gmail.com >
2026-09-29 19:44:12 -07:00
Kangyan-Zhou and Baizhou Zhang
d7ff74b984
[Cherry-pick to release/v0.5.21] [Fix] Restore deferred layer dumps and pin SentencePiece for InternVL ( #41777 ) ( #41788 )
...
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com >
2026-09-29 17:30:38 -07:00
Jiacong Fang
bd78095030
[Fix] Add name mapping in load_weights of nvidia/LocateAnything-3B ( #41059 )
2026-09-29 00:38:58 -07:00
Mick and Mick Qian
dc1bd46802
[diffusion] feat: support bounded exact conditioning cache across native models ( #40470 )
...
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com >
2026-09-29 15:27:22 +08:00
eeecho
c7be3e935b
[SM120] Add optional FlashInfer PCIe-IPC all-reduce for switch-free hosts ( #34528 )
2026-09-28 23:08:44 -07:00
Anupa Sajikumar and Ma Mingfei
2ff52e3ceb
[Intel][XPU]Enable chunked prefill scnearios for XPU with UT ( #33804 )
...
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
2026-09-29 13:28:25 +08:00
9ae43b0eee
[XPU] Support compressed-tensors W4A16 by reusing the torch int4pack path ( #40828 )
...
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Singh <rohitsi2@iil-gnrap01.iind.intel.com >
Co-authored-by: Singh <rohitsi2@iil-login.iind.intel.com >
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com >
2026-09-29 13:16:03 +08:00
Cheng Wan
5781206833
[PD] Give FakeKVReceiver ensure_abort_notified ( #41618 )
2026-09-28 21:59:17 -07:00
Cheng Wan
6dad152490
[Refactor] Document layer boundary contracts and integration ( #41557 )
2026-09-28 20:18:27 -07:00
Cheng Wan
de9f850b36
[Refactor] Rename the module to layer_boundary ( #41555 )
2026-09-28 20:17:50 -07:00
Cheng Wan
701213c867
[Refactor] Retire the layer facade and simplify boundary internals ( #41554 )
2026-09-28 20:17:33 -07:00
Cheng Wan
9b89b96230
[Refactor] Migrate specialized decoder and overlap boundaries ( #41553 )
2026-09-28 20:17:17 -07:00
Cheng Wan
49b5e76e45
[Refactor] Construct independent decoder stage boundaries ( #41552 )
2026-09-28 20:17:00 -07:00
Cheng Wan
acffb0d20d
[Refactor] Select reduction fusion at the consumer ( #41551 )
2026-09-28 20:16:44 -07:00
Cheng Wan
cb1fa3c399
[Refactor] Capture auxiliary states at residual reads ( #41550 )
2026-09-28 20:16:26 -07:00
Cheng Wan
42f58b4da7
[Refactor] Carry residual state across stage boundaries ( #41549 )
2026-09-28 20:15:03 -07:00
Cheng Wan
6f72cc3b64
[Refactor] Centralize decoder output access ( #41548 )
2026-09-28 20:14:04 -07:00
Cheng Wan
0a8ca85565
[Refactor] Group communicator fusion and CP adapters ( #41547 )
2026-09-28 20:10:50 -07:00
Liangsheng Yin
d9074f7943
[Test] Fail fast when PD test RDMA devices are not openable by ibverbs ( #41600 )
2026-09-28 19:34:58 -07:00
James
6e1df69623
[npu]support NPU 910C L2 memcache offload ( #41527 )
2026-09-29 10:30:01 +08:00
77091cea68
[Radix Cache] Sync Rust TreeCore and make it the default ( #39627 )
...
Co-authored-by: Ke Bao <ispobaoke@gmail.com >
Co-authored-by: Zhangheng <hzh0425@apache.org >
Co-authored-by: alphabetc1 <alphabetc1@users.noreply.github.com >
2026-09-29 10:18:57 +08:00
WenhaoZhang
49d26ff0c2
[diffusion] model: support flux 3 action robot policies ( #41066 )
2026-09-29 10:17:19 +08:00
79cafec013
[Model] Add IQuest Q1 support and MTP draft ( #41590 )
...
Co-authored-by: zelong huang <yzhu@ubiquant.com >
Co-authored-by: hnyls2002 <lsyincs@gmail.com >
Co-authored-by: zelong518 <zelonghuang05@gmail.com >
Co-authored-by: chenwenxiaolive <cocoshirolive@gmail.com >
2026-09-28 17:21:31 -07:00
7889fbab9a
[PD] Keep EAGLE DP graph and token metadata consistent ( #32196 )
...
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com >
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com >
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai >
2026-09-28 17:15:51 -07:00
Shuwen Wang
89e1316eae
[mem cache] refactor: remove the index-K continuous getters orphaned by the CP v1 removal ( #41469 )
2026-09-28 16:41:07 -07:00
Hrithvik Alex and Hrithvik Alex
f124c5ceec
[Model Loader] Stop checkpoint prefetch after iterator completion ( #41588 )
...
Co-authored-by: Hrithvik Alex <hrithvik@baseten.co >
2026-09-28 16:27:09 -07:00
9654e5c4bc
dsv4.1-amd: fused mHC boundary and all-reduce + mHC post kernels ( #41021 )
...
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai >
2026-09-28 16:15:08 -07:00
Kevin Mi and Claude Opus 5.5
096b066fb4
dsv4.1-amd: gfx950 sparse decode attention and sorted top-k ( #41020 )
...
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com >
2026-09-28 16:14:28 -07:00
Nan Jiang
6fa3fe69e2
[PD] Keep the sampling mask of a replayed rebootstrap token ( #41235 )
2026-09-28 12:02:27 -07:00
Shangming Cai and Claude Fable 5
2a1c477648
[PD] Defer decode KV release on every transfer failure, not only decode-initiated aborts ( #41404 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-09-29 02:19:51 +08:00
YAMY
f209e67767
[Spec] Model-agnostic last-stage draft embedding under pipeline parallelism ( #39643 )
2026-09-28 10:22:40 -07:00
Kurkur
6624999385
[Fix][NPU] fix dp-attn hang when pin_mem is True on NPU ( #40446 )
2026-09-29 00:41:43 +08:00