 Liangsheng Yin
|
50d1edaa7f
|
[misc] Move SchedulerRecvSkipper into scheduler_components (#31222)
|
2026-07-14 16:35:04 -07:00 |
|
|
Alison Shao
|
771e386332
|
Disable flaky DSV4-Flash FP4 BCG determinism test (nondeterminism from #30898 idle-rank dummy extend) (#31125)
|
2026-07-14 16:21:10 -07:00 |
|
|
paulzhang-tm
|
463a3f4248
|
[Mamba] Support configurable conv-window layouts (#31059)
|
2026-07-14 14:41:10 -07:00 |
|
|
|
0d89564d27
|
Support scheduler_recv_interval (recv skipper) under DP-attention (#30457)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-07-14 14:02:58 -07:00 |
|
|
hunhokimandHun-ho Kim
|
a5c3e0283f
|
[Bug fix] Account for KV replication fan-out in transfer-byte metrics (#30351)
Co-authored-by: Hun-ho Kim <hunho.kim@samsung.com>
|
2026-07-14 10:08:24 -07:00 |
|
|
Mohammad Miadh Angkad
|
271e5ef5c3
|
[CI] Fix Flash MLA SM120 test import path (#31199)
|
2026-07-14 09:01:23 -07:00 |
|
|
Mick
|
04af94d150
|
fix: avoid tilelang cuda runtime pollution (#30870)
|
2026-07-14 22:30:27 +08:00 |
|
|
Ma Mingfei
|
31548781e0
|
[CPU] bypass scoring_func argument in topk for cpu device (#31110)
|
2026-07-14 21:48:22 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
1a35440c4a
|
[Kernel] Migrate generic attention kernels to sglang.kernels (RFC #29630, Phase 2.5, 4/7) (#30789)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 16:53:46 +08:00 |
|
|
fzyzcjy
|
54f99a21d5
|
Narrow component dependencies to injected fields instead of ModelRunner (#31166)
|
2026-07-14 16:03:07 +08:00 |
|
|
fzyzcjy
|
cfd17301a8
|
Extract per-architecture KV-cache pool builders into KVCacheConfigurator (#31163)
|
2026-07-14 16:02:09 +08:00 |
|
|
fzyzcjy
|
725920915f
|
Introduce ModelRunner.ps ParallelState (#31161)
|
2026-07-14 16:01:14 +08:00 |
|
|
fzyzcjy
|
1dc48c2c3b
|
Absorb capturer setup and extract the shared-mooncake gate (#31160)
|
2026-07-14 16:00:51 +08:00 |
|
|
fzyzcjy
|
d15f6a9ac3
|
Introduce NgramEmbeddingManager component (#31154)
|
2026-07-14 15:58:08 +08:00 |
|
|
fzyzcjy
|
e20c346541
|
Extract hybrid-arch helpers into configs.hybrid_arch and ModelConfig (#31150)
|
2026-07-14 15:55:32 +08:00 |
|
|
fzyzcjy
|
6507d4a090
|
Introduce WeightUpdater and WeightExporter components (#31148)
|
2026-07-14 15:53:33 +08:00 |
|
|
Zhanghengandispobock
|
afa3c06d1f
|
Using UnifiedRadixTree by default for SWA, Mamba, and DSA models (#30468)
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-07-14 15:17:08 +08:00 |
|
|
|
702bddcee8
|
[Model] Add support for JetBrains' Mellum v2 code generation model (#27375)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Jiminator <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-13 22:54:38 -07:00 |
|
|
Yuxuan ZhangandBaizhou Zhang
|
7e229e2a81
|
support GLM-5.2 MTP index sharing with prefill CP (#30992)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-07-13 21:11:27 -07:00 |
|
|
|
78dc581518
|
[bug-fix] Stabilize GLM-5.2 MTP IndexShare across PD and CUDA graph replay (#30839)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 19:37:07 -07:00 |
|
|
YAMY
|
41ad0d9c26
|
Allow prefill breakable CUDA graph for Qwen3.5 via multimodal opt-in allowlist (#30620)
|
2026-07-13 18:39:44 -07:00 |
|
|
|
7431f35fd8
|
Delete CUTLASS FP8 blockwise for SM90 and SM100, move SM120 to JIT and add SwapAB (#30438)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-14 09:31:32 +08:00 |
|
|
Haotong Zou
|
c124bec99d
|
[CI] Disable gated Llama-2 EAGLE spec tests to unblock Xeon CPU CI (#30995)
|
2026-07-14 09:28:47 +08:00 |
|
|
Brayden Zhongandroot
|
9756f768a6
|
Refactor FP4 quantization and remove deprecated JIT kernels (#30448)
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
|
2026-07-14 09:22:07 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
e9ef06c560
|
[Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:20:59 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
ee464fedc6
|
[Kernel] Migrate scattered MoE kernels to sglang.kernels (RFC #29630, Phase 2.5, 2/7) (#30786)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:03:21 +08:00 |
|
|
Alison Shao
|
464fe1b77c
|
[CI] Use torch.testing.assert_close in custom-all-reduce test (~1400x faster compare) (#31080)
|
2026-07-14 08:53:20 +08:00 |
|
|
Mick
|
33f83011e0
|
fix: fix Kimi-VL encoder parallelism (#30869)
|
2026-07-14 08:44:06 +08:00 |
|
|
Po-Han Huang (NVIDIA)
|
cfc3d0555e
|
Fix ModelOpt NVFP4 scalar scales for merged linears (#29151)
|
2026-07-13 16:14:20 -07:00 |
|
|
hari-hm
|
a909077d22
|
Return top-p/top-k sampling mask/nucleas (#27408)
|
2026-07-13 17:58:51 -05:00 |
|
|
Brayden Zhong
|
0ee236ebdf
|
more fixes for Nemotron 3 parser for tool call and force nonempty content (#30533)
|
2026-07-14 06:50:27 +08:00 |
|
|
Liangsheng Yin
|
e2728ac504
|
[Spec] Remove dead padded_static_len and stale SGLANG_ENABLE_SPEC_V2 references (#30998)
|
2026-07-13 15:30:31 -05:00 |
|
|
Liangsheng Yin
|
c0f1f7e062
|
[Spec] Rename num_tokens_per_bs to num_tokens_per_req (#30977)
|
2026-07-13 13:47:53 -05:00 |
|
|
|
11a82af5f8
|
[Platform] Route pin memory availability through current_platform (#28113)
Co-authored-by: N3u0ns <N3u0ns@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-13 11:37:59 -07:00 |
|
|
Xinyuan Tong
|
afaa17a7f2
|
[Feature] Add --default-chat-template-kwargs server arg (#29579)
|
2026-07-13 11:34:39 -07:00 |
|
|
ziruiliu
|
978bce2063
|
[HiCache & HybridModel] nixl hicache backend support hybrid models (#29191)
Signed-off-by: Zirui Liu <ziliu@ddn.com>
|
2026-07-13 09:09:37 -07:00 |
|
|
|
9fec359a60
|
[Fix] Load HunyuanV3 NextN final_layernorm into the draft head's output norm (#30331)
Co-authored-by: Auroter <auroter@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 20:37:36 +08:00 |
|
|
Yichao Cheng
|
a74bee2261
|
[PD] Handle NIXL abort notifications (#30352)
|
2026-07-13 05:05:25 -07:00 |
|
|
xutizhou
|
eb31b5310c
|
Support Waterfill with MegaMoE backend (#27350)
|
2026-07-13 03:56:46 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
874fc07d9b
|
[Kernel] Migrate scattered quantization kernels to sglang.kernels (RFC #29630, Phase 2.5, 1/7) (#30784)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 16:17:01 +08:00 |
|
|
shuwenn
|
9dd57ef8c4
|
[mem_cache][7/N] refactor: move MLATokenToKVPoolHost to pool_host.mla (#30616)
|
2026-07-13 14:23:38 +08:00 |
|
|
Mohammad Miadh Angkad
|
cbcbef6811
|
[Bugfix] Fix Nemotron ForwardFlags across custom op boundary (#30968)
|
2026-07-12 22:10:23 -07:00 |
|
|
Mick
|
7da30f4e55
|
feat: enable piecewise prefill graph for Kimi K2.5/K2.7 (#30889)
|
2026-07-13 08:37:30 +08:00 |
|
|
Lianmin Zheng
|
b94ac87e0c
|
Enable breakable prefill CUDA graph for DP attention (#30898)
|
2026-07-12 17:10:04 -07:00 |
|
|
cctry
|
c616d5a55e
|
[PD] Improve optimistic prefill (#30951)
|
2026-07-12 15:31:53 -07:00 |
|
|
|
6cc9352dfe
|
[Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-07-12 17:25:26 -05:00 |
|
|
Liangsheng Yin
|
7a82178277
|
[Fix] Disable FlashInfer allreduce fusion in Nemotron-3-Nano lm-eval test (#30945)
|
2026-07-12 15:39:59 -05:00 |
|
|
Liangsheng Yin
|
5ba3c5147e
|
[Spec] Add kill-switch env for draft-extend CUDA graph capture (#30944)
|
2026-07-12 14:54:36 -05:00 |
|
|
Mohammad Miadh Angkad
|
96a04cb13f
|
Fix DeepEP CI test registration (#30873)
|
2026-07-12 05:54:50 -07:00 |
|
|
Lianmin ZhengandYongji Wu
|
81d273f73b
|
Handle coredump dirs and cache hit updates (#30897)
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
|
2026-07-12 00:37:43 -07:00 |
|