 fzyzcjy
|
54f99a21d5
|
Narrow component dependencies to injected fields instead of ModelRunner (#31166)
|
2026-07-14 16:03:07 +08:00 |
|
|
fzyzcjy
|
cfd17301a8
|
Extract per-architecture KV-cache pool builders into KVCacheConfigurator (#31163)
|
2026-07-14 16:02:09 +08:00 |
|
|
fzyzcjy
|
725920915f
|
Introduce ModelRunner.ps ParallelState (#31161)
|
2026-07-14 16:01:14 +08:00 |
|
|
fzyzcjy
|
1dc48c2c3b
|
Absorb capturer setup and extract the shared-mooncake gate (#31160)
|
2026-07-14 16:00:51 +08:00 |
|
|
fzyzcjy
|
d15f6a9ac3
|
Introduce NgramEmbeddingManager component (#31154)
|
2026-07-14 15:58:08 +08:00 |
|
|
fzyzcjy
|
e20c346541
|
Extract hybrid-arch helpers into configs.hybrid_arch and ModelConfig (#31150)
|
2026-07-14 15:55:32 +08:00 |
|
|
fzyzcjy
|
6507d4a090
|
Introduce WeightUpdater and WeightExporter components (#31148)
|
2026-07-14 15:53:33 +08:00 |
|
|
Zhanghengandispobock
|
afa3c06d1f
|
Using UnifiedRadixTree by default for SWA, Mamba, and DSA models (#30468)
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-07-14 15:17:08 +08:00 |
|
|
|
702bddcee8
|
[Model] Add support for JetBrains' Mellum v2 code generation model (#27375)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Jiminator <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-13 22:54:38 -07:00 |
|
|
Yuxuan ZhangandBaizhou Zhang
|
7e229e2a81
|
support GLM-5.2 MTP index sharing with prefill CP (#30992)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2026-07-13 21:11:27 -07:00 |
|
|
|
78dc581518
|
[bug-fix] Stabilize GLM-5.2 MTP IndexShare across PD and CUDA graph replay (#30839)
Co-authored-by: kpham-sgl <khoa.pham@radixark.ai>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 19:37:07 -07:00 |
|
|
YAMY
|
41ad0d9c26
|
Allow prefill breakable CUDA graph for Qwen3.5 via multimodal opt-in allowlist (#30620)
|
2026-07-13 18:39:44 -07:00 |
|
|
|
7431f35fd8
|
Delete CUTLASS FP8 blockwise for SM90 and SM100, move SM120 to JIT and add SwapAB (#30438)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
|
2026-07-14 09:31:32 +08:00 |
|
|
Haotong Zou
|
c124bec99d
|
[CI] Disable gated Llama-2 EAGLE spec tests to unblock Xeon CPU CI (#30995)
|
2026-07-14 09:28:47 +08:00 |
|
|
Brayden Zhongandroot
|
9756f768a6
|
Refactor FP4 quantization and remove deprecated JIT kernels (#30448)
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
|
2026-07-14 09:22:07 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
e9ef06c560
|
[Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:20:59 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
ee464fedc6
|
[Kernel] Migrate scattered MoE kernels to sglang.kernels (RFC #29630, Phase 2.5, 2/7) (#30786)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:03:21 +08:00 |
|
|
Alison Shao
|
464fe1b77c
|
[CI] Use torch.testing.assert_close in custom-all-reduce test (~1400x faster compare) (#31080)
|
2026-07-14 08:53:20 +08:00 |
|
|
Mick
|
33f83011e0
|
fix: fix Kimi-VL encoder parallelism (#30869)
|
2026-07-14 08:44:06 +08:00 |
|
|
Po-Han Huang (NVIDIA)
|
cfc3d0555e
|
Fix ModelOpt NVFP4 scalar scales for merged linears (#29151)
|
2026-07-13 16:14:20 -07:00 |
|
|
hari-hm
|
a909077d22
|
Return top-p/top-k sampling mask/nucleas (#27408)
|
2026-07-13 17:58:51 -05:00 |
|
|
Brayden Zhong
|
0ee236ebdf
|
more fixes for Nemotron 3 parser for tool call and force nonempty content (#30533)
|
2026-07-14 06:50:27 +08:00 |
|
|
Liangsheng Yin
|
e2728ac504
|
[Spec] Remove dead padded_static_len and stale SGLANG_ENABLE_SPEC_V2 references (#30998)
|
2026-07-13 15:30:31 -05:00 |
|
|
Liangsheng Yin
|
c0f1f7e062
|
[Spec] Rename num_tokens_per_bs to num_tokens_per_req (#30977)
|
2026-07-13 13:47:53 -05:00 |
|
|
|
11a82af5f8
|
[Platform] Route pin memory availability through current_platform (#28113)
Co-authored-by: N3u0ns <N3u0ns@users.noreply.github.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-13 11:37:59 -07:00 |
|
|
Xinyuan Tong
|
afaa17a7f2
|
[Feature] Add --default-chat-template-kwargs server arg (#29579)
|
2026-07-13 11:34:39 -07:00 |
|
|
ziruiliu
|
978bce2063
|
[HiCache & HybridModel] nixl hicache backend support hybrid models (#29191)
Signed-off-by: Zirui Liu <ziliu@ddn.com>
|
2026-07-13 09:09:37 -07:00 |
|
|
|
9fec359a60
|
[Fix] Load HunyuanV3 NextN final_layernorm into the draft head's output norm (#30331)
Co-authored-by: Auroter <auroter@users.noreply.github.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 20:37:36 +08:00 |
|
|
Yichao Cheng
|
a74bee2261
|
[PD] Handle NIXL abort notifications (#30352)
|
2026-07-13 05:05:25 -07:00 |
|
|
xutizhou
|
eb31b5310c
|
Support Waterfill with MegaMoE backend (#27350)
|
2026-07-13 03:56:46 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
874fc07d9b
|
[Kernel] Migrate scattered quantization kernels to sglang.kernels (RFC #29630, Phase 2.5, 1/7) (#30784)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 16:17:01 +08:00 |
|
|
shuwenn
|
9dd57ef8c4
|
[mem_cache][7/N] refactor: move MLATokenToKVPoolHost to pool_host.mla (#30616)
|
2026-07-13 14:23:38 +08:00 |
|
|
Mohammad Miadh Angkad
|
cbcbef6811
|
[Bugfix] Fix Nemotron ForwardFlags across custom op boundary (#30968)
|
2026-07-12 22:10:23 -07:00 |
|
|
Mick
|
7da30f4e55
|
feat: enable piecewise prefill graph for Kimi K2.5/K2.7 (#30889)
|
2026-07-13 08:37:30 +08:00 |
|
|
Lianmin Zheng
|
b94ac87e0c
|
Enable breakable prefill CUDA graph for DP attention (#30898)
|
2026-07-12 17:10:04 -07:00 |
|
|
cctry
|
c616d5a55e
|
[PD] Improve optimistic prefill (#30951)
|
2026-07-12 15:31:53 -07:00 |
|
|
|
6cc9352dfe
|
[Spec] Add DSpark: confidence-scheduled speculative decoding (#30261)
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Claude Code <noreply@anthropic.com>
Co-authored-by: Codex <noreply@openai.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
|
2026-07-12 17:25:26 -05:00 |
|
|
Liangsheng Yin
|
7a82178277
|
[Fix] Disable FlashInfer allreduce fusion in Nemotron-3-Nano lm-eval test (#30945)
|
2026-07-12 15:39:59 -05:00 |
|
|
Liangsheng Yin
|
5ba3c5147e
|
[Spec] Add kill-switch env for draft-extend CUDA graph capture (#30944)
|
2026-07-12 14:54:36 -05:00 |
|
|
Mohammad Miadh Angkad
|
96a04cb13f
|
Fix DeepEP CI test registration (#30873)
|
2026-07-12 05:54:50 -07:00 |
|
|
Lianmin ZhengandYongji Wu
|
81d273f73b
|
Handle coredump dirs and cache hit updates (#30897)
Co-authored-by: Yongji Wu <30348494+libertyeagle@users.noreply.github.com>
|
2026-07-12 00:37:43 -07:00 |
|
|
Mick
|
bce3fc987d
|
perf: reuse MoonViT FA3 max-seqlen metadata (#30878)
|
2026-07-12 14:05:21 +08:00 |
|
|
pllimax
|
592c04381d
|
Update test repository case scripts to the main community (#29939)
|
2026-07-12 11:36:30 +08:00 |
|
|
Mick
|
a358abd651
|
chore: update vlm moe config and tune scripts (#30866)
|
2026-07-12 08:35:59 +08:00 |
|
|
Mick
|
af66370d81
|
bench: support random image resolutions (#30879)
|
2026-07-12 08:28:56 +08:00 |
|
|
Liangsheng Yin
|
4884f6fbee
|
[Fix] Unify ForwardBatch extend lens cpu fields to their declared list type (#30896)
|
2026-07-11 17:30:53 -05:00 |
|
|
|
ed554aac17
|
Fix: add grammar sync in PP for structured output (#30747)
Signed-off-by: Jing Wang <jingwang96@qq.com>
Co-authored-by: ziang663 <119752791+ziang663@users.noreply.github.com>
Co-authored-by: Chao Shi <chao.shi@alibaba-inc.com>
|
2026-07-12 02:54:50 +08:00 |
|
|
Jae B.
|
a91c2e6596
|
[Apple Silicon] [CI] Move the MLX lane to the check-changes + pr-gate composite (#30121)
|
2026-07-10 22:00:15 -07:00 |
|
|
Baizhou Zhang
|
07165d5daa
|
Add DCP to runtime parallel context (#30478)
|
2026-07-10 21:23:41 -07:00 |
|
|
|
0663ebc783
|
[minimax-m3] Split 4/4: model + VL + glue + function-call + fp8 quant + generic infra (#28715)
Co-authored-by: Xinyuan Tong <xinyuan-tong@users.noreply.github.com>
Co-authored-by: zijiexia <37504505+zijiexia@users.noreply.github.com>
|
2026-07-11 11:11:06 +08:00 |
|