 fzyzcjy
|
725920915f
|
Introduce ModelRunner.ps ParallelState (#31161)
|
2026-07-14 16:01:14 +08:00 |
|
|
fzyzcjy
|
1dc48c2c3b
|
Absorb capturer setup and extract the shared-mooncake gate (#31160)
|
2026-07-14 16:00:51 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
e9ef06c560
|
[Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:20:59 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
874fc07d9b
|
[Kernel] Migrate scattered quantization kernels to sglang.kernels (RFC #29630, Phase 2.5, 1/7) (#30784)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 16:17:01 +08:00 |
|
|
Liangsheng Yin
|
4884f6fbee
|
[Fix] Unify ForwardBatch extend lens cpu fields to their declared list type (#30896)
|
2026-07-11 17:30:53 -05:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
6ed9843b57
|
[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-10 21:41:08 +08:00 |
|
|
|
2e66707399
|
Fix pipeline-parallel abort missing in-flight requests in non-current microbatch slots (#29405)
Co-authored-by: burling <3637497+burling@users.noreply.github.com>
Co-authored-by: zhaotyer <89376832+zhaotyer@users.noreply.github.com>
|
2026-07-10 08:53:18 +08:00 |
|
|
Lianmin Zheng
|
a9e804623e
|
Allow EPLB manual test to use FlashInfer A2A (#30641)
|
2026-07-09 03:46:07 -07:00 |
|
|
Cheng Wan
|
1f15308dca
|
[refactor] Retire the legacy config accessor and the remaining process singletons (#30493)
|
2026-07-09 02:10:47 -07:00 |
|
|
Baizhou Zhang
|
5eb1b6a7ba
|
Remove retired DSA env paths (#29912)
|
2026-07-05 22:58:02 -07:00 |
|
|
Mohammad Miadh Angkad
|
cfb9c574d3
|
Fix UE8M0 scale rounding for DeepGEMM (#29956)
|
2026-07-02 13:42:17 -07:00 |
|
|
Xiaoyu Zhang
|
b276a9acee
|
chore: cleanup garbage code (#29770)
|
2026-07-02 16:14:01 +08:00 |
|
|
Liangsheng Yin
|
909123ddb8
|
[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591)
|
2026-06-28 18:38:28 -07:00 |
|
|
ishandhanani
|
aaa31eb0a1
|
feat: first-class session identity in SGLang (#29436)
|
2026-06-28 07:16:38 -07:00 |
|
|
Jimmy Shong
|
e745b3af22
|
[Fix] compressed-tensors block FP8: requantize weight scales to UE8M0 for DeepGEMM on Blackwell (#28662)
|
2026-06-26 21:41:18 +00:00 |
|
|
Yan Ru Pei
|
c0d4d1897c
|
fix: batch BlockRemoved events per radix node (#29265)
|
2026-06-26 16:13:40 +08:00 |
|
|
fzyzcjy
|
7002a37ea1
|
Inline extend_range accessors and remove the extend_input_len/fill_len properties (#27611)
|
2026-06-25 08:56:44 +08:00 |
|
|
fzyzcjy
|
d0524d6433
|
Avoid scattered assignment of extend_input_len and fill_len by merging them into Req.extend_range (#27610)
|
2026-06-25 08:33:28 +08:00 |
|
|
Alex Tumanov
|
33373cbb12
|
[misc] Move bench_serving into sglang.benchmark (#28996)
|
2026-06-23 19:34:11 -07:00 |
|
|
Liangsheng Yin
|
b448b08401
|
[misc] Move bench_offline_throughput into sglang/benchmark/ with a back-compat shim (#28747)
|
2026-06-23 18:37:52 -07:00 |
|
|
Liangsheng Yin
|
c864c8d9c2
|
[misc] Move bench_one_batch into sglang/benchmark/ with a back-compat shim (#28687)
|
2026-06-23 14:48:35 -07:00 |
|
|
Shangming Cai
|
0460f277b7
|
Fix manual chunked-prefill test to use req.fill_len after fill_ids refactor (#29032)
|
2026-06-23 17:52:26 +08:00 |
|
|
ishandhanani
|
e67b228d4c
|
feat: session radix cache (#27058)
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
|
2026-06-23 01:51:41 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
abb0717174
|
[CI] Fix lint brought by #27527 (#28988)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-06-22 20:40:06 -07:00 |
|
|
Chetan Kumar Verma
|
6cd8d2869b
|
Vectorize _create_custom_4d_mask in CustomQwen2Decoder (#27527)
|
2026-06-23 10:56:35 +08:00 |
|
|
Cheng Wan
|
53318911ca
|
Add get_parallel(): a structured accessor for parallel-topology state (#28567)
|
2026-06-17 20:23:43 -07:00 |
|
|
|
13537f8e20
|
Unskip Marlin NVFP4 tests (#27589)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: shaunkotek <shaunkotek@users.noreply.github.com>
|
2026-06-16 11:58:22 -07:00 |
|
|
iridiumine
|
3df6e2f968
|
[NPU] Add MiMo-V2-Flash manual testcases (#28223)
|
2026-06-15 19:57:49 +08:00 |
|
|
Yuhao Yang
|
aea0e30853
|
[4/N] Qwen3.5Opt: Overlap mamba verify update with draft extend (#26924)
|
2026-06-13 20:29:20 +08:00 |
|
|
Zach Zhu
|
627ed3476b
|
Fix invalid KVFP4QuantizeUtil references (#28013)
Signed-off-by: Zach Zhu <zzqshu@126.com>
|
2026-06-12 13:44:11 -07:00 |
|
|
syy-hw
|
3a3a759464
|
[NPU] Add Gemma4 Sliding Window Attention support on Ascend backend (#26147)
|
2026-06-12 11:44:38 +08:00 |
|
|
Liangsheng Yin
|
c0480a88be
|
[Spec] Retire Spec V1 (#27964)
|
2026-06-11 16:15:15 -07:00 |
|
|
Baizhou Zhang
|
3c1b0fb226
|
[1/n] [CP] Simplify prefill context parallel server args (#27312)
|
2026-06-10 14:11:38 -07:00 |
|
|
billishyahaoandHAI
|
0ae27405d0
|
[AMD] Support eplb for moriep (#22985)
Co-authored-by: HAI <hixiao@gmail.com>
|
2026-06-10 10:23:51 -07:00 |
|
|
fzyzcjy
|
1368717248
|
Add more testing for chunked prefill (#27506)
|
2026-06-09 20:19:30 +08:00 |
|
|
|
c2eae96c56
|
MSCCL++ Integration (#22734)
Co-authored-by: Caio Rocha <caiorocha@microsof.com>
Co-authored-by: empyreus <rjsouza1995@gmail.com>
|
2026-06-08 21:13:13 -07:00 |
|
|
Zhiy-Zhangandqiufan.zzy
|
a09e85d677
|
Fix(spec): Fix the crash issue in the FA3 backend when running with top-k > 1 and page_size > 1 (#25077)
Co-authored-by: qiufan.zzy <qiufan.zzy@antgroup.com>
|
2026-06-08 17:14:29 -07:00 |
|
|
Liangsheng Yin
|
b5c64b94d5
|
[Spec] Rename token resolver to _resolve_spec_v2_tokens; remove dead V1 helpers (#27552)
|
2026-06-08 14:42:21 -07:00 |
|
|
fzyzcjy
|
259a2da3e0
|
Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637)
|
2026-06-08 14:52:18 +08:00 |
|
|
Mohammad Miadh AngkadandLianmin Zheng
|
52f221cce0
|
Fix Req array token-id concatenation (#26182)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-06 19:59:51 -07:00 |
|
|
Cheng WanandClaude Opus 4.8
|
c9ca56da8c
|
Unify full→SWA index translation in init_forward_metadata; drop pool caches (#27091)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-06-03 16:12:27 -07:00 |
|
|
Hanming LuandYAMY
|
e0b692600f
|
[Mamba] extra buffer lazy support (#27118)
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
|
2026-06-03 12:42:11 -07:00 |
|
|
Shaun Kotek
|
b8d7351a74
|
Feat/add w4a16 moe support to nemotron (#25655)
|
2026-06-02 22:42:26 -07:00 |
|
|
Cheng WanandClaude Opus 4.7
|
99da43b900
|
[refactor] init_forward_metadata 3-method ABC + side-channel removal + ForwardMetadata type rename (#26735)
Co-authored-by: Claude Opus 4.7 <noreply@anthropic.com>
|
2026-06-02 10:33:33 -07:00 |
|
|
fzyzcjy
|
e188745ee0
|
Add KV-canary SWA + DeepSeek-V4 pool support (#26810)
|
2026-05-31 09:55:34 +08:00 |
|
|
fzyzcjy
|
11391b2a1c
|
Add the KV-canary core: data layer, MHA KV-pool patcher, and per-forward runner (#26808)
|
2026-05-31 09:54:24 +08:00 |
|
|
Haichuan Hu
|
acd689b407
|
feat: add SGLANG_RAY_BUNDLE_INDICES for fine-grained Ray bundle index control (#24667)
Signed-off-by: Haichuan Hu <kaisennhu@gmail.com>
|
2026-05-30 02:19:50 -07:00 |
|
|
Liangsheng Yin
|
ec78fa6518
|
test/registered: cleanup pure model e2e tests (moves, splits, dedup, kit) (#26610)
|
2026-05-28 15:41:46 -07:00 |
|
|
Kaixi Hou
|
ddf0627254
|
[NVIDIA] [GDN] Add FlashInfer prefill support for SM100+ (Blackwell) (#22921)
|
2026-05-27 13:58:05 -07:00 |
|
|
Sam HandYihao Wang
|
a95b4e2e09
|
[Feature] WebSocket streaming audio input for ASR (#22848)
Co-authored-by: Yihao Wang <42559837+AgainstEntropy@users.noreply.github.com>
|
2026-05-27 22:44:55 +08:00 |
|