 Liangsheng YinandMick
|
afc868517b
|
[Perf] Speed up the Kimi-K2.5 vision path and match PIL bicubic in the GPU resize (#33349)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-03 21:57:49 -07:00 |
|
|
Liangsheng YinandMick
|
4bc593fdc8
|
[Perf] Broadcast single-image DP vision embedding instead of pad-to-max all-gather (#33307)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-08-02 19:39:53 -07:00 |
|
|
|
056474cdb0
|
feat: Session-reference-aware Unified Radix Cache for agentic multi-turn workloads (#29173)
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-08-02 13:43:55 +08:00 |
|
|
Trang DoandCheng Wan
|
a1c30701aa
|
Integrate pplx a2a backend (#30756)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-07-30 15:33:19 -07:00 |
|
|
Ho-Ren (Jack) ChuangandClaude Fable 5
|
e4a40a71f8
|
[DSA] Q8KV8 FP8 Sparse Prefill on GLM-5.2 & DeepSeek-V3.2: Q8-Path & Shared-Path Optimizations (#31888)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-30 15:15:11 +08:00 |
|
|
Yoray Zack
|
62d0f81f16
|
[2/N] elastic-ep: Enable EPLB after scale-up (#30553)
|
2026-07-30 01:06:56 +08:00 |
|
|
Void
|
7f438a6031
|
feat: SM120 (Blackwell Desktop) support for GLM-5.1 inference (#26928)
|
2026-07-28 14:52:34 -07:00 |
|
|
|
a678a42033
|
[KDA] Add target_verify support for speculative decoding (#26888)
Co-authored-by: yuyanqi <yuyanqi@meituan.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-07-25 19:52:44 +08:00 |
|
|
Xun SunandShangming Cai
|
9eb2dccbb7
|
[Elastic EP] Fix recovery lifecycle and add manual coverage (#31744)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2026-07-25 14:32:47 +08:00 |
|
|
|
f9c14e6bd4
|
[FEAT] Support fast engine recovery through weight cache (#27139)
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
|
2026-07-25 14:31:21 +08:00 |
|
|
Cheng Wan
|
eac7c7d7cd
|
fix(attention): read per-runner kv cache dtype off model_runner (#32251)
|
2026-07-23 20:08:57 -07:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
11b0e5c5ad
|
[Kernel] Classification cleanup: unify _jit_ naming, drop empty/model groups, add elementwise (RFC #29630) (#32148)
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
|
2026-07-23 13:47:02 +08:00 |
|
|
Chunyuan WU
|
60dea26077
|
[sgl-kernel][CPU] add kernel for shm_allgather_into_tensor and shm_reduce_scatter_tensor (#13397)
|
2026-07-23 09:19:38 +08:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
977ea336cd
|
[Kernel] Phase 4 batch-2: migrate JIT operator groups into kernels.ops (no shims) (RFC #29630) (#32015)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-22 17:49:51 +08:00 |
|
|
JD
|
becf252e6c
|
AutoWeightLoader support Sglang native models 1: demo (#28671)
|
2026-07-21 14:32:13 -07:00 |
|
|
iridiumine
|
d6ef68881e
|
[NPU] Adapt MiMo-V2.5-W8A8 (#29131)
|
2026-07-21 09:16:48 +08:00 |
|
|
Liangsheng Yin
|
ff6c755952
|
[Refactor] Unify logprob results into a single LogprobResult and rename chunk env vars (#31733)
|
2026-07-20 12:44:27 -07:00 |
|
|
Sam (Kesen Li)
|
ec6a3163b7
|
[Feature] Add FP4 KV Cache Design and support SM120 GPUs (#21601)
|
2026-07-17 14:49:43 -07:00 |
|
|
Yoray Zack
|
77d23a796e
|
[1/N] elastic-ep: Add runtime EP scale-up (#30164)
|
2026-07-16 15:53:44 -07:00 |
|
|
guzekai01
|
dee91c51cf
|
perf(deepseek_v4): enable SGLANG_OPT_FP8_WO_A_GEMM on sm90 (Hopper) (#28983)
|
2026-07-16 11:16:32 +08:00 |
|
|
Brayden ZhongandBrayden Zhong
|
7647a9d260
|
Fuse the preprocess kernels of trtllm-gen attention (#29690)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
|
2026-07-15 18:21:34 -07:00 |
|
|
karverma-amd
|
ec32590025
|
feat(moriep): add fp4 combine dtype (SGLANG_MORI_COMBINE_DTYPE=fp4) (#30706)
|
2026-07-15 14:21:41 -07:00 |
|
|
fzyzcjy
|
e77d95c3d5
|
Pass per-forward overrides to ForwardBatch.init_new as explicit arguments (#30670)
|
2026-07-15 14:25:59 +08:00 |
|
|
haoyangli0109
|
0832d856ca
|
[Bugfix] fix quickreduce acc error in cudagraph mode (#29508)
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
|
2026-07-14 22:16:02 -07:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
ba5be86d42
|
[Kernel] Migrate DSA + DSV4 attention kernels to sglang.kernels (RFC #29630, Phase 2.5, 5/7) (#30792)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-15 11:11:22 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
1a35440c4a
|
[Kernel] Migrate generic attention kernels to sglang.kernels (RFC #29630, Phase 2.5, 4/7) (#30789)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 16:53:46 +08:00 |
|
|
fzyzcjy
|
725920915f
|
Introduce ModelRunner.ps ParallelState (#31161)
|
2026-07-14 16:01:14 +08:00 |
|
|
fzyzcjy
|
1dc48c2c3b
|
Absorb capturer setup and extract the shared-mooncake gate (#31160)
|
2026-07-14 16:00:51 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
e9ef06c560
|
[Kernel] Migrate top-level srt/layers stray kernels to sglang.kernels (RFC #29630, Phase 2.5, 3/7) (#30787)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-14 09:20:59 +08:00 |
|
|
Xiaoyu ZhangandClaude Fable 5
|
874fc07d9b
|
[Kernel] Migrate scattered quantization kernels to sglang.kernels (RFC #29630, Phase 2.5, 1/7) (#30784)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
|
2026-07-13 16:17:01 +08:00 |
|
|
Liangsheng Yin
|
4884f6fbee
|
[Fix] Unify ForwardBatch extend lens cpu fields to their declared list type (#30896)
|
2026-07-11 17:30:53 -05:00 |
|
|
Xiaoyu ZhangandClaude Opus 4.8
|
6ed9843b57
|
[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
2026-07-10 21:41:08 +08:00 |
|
|
|
2e66707399
|
Fix pipeline-parallel abort missing in-flight requests in non-current microbatch slots (#29405)
Co-authored-by: burling <3637497+burling@users.noreply.github.com>
Co-authored-by: zhaotyer <89376832+zhaotyer@users.noreply.github.com>
|
2026-07-10 08:53:18 +08:00 |
|
|
Lianmin Zheng
|
a9e804623e
|
Allow EPLB manual test to use FlashInfer A2A (#30641)
|
2026-07-09 03:46:07 -07:00 |
|
|
Cheng Wan
|
1f15308dca
|
[refactor] Retire the legacy config accessor and the remaining process singletons (#30493)
|
2026-07-09 02:10:47 -07:00 |
|
|
Baizhou Zhang
|
5eb1b6a7ba
|
Remove retired DSA env paths (#29912)
|
2026-07-05 22:58:02 -07:00 |
|
|
Mohammad Miadh Angkad
|
cfb9c574d3
|
Fix UE8M0 scale rounding for DeepGEMM (#29956)
|
2026-07-02 13:42:17 -07:00 |
|
|
Xiaoyu Zhang
|
b276a9acee
|
chore: cleanup garbage code (#29770)
|
2026-07-02 16:14:01 +08:00 |
|
|
Liangsheng Yin
|
909123ddb8
|
[misc] Use --cuda-graph-max-bs-decode in tests, examples, and docs (#29591)
|
2026-06-28 18:38:28 -07:00 |
|
|
ishandhanani
|
aaa31eb0a1
|
feat: first-class session identity in SGLang (#29436)
|
2026-06-28 07:16:38 -07:00 |
|
|
Jimmy Shong
|
e745b3af22
|
[Fix] compressed-tensors block FP8: requantize weight scales to UE8M0 for DeepGEMM on Blackwell (#28662)
|
2026-06-26 21:41:18 +00:00 |
|
|
Yan Ru Pei
|
c0d4d1897c
|
fix: batch BlockRemoved events per radix node (#29265)
|
2026-06-26 16:13:40 +08:00 |
|
|
fzyzcjy
|
7002a37ea1
|
Inline extend_range accessors and remove the extend_input_len/fill_len properties (#27611)
|
2026-06-25 08:56:44 +08:00 |
|
|
fzyzcjy
|
d0524d6433
|
Avoid scattered assignment of extend_input_len and fill_len by merging them into Req.extend_range (#27610)
|
2026-06-25 08:33:28 +08:00 |
|
|
Alex Tumanov
|
33373cbb12
|
[misc] Move bench_serving into sglang.benchmark (#28996)
|
2026-06-23 19:34:11 -07:00 |
|
|
Liangsheng Yin
|
b448b08401
|
[misc] Move bench_offline_throughput into sglang/benchmark/ with a back-compat shim (#28747)
|
2026-06-23 18:37:52 -07:00 |
|
|
Liangsheng Yin
|
c864c8d9c2
|
[misc] Move bench_one_batch into sglang/benchmark/ with a back-compat shim (#28687)
|
2026-06-23 14:48:35 -07:00 |
|
|
Shangming Cai
|
0460f277b7
|
Fix manual chunked-prefill test to use req.fill_len after fill_ids refactor (#29032)
|
2026-06-23 17:52:26 +08:00 |
|
|
ishandhanani
|
e67b228d4c
|
feat: session radix cache (#27058)
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
|
2026-06-23 01:51:41 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
abb0717174
|
[CI] Fix lint brought by #27527 (#28988)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-06-22 20:40:06 -07:00 |
|