minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity
15,383 Commits 2 Branches 0 Tags
e2d2e8d07ebfa019af5834b81933bd31ef6f4c4f
Commit Graph
15383 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Qiaolin Yu e2d2e8d07e [spec decoding] fix multi_layer_eagle rotate_input_ids kernel registration (#31614) 2026-07-17 15:18:01 -07:00
Sam (Kesen Li) ec6a3163b7 [Feature] Add FP4 KV Cache Design and support SM120 GPUs (#21601) 2026-07-17 14:49:43 -07:00
Brayden ZhongandBrayden Zhong 7fc3fb9657 Remove deprecated Mamba flags from doc, wrong FP8 GEMM docstrings and change Nemotron image to 0.5.15 (#31094) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-07-17 14:34:29 -07:00
sglang-bot c00206c68c chore: bump sgl-kernel version to 0.4.5 (#31496) 2026-07-17 14:00:55 -07:00
Douglas YangandClaude Opus 4.8 ae3f62613a docs(cookbook): fix stale/pruned Docker image tags (#31508) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 13:24:46 -07:00
Liangsheng Yin 2c856abbe3 [Fix] Enable chunked input-logprob processing by default to cap peak memory (#31498) 2026-07-17 13:19:03 -07:00
Andy Ye d389039337 [diffusion] Opt in Qwen and Wan multi-output conditioning expansion (#31233) 2026-07-17 12:00:23 -07:00
fanxingranandkk fec6131844 [AMD] Disable DSA fused top-k v2 on ROCm for GLM-5.x / DeepSeek-V3.2 (#30506) 
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
 2026-07-17 10:22:14 -07:00
Muhammad Safiullah MemonandMuhammad Safiullah 2db21daf8d Fix Heartbeat Checker in KV Manager Disaggregation (#31584) 
Co-authored-by: Muhammad Safiullah <muhammadsafiullah136@gmail.com>
 2026-07-18 01:21:50 +08:00
Zhaoyi LiandMichael 2c64b7782e [AMD][PD] Fix early-send cached-prefix KV racing the prefill forward on mori (#31368) 
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
 2026-07-17 10:08:04 -07:00
Bingxu Chen 53229e88da [AMD] Fix stale imports in test_fused_fp8_kv_write.py (#31515) 2026-07-17 09:03:44 -07:00
Michael c546afc147 [AMD] Register 2 CPU/triton unit + kernel tests for AMD 1-GPU PR CI (#31379) 2026-07-17 09:01:46 -07:00
NOOBandR0CKSTAR 5e7eed4c00 [MLX] Honor --max-running-requests in the model runner stub (#30547) 
Co-authored-by: R0CKSTAR <yeahdongcn@gmail.com>
 2026-07-17 08:24:00 -07:00
Mick 85ac56c823 docs: simplify diffusion new model guide (#30109) 2026-07-17 19:39:38 +08:00
Mick 681c223570 refactor: wrap split backends once on full-attention backends (#31439) 2026-07-17 19:15:04 +08:00
Mick 24a8944e15 fix: enable Kimi multimodal breakable prefill cuda graph replay (#31391) 2026-07-17 19:13:54 +08:00
DarkSharpnessClaude Fable 5root
 		132ade55cd [Kernel] Rewrite JIT custom all-reduce (v2) with a decoupled kernel/storage design (#31049) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: root <root@GPUC5A6.maas>
 2026-07-17 18:37:22 +08:00
Baizhou Zhang eaeb779ea4 [Doc] Update GLM5.2 Cookbook with LayerSplit usage (#31577) 2026-07-17 02:25:50 -07:00
Liangsheng Yin 19f4859b30 [CI] Exclude current process memory from GPU idle check (#31571) 2026-07-17 02:11:41 -07:00
zijiexiaandClaude Fable 5 8f765bc1c9 [Docs] Inkling cookbook: mark B300/GB300 recipes verified, tune B300 MTP mem fractions (#31550) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-17 16:07:09 +08:00
Mohammad Miadh AngkadandBrayden Zhong d67aa05697 Bump FlashInfer to 0.6.15 and revert regressions (#31502) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2026-07-17 00:50:12 -07:00
Baizhou Zhang e835512303 Add nightly test for GLM5.2 LayerSplit (#31512) 2026-07-17 00:29:14 -07:00
Xiaoyu ZhangandClaude Opus 4.8 619609aa5a [Kernel] Simplify sglang.kernels tests to idiomatic pytest style (RFC #29630) (#31546) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 15:06:26 +08:00
huangtingweiandZhangheng 44e3dd2713 [HiCache] Optimize HiCache host pool free-list release (#30658) 
Co-authored-by: Zhangheng <hzh0425@apache.org>
 2026-07-17 14:52:08 +08:00
Liangsheng Yin 6e3be088a9 [Spec] Allocate the verify tree-mask scratch on the target backend only (#31527) 2026-07-16 23:23:21 -07:00
Junlin Wu bbd2a3fe4a ✨ [llm][npu][quant] Add W4A4 MXFP4 quantization support for Qwen3 Dense on Ascend NPU (#23795) 2026-07-17 09:06:30 +03:00
Xiaoyu ZhangandClaude Opus 4.8 1ac1ffea0c [Kernel] Fill non-CUDA coverage: HIP (aiter/rocm-triton) + Ascend NPU backends (RFC #29630) (#31307) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 14:05:35 +08:00
NOOB 444bbd866d [CI] Fix invalid suite name breaking all PR test lanes (#31539) 2026-07-16 22:30:05 -07:00
Khoa PhamandCursor 96dd96c02b [DCP] Auto-disable tc_piecewise and breakable prefill CUDA graphs under DCP (#31532) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-07-16 22:17:50 -07:00
Khoa Phamandkpham-sgl d310fce85f [Fix] Update PR #25015 revert for fused topk=1 draft postprocess (#31519) 
Co-authored-by: kpham-sgl <kpham-sgl@users.noreply.github.com>
 2026-07-16 21:51:16 -07:00
Khoa Phamandkpham-sgl ead703815e [DCP] Enable decode context parallel for Kimi K2.5 NVFP4 (#31514) 
Co-authored-by: kpham-sgl <kpham-sgl@users.noreply.github.com>
 2026-07-16 21:50:42 -07:00
AuFlowandAuFlow bf417440e9 [Scheduler] Add SGLANG_MAX_NEW_TOKENS_LIMIT to cap per-request max_new_tokens (#22591) 
Co-authored-by: AuFlow <AuFlow@users.noreply.github.com>
 2026-07-16 21:34:10 -07:00
Liangsheng Yin 45824c69ca fa3: build the topk>1 verify replay page table on-device (#31381) 2026-07-16 21:21:01 -07:00
Liangsheng Yin 27ad9d11b1 [CI] Wait for GPU memory release before each test class setUpClass (#31509) 2026-07-16 21:06:29 -07:00
Peng Xingchen 12af7e6c34 [NPU] Fix DSA top-k seed buffer shape for MTP IndexShare (#31005) 2026-07-17 12:05:57 +08:00
Liangsheng Yin dfa6278370 [Fix] Publish idle scheduler metrics immediately when the running-reqs gauge is stale (#31517) 2026-07-16 21:04:10 -07:00
Ma Mingfei 486a56be56 [CPU] improve silu performance by replacing fp32 div with rcp14 (#31304) 2026-07-17 12:02:37 +08:00
Duyi-Wang 27a52d2530 [Docs] Tune DeepSeek-V4 HiCache for MI355X PD (#31452) 
Signed-off-by: Duyi-Wang <duyi.wang@amd.com>
 2026-07-17 11:50:58 +08:00
zijiexiaandClaude Fable 5 40a3bd7659 [Docs] Mistral Medium 3.5 cookbook: replace stale day-0 dev images with latest (#31507) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-07-16 20:19:01 -07:00
monkeyLoveding 7355e0cb87 [NPU] custom-ops adapt (#30731) 2026-07-17 10:39:00 +08:00
Liangsheng Yin 9910ef8167 flashmla: sync-free spec via device-side draft-extend (#31090) 2026-07-16 19:38:12 -07:00
Xiaoyu ZhangandClaude Opus 4.8 8432eafd3d [Kernel] Decouple KernelBackend from device + device-based CapabilityRequirement (RFC #29630) (#31292) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-07-17 10:35:34 +08:00
amote-i 68d324d697 [PD] Fix send_multipart blocking after prefill failure (#31306) 2026-07-17 10:33:29 +08:00
Sam Shleifer 0675d3033f Fix mamba track-boundary seqlen under overlap scheduler (#31369) 2026-07-17 10:22:07 +08:00
Polisetty V R K Jyothendra VarmaandRahul Vijayaraghavan 37f94cb7a0 [Intel GPU] DeepSeek V4 13/N: use sgl-kernel implementation of kernels in V2 Compressor to run on XPU (#28439) 
Signed-off-by: P V R K Jyothendra Varma <polisettyvarma@gmail.com>
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
Co-authored-by: Rahul Vijayaraghavan <rahul.vijayaraghavan@intel.com>
 2026-07-17 09:16:04 +08:00
ZiruandNiu Ziru 302c3b97d2 fix: Qwen3.5-35B-A3B-AWQ w2_weight KeyError and related params for CPU (#31174) 
Co-authored-by: Niu Ziru <niuziru@a4bf018d3341.jf.intel.com>
 2026-07-17 09:14:55 +08:00
jiayisunx 27ea5ed070 [XPU] Fix dtype mismatch in MRotaryEmbedding.forward_xpu by calling _… (#31441) 2026-07-17 09:14:25 +08:00
Kaixi dc0b3eb68f [2/3] [EAGLE] perf: Fuse TP vocab-parallel embedding (#30948) 2026-07-16 15:57:51 -07:00
Kaixi d539bf2cda [1/3] [EAGLE] perf: Fuse topk=1 draft postprocess (#30947) 2026-07-16 15:57:27 -07:00
Yoray Zack 77d23a796e [1/N] elastic-ep: Add runtime EP scale-up (#30164) 2026-07-16 15:53:44 -07:00