minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
13,764 Commits 2 Branches 0 Tags
2218622f50f7a755aca20e470c6794ffa9de9322
Commit Graph
9268 Commits
Author SHA1 Message Date
gq112gsshnyls2002Liangsheng Yin
 		2218622f50 Fix spec v2 stop output boundary (#25980) 
Co-authored-by: gss <2783977641@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-06-09 00:32:21 -07:00
Zaili Wang d981b7b9c4 [Fix] Avoid applying cuda graph input-buffer registry on non-cuda devices (#27549) 2026-06-09 00:24:55 -07:00
Mohammad Miadh Angkad a287ab83c0 Fix Gemma4 NVFP4 MoE default attention backend (#26791) 2026-06-09 14:33:08 +08:00
Yi Xiexythinkhnyls2002Liangsheng Yin
 		d145a6127a fix: stop-string check misses early matches during speculative decoding (#23802) 
Co-authored-by: xythink <xythink@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-06-08 23:25:58 -07:00
LJL36andZhangheng 991689fd0d fix(hiradix): wait for extra pool IO (#27550) 
Co-authored-by: Zhangheng <hzh0425@apache.org>
 2026-06-09 14:17:36 +08:00
Erik Wijmans dff695c76b [lora] Exclude finished requests from running_loras (#27597) 2026-06-08 23:05:43 -07:00
Khoa PhamandCursor 9a3e845fc1 [Spec] Add nvtx to spec regions (#27615) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-06-08 22:58:03 -07:00
Fenglin Yudreamyang-liuXiaole Guozhaochenyang20Xiaole GuozhihengyMikukuOvO
 		5c0b2859e8 [diffusion] rl: extract post-training weight apis into mixins and add tensor update/checker paths (#22817) 
Co-authored-by: dreamyang-liu <nikolaliu@icloud.com>
Co-authored-by: Xiaole Guo <vera0315@connect.hku.hk>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: Xiaole Guo <119391905+gxlvera@users.noreply.github.com>
Co-authored-by: zhihengy <zhihengy@andrew.cmu.edu>
Co-authored-by: MikukuOvO <MikukuOvO@users.noreply.github.com>
 2026-06-09 13:57:47 +08:00
Liangsheng Yin cae022aa88 [JIT] Reuse JIT kernel build cache across CI runs (#27605) 2026-06-08 22:14:48 -07:00
Michael a32aeb688a [AMD] Fix AttributeError in GeneratedSharedPrefixDataset.from_args for in-process callers (#27580) 2026-06-08 21:53:14 -07:00
Caio RochaCaio Rochaempyreus
 		c2eae96c56 MSCCL++ Integration (#22734) 
Co-authored-by: Caio Rocha <caiorocha@microsof.com>
Co-authored-by: empyreus <rjsouza1995@gmail.com>
 2026-06-08 21:13:13 -07:00
Jan BernlöhrandXueLiang Yang 15c801f726 fix(server): clamp piecewise_cuda_graph_max_tokens to context_length (#22516) 
Co-authored-by: XueLiang Yang <102161631+xueliangyang-oeuler@users.noreply.github.com>
 2026-06-08 19:43:54 -07:00
jianan-guandMa Mingfei db143e5212 [Intel GPU][Encoder] Add xpu_attn backend for encoder vision attention (#26460) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-06-09 09:47:44 +08:00
Juan MunetonClaude Opus 4.7gemini-code-assist[bot]Yao Matrix
 		ea66b2cca7 [XPU] Enable NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 on Intel XPU backend (#24390) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Yao Matrix <matrix.yao@intel.com>
 2026-06-09 09:46:12 +08:00
Cao E 71e8258783 Improve registration in cpu_graph_runner (#26635) 2026-06-09 09:35:33 +08:00
Polisetty V R K Jyothendra Varma d7c8b9ab9f [Intel GPU] Enable fused_experts in fp8.py for quantized models on XPU (#27533) 
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
 2026-06-09 09:22:30 +08:00
Estrella-xx 6abef38627 [NPU]adaptation to support deterministic inference (#21197) 2026-06-09 09:22:09 +08:00
Jianhong Zhang ab70153b62 [XPU][NIXL] Use uint64 for XPU address arithmetic in prep handle builders (#27415) 2026-06-09 09:18:36 +08:00
Liangsheng Yin 3fe6bc390b [Spec] Naming cleanup: contiguous draft-loc kernel + accepted->accept (#27599) 2026-06-08 15:04:58 -07:00
Khoa Pham c95179bc85 [Spec] Fuse small kenrels under gather_spec_extras (#27233) 2026-06-08 15:02:04 -07:00
Liangsheng Yin b5c64b94d5 [Spec] Rename token resolver to _resolve_spec_v2_tokens; remove dead V1 helpers (#27552) 2026-06-08 14:42:21 -07:00
YAMYandYuwei An ca66e6fb5e [BCG] Support breakable CUDA graph for DeepSeek V4 DP attention (#25195) 
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
 2026-06-08 13:54:58 -07:00
Mohammad Miadh Angkad dc24a26821 Fix GPT-OSS MXFP4 hidden size reshape on SM10X (#27528) 
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
 2026-06-08 13:26:54 -07:00
Liangsheng Yin 28c1a3cb45 [Spec] Deprecate Spec V1 (#25464) 2026-06-08 13:10:27 -07:00
Xinyu JiangZhiyao JiangThomas Wang
 		ea1d190ed0 [ROCm] dsv4: remove the redundant fp8 scale transpose-copy on decode (#27289) 
Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
 2026-06-08 11:49:34 -07:00
Lianmin Zheng fca4ef9d69 Fix SWA pool resolution for EAGLE draft workers (#27491) 2026-06-08 11:00:29 -07:00
Lianmin Zheng bcb5645629 Fix TRTLLM target verify query metadata (#27495) 2026-06-08 10:58:48 -07:00
Yihao WangClaude Opus 4.8sjmshshMick
 		32bedbf88e [diffusion] model: support SANA-WM with streaming support (#27531) 
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: sjmshsh <88866917+sjmshsh@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-06-09 01:10:14 +08:00
MARATRIX 61e4132bc2 [MUSA] bump torchada version to 0.1.59 and workaround PCG limitation. (#27537) 
Signed-off-by: yafeng.li <yafeng.li@mthreads.com>
 2026-06-08 08:45:39 -07:00
Stella-17andxinyue.fan 12de907bc2 [MUSA][23/N] CI: Fix torchada preflight lock cleanup and add LLM server smoke test (#27242) 
Co-authored-by: xinyue.fan <xinyue.fan@mthreads.com>
 2026-06-08 08:45:16 -07:00
Leon Gao eb646c7b78 [srt] Add sglang:weight_load_duration_seconds gauge with source label (#27363) 2026-06-08 23:41:54 +08:00
Elizaveta Martirosiangithub-actions[bot]Elizaveta Martirosianronnie_zheng
 		40030d8af8 [NPU] Add GitHub test summary and deduplicate test code. Part 2 (#24689) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Elizaveta Martirosian <elizaveta.martirosian@gmail.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-06-08 18:08:45 +03:00
Vladislav Nosivskoy 62c505a196 [HiCache][Dsv4] Don't cache C128 State pool in L3 (#27293) 2026-06-08 21:23:26 +08:00
Brian Chao b0cd533a96 [diffusion] feat: progressive resolution growing for image and video models (#27524) 2026-06-08 20:44:07 +08:00
Zhangheng 1ff7c627cd [UnifiedTree]: Support hicache metrics (#27554) 2026-06-08 20:18:02 +08:00
Shangming Cai 6394a8b381 [EPD] Dynamic encoder registration cleanup (#27542) 2026-06-08 19:08:29 +08:00
Yaochen Hanandronnie_zheng 1f5dc2cdca [GPTQ] Refactor CPU quantization schemes (#26786) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-06-08 13:14:40 +03:00
YC Yen-Ching Tseng a26587dd4e [AMD][diffusion] Add FlyDSL fused normalization kernels for ROCm diffusion models optimization (#22786) 2026-06-08 02:42:39 -07:00
Liangsheng Yin 57ea09badb Fix NaN in triton EAGLE spec-v2 draft-extend CUDA graph at topk>1 (wrong qo_indptr stride) (#27545) 2026-06-08 02:28:48 -07:00
Shangming Cai 8ff0c9fef9 [PD] Downgrade propagated rank failure logs from error to debug (#27534) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-06-08 16:56:46 +08:00
Ke Bao d03182cd2d Fix TP deadlock in unified radix cache writing_check / loading_check (#27489) 2026-06-08 16:08:47 +08:00
siyu 13dda3b8de [EPD] Support dynamic encoder register (#22253) 2026-06-08 16:05:16 +08:00
Niko Ma 18d728967a [PD][MoRI] Drive KV transfers with a sharded synchronous worker pool (#26922) 2026-06-08 00:49:25 -07:00
Jan BernlöhrandClaude Opus 4.6 0d0254c9de Fix port overflow in DP attention path when base port is near 65535 (#20260) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-06-08 00:39:29 -07:00
fzyzcjy 71a0b10462 Fix the _chunked_req_scheduled_last_iter flag with a content-based stash gate (#26938) 2026-06-08 14:55:41 +08:00
fzyzcjy f746e4a608 Fix fill_len asymmetric assignment statement in ignore-eos branch (#26999) 2026-06-08 14:53:21 +08:00
fzyzcjy 9034c2f9ae Fix Req fill_len (fill_ids) having dual semantics by restricting to truncated/committed semantics (#26659) 2026-06-08 14:52:48 +08:00
fzyzcjy 259a2da3e0 Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637) 2026-06-08 14:52:18 +08:00
fzyzcjy 4201de11de Extract release_req and retract_all as module-level free functions (#26548) 2026-06-08 14:51:45 +08:00
fzyzcjy 3197808283 Avoid calling filter_batch with chunked_req_to_exclude being things unrelated to chunked reqs (#26547) 2026-06-08 14:51:21 +08:00