minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
12,520 Commits 3 Branches 0 Tags
10375a103774df29ec221a6b59cd7ade052d09ea
Commit Graph
2503 Commits
Author SHA1 Message Date
Liangsheng Yin f3a8189e20 [Spec] Internal rename per N2 v2 naming rule (#25014) 2026-05-11 18:16:26 -07:00
Ethan (Yusheng) SuCursorClaude Opus 4.7
 		e9dea79755 (3/n - prefill optimize)[LoRA][MoE] Optimize virtual experts: remove CPU-GPU sync & multi-block CUDA JIT histogram (#24262) 
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-11 16:36:57 -07:00
Liangsheng Yin ce1736fcc6 [Spec] Remove dead kernel params; fix stale comment in trtllm_mla (#25010) 2026-05-11 14:50:46 -07:00
Jia Guo da0eeb82f2 perf: add --prefill-only-disable-kv-cache to skip KV pool allocation (#23675) 2026-05-11 13:10:24 -07:00
Yan Ru Pei 4b6f776889 feat(kv-events): publish SWA radix cache events (#24718) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-05-11 10:31:45 -07:00
TianheandClaude Sonnet 4.6 95985f983d feat(trace): support SGLANG_TRACE_LEVEL env var for startup trace level (#24716) 
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-05-11 10:31:03 -07:00
Ke Bao 36ba60ad49 Register SWA unit tests under unit/mem_cache (#24974) 2026-05-11 20:21:05 +08:00
Cheng WanandClaude Opus 4.7 044bb88a97 fix: SGLANG_RADIX_FORCE_MISS chunk-cache passthrough (#24950) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-11 00:07:46 -07:00
Bingxu ChenandCursor Agent 22543b1982 [AMD] DSv4 nightly hotfix + schedule-aware --continue-on-error in AMD CI (#24825) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2026-05-10 21:46:32 -07:00
Byron HsuByron HsuCursorzyzshishuiYuzhen Zhou
 		d82e339ce2 [Session R3] Add routed_experts_start_len for absolute routing slice control (#24851) 
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
Co-authored-by: Yuzhen Zhou <82826991+zyzshishui@users.noreply.github.com>
 2026-05-10 10:04:43 -07:00
Yuan Luoandluoyuan.luo d3fd91ed97 [Gemma4] Optimize Gemm4 with fused Q/K/V RMSNorm + per-expert FP8 ckpt loader (#24696) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-05-10 00:24:12 -07:00
Baizhou ZhangXinyuan Tongyueming-yuan
 		ef5e9f8aba [DSV4] Cherry pick missing commits from deepseek_v4 branch and enhance tests (#24793) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
 2026-05-09 04:15:37 -07:00
Brayden Zhongandb8zhong 8f33bee31b Reland Cute-DSL FP4 dense GEMM (#23590) 
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
 2026-05-09 02:20:58 -07:00
shuwennandClaude Opus 4.7 9d12f9e6fa [HiCache] ci: lower est_time for test_hicache_spec_file_storage (#24713) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-09 00:33:18 -07:00
Khoa Pham 1610aa77ab Reduce gemma4 moe deterministic test runtime (#24754) 2026-05-08 20:46:56 -07:00
Liangsheng Yin 44a527f6f4 fix patch_torch test queue race (#24739) 2026-05-08 20:25:59 -07:00
Liangsheng Yin 1613bae412 [Spec] Disambiguate verified_id into bonus_token(s) / accept_tokens (#24724) 2026-05-08 18:24:33 -07:00
Cheng Wansihan-zzzClaude Opus 4.7
 		d1c5937428 env: add SGLANG_RADIX_FORCE_MISS to force radix prefix-cache miss (#24726) 
Co-authored-by: sihan-zzz <228612289+sihan-zzz@users.noreply.github.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-08 17:46:38 -07:00
YAMY 560829a171 feat(scheduler): add adaptive queue-based prefill delayer trigger (#23189) 2026-05-08 16:54:30 -07:00
YAMY 6971a03fe6 fix(fa3): skip scheduler_metadata precompute under DP attention (#24632) 2026-05-08 16:19:20 -07:00
Niko Ma 62c2e091f6 [PD] MORI-IO: Add state transfer, inline transfer model, and high-concurrency fixes (#22665) 2026-05-08 16:07:22 -07:00
Michael 190b15c8fe [AMD] Register 8 CPU-bound unit tests for AMD 1-GPU PR CI (#24569) 2026-05-08 16:01:58 -07:00
Alison Shao 5fbec0e445 ci: prune per-commit CUDA tests — move 25 files + 13 testcases to test/manual/ (#24721) 2026-05-08 15:53:23 -07:00
Jimmy Shongandgemini-code-assist[bot] fa8985486e [test/fix]: isolate VLM MMMU eval output dirs to fix nightly-4-gpu cross-test pollution (#24623) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-05-08 15:01:53 -07:00
Jimmy Shong 096ad02b06 [Model] Laguna-XS.2 Model Support (#24204) 2026-05-09 05:43:13 +08:00
Ethan Feng 672f778512 [NemotronH] Fix expert scale weight loading (#24434) 2026-05-08 12:37:06 -07:00
zhongdaor-nvandzhongdaor-nv 2cf1a4ab38 feat: Add KV events for Mamba radix cache (#23678) 
Signed-off-by: zhongdaor-nv <220807034+zhongdaor-nv@users.noreply.github.com>
Co-authored-by: zhongdaor-nv <220807034+zhongdaor-nv@users.noreply.github.com>
 2026-05-08 11:53:36 -07:00
Xu Zouandxz-keg ca7a8cc61d [Bugfix] Fix a bug causing NVFP4 to be tested on all gpus like SM90 devices. (#24604) 
Co-authored-by: xz-keg <xuzou_keg@outlook.com>
 2026-05-08 11:51:30 -07:00
HAI 73792629d4 [AMD] Intro SGLANG_DIFFUSION_AITER_FP8_ATTN (#24677) 2026-05-08 01:31:00 -07:00
jacky.cheng 76a1f169b3 [AMD] Add AMD FP8 MLA attention test for Wan2.2-T2V-A14B (#23955) 2026-05-08 01:03:51 -07:00
shuwennandQiaolin-Yu d9dddd4d7d [SPEC V2][2/N] feat: adaptive spec support spec v2 (#23336) 
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
 2026-05-07 18:33:47 -07:00
+6
Liangsheng YinBaizhou ZhangClaude Opus 4.7fzyzcjyispobockZhiqiang Xieyueming-yuanDarkSharpnessYuhao Yangyhyang201yhyang201Qiaolin YuEthan SuMingyiCheng WanYihao Wang
 		35870d55ac Deepseek V4 (#23882) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com>
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com>
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com>
 2026-05-07 18:32:21 -07:00
Mandepudi Rani ChowdaryandMa Mingfei 55224fff08 Add Arm64 CPU Phase 1A CI bootstrap (#22123) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-05-08 09:28:23 +08:00
Baizhou Zhang c4bb3ce273 Fix stuck when enabling MTP on DSA models (#24635) 2026-05-07 17:06:28 -07:00
Liangsheng Yin 95fb722dd2 Add registry for custom speculative algorithms (#23991) 2026-05-07 16:11:45 -07:00
Xinyuan Tong 5b589ed2e7 feat(constrained): two-phase reasoning grammar + --enable-strict-thinking (#23953) 2026-05-07 14:21:51 -07:00
Xinyuan Tong af2a2ac618 fix(function_call): handle Kimi-K2.5 bare numeric tool call IDs (#23950) 2026-05-07 14:20:02 -07:00
Xinyuan Tong d8f9d32a05 feat(reasoning): auto-detect reasoning/tool-call parser from chat template (#23952) 2026-05-07 14:19:16 -07:00
Xinyuan Tong f1395af543 fix(openai): map reasoning.enabled to thinking AND enable_thinking (#23951) 2026-05-07 14:01:35 -07:00
McZyWuandsglang-npu-bot 7d397ad23d [NPU]Support model Trinity-mini for Npu, accuracy 90% (#18172) 
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
 2026-05-07 20:58:18 +03:00
Vladimir Serovandronnie_zheng 263cb3b222 [LoRA] Torch Native enhancement: embedding and graph optimization (#21885) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-05-07 17:28:38 +03:00
fzyzcjy 9ba4aac47b Fix weight_checker e2e OOM on 32GB GPU + move to nightly (#24559) 2026-05-06 21:06:04 -07:00
Baizhou Zhang ecb786c8d7 [Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268) 2026-05-06 18:59:01 -07:00
Liangsheng Yin eaf074d50e propagate pytest exit code from test __main__ entries (#24487) 2026-05-06 18:46:52 -07:00
huangtingwei 27445f9836 Add ChatCompletionRequest-style support to /v1/tokenize (#23981) 2026-05-06 18:35:20 -07:00
Baizhou Zhang 9e1336d406 [Misc] Fix breaking weight checker test (#24553) 2026-05-06 15:42:54 -07:00
Alison Shao e72246c6e6 ci: bump test_mimo_models.py est_time 330 → 610 (#24551) 2026-05-06 14:35:43 -07:00
jsheng_LinkedinandClaude Opus 4.7 bc70488695 [CI] Temporarily disable marco/mcdse-2b-v1 in test_embedding_models (#24279) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-06 14:28:39 -07:00
Lianmin Zheng b859f7ffba Improve metrics, observability, and PD deploy tooling (#24521) 2026-05-06 11:27:35 -07:00
fzyzcjy c4c5541618 Support getting checksums in weight checker (#24537) 2026-05-06 22:59:28 +08:00