minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,704 Commits 2 Branches 0 Tags
29f56cb2304bf6699da78e4e5a738fb794babcfd
Commit Graph
2322 Commits
Author SHA1 Message Date
Xinyuan Tong 082eaed0a4 test: fix flaky required function calling assertion (#22890) 2026-04-16 09:44:26 -07:00
Zhangheng 14bcdfca21 [HiSparse]: Adding e2e ut for hisparse (#22979) 2026-04-16 23:20:07 +08:00
Liangsheng Yin bbd8f9ba09 migrate CPU-only unit tests from openai_server to unit/ (#22965) 2026-04-16 03:53:33 -07:00
ybyang fbd6dc3565 fix: normalize tool message content for GLM5.1 chat template (#22595) 2026-04-16 16:48:38 +08:00
Xinyuan Tong 34fef07a15 Upgrade transformers to 5.5.3 and refactor hf_transformers_utils into subpackage (#21569) 2026-04-15 20:03:44 -07:00
Liangsheng Yin a4cf2ea128 streaming session: spec v2 bonus accounting + comprehensive test matrix (#22651) 2026-04-15 17:12:41 -07:00
Liangsheng Yin f9792166c3 trim_overshoot: cap swa_evicted_seqlen + unit test (#22900) 2026-04-15 15:05:35 -07:00
Xinyu Zhangandxyuzh 13a2cd748d [Ray] Add data parallel (DP) and DP attention support to RayEngine (#21887) 
Co-authored-by: xyuzh <xyuzh@users.noreply.github.com>
 2026-04-15 15:00:48 -07:00
Sundara Raman Ramachandran 4927975427 [Score API] Add return_pooled_hidden_states to Scoring API for SequenceClassification / RewardModel (#22427) 2026-04-15 14:58:56 -07:00
Kurt Shuster 32d9fe5a32 [lora] Speedup triton backend sgemm calls with better grid (#22386) 2026-04-15 13:47:07 -07:00
Liangsheng Yin aa78564e1a Refactor streaming session abort handling (#22790) 2026-04-15 00:13:05 -07:00
Michael 39c6bf730c [AMD][CI] Add GLM-5-MXFP4 accuracy and perf nightly tests for MI35x (#21773) 2026-04-14 18:55:36 -07:00
Ke Bao 3c0a6c6987 Add page_size and SWA coverage to unified radix cache bench test (#22815) 2026-04-14 23:58:05 +08:00
Bi Xue 070c6a2489 [sgl] perf optimization for eplb (#21232) 2026-04-14 22:52:17 +08:00
Ke Bao 9f9e0231bb Refactor unified radix cache UT into parameterized test suite (#22812) 2026-04-14 22:34:33 +08:00
Jincong Chen 6760c790bd [bugfix] avoid attention padding tokens computation in pcg (#17706) 2026-04-14 16:08:23 +08:00
MichaelandHaiShaw eab045b2b7 [AMD] Add MiniMax-M2.7 accuracy and performance nightly tests (#22722) 
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-04-14 00:30:11 -07:00
huangtingweihzh0425pansichengispobockVladislav Nosivskoy
 		e9d6b9eb2d [HiCache & HybridModel] mooncake backend support DSA & mamba model (#21259) 
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
 2026-04-13 18:47:36 -07:00
Liangsheng Yin 33a3ba256f Delete dead rematch path in SessionAwareCache.release_session (#22735) 2026-04-13 17:02:40 -07:00
Kurt ShusterandYusheng Su ff13dfee45 [lora][moe] Virtual experts for LoRA MoE (#22122) 
Co-authored-by: Yusheng Su <yushengsu.thu@gmail.com>
 2026-04-13 21:19:30 +00:00
Asish Kumar 39810762d2 fix: use describe mode for SGLang version detection (#22600) 
Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>
 2026-04-13 09:45:45 -07:00
Liangsheng Yin 9e6d1c066e TestStreamingSessionAbortLeakRepro: inherit stdout/stderr instead of tempfile (#22668) 2026-04-13 00:37:29 -07:00
Liangsheng Yin c775c31cb3 Simplify test_chunked_prefill; remove redundant tests (#22652) 2026-04-12 20:26:54 -07:00
Zhanghengispobockpansichengyizhang2077xiezhq-hermann
 		bc59cc0f96 [RaidxTree Refactor]: Support Unified HybridRadixTree V2 (#21206) 
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: xiezhq-hermann <xiezhq@stanford.edu>
 2026-04-13 10:28:22 +08:00
Ziang Li 5593539942 [RL] Refactor NVFP4 shuffling/swizzling to in-place replacement (#22204) 2026-04-12 19:08:45 -07:00
Liangsheng Yin da6b8e1448 Extract pause_resume_in_place kit; rename test_abort to test_scheduler_control (#22647) 2026-04-12 18:49:37 -07:00
Lawrence Wu 28e40d873c fix(PD): respect pause_generation in disagg event loops (#20908) 2026-04-12 18:07:51 -07:00
ishandhananiClaude Opus 4.6hnyls2002Liangsheng Yin
 		c1ab68b45e fix: streaming session race condition + some metrics (#21875) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-04-12 18:05:23 -07:00
Khoa PhamandClaude Opus 4.6 1f8df97054 Fix broken streaming response with --incremental-streaming-output (#22549) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-12 15:05:58 -07:00
Wenyao Gao 4dfc8e1c3f VLM: support passing --mm-process-config for all models (#18467) 2026-04-12 17:08:05 +08:00
Liangsheng Yin f1eb4ca90c Fix streaming session busy check double-counting; add compat CI tests (#22213) 2026-04-12 01:48:16 -07:00
Xinyuan Tong 3f60df8012 [Test] Fix flaky test_function_call_specific by adding strict=True (#22624) 2026-04-12 01:22:57 -07:00
Hubert LuandHAI edaa5973d4 [AMD][No-Merge] Simplify fused allreduce + RMSNorm and remove hidden_dim allowlist (#21986) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-04-11 23:47:08 -07:00
Alison ShaoandAlison Shao d6c9d9116b [CI] Update B200 est_times to prevent timeouts on slower machine (#22609) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-11 21:40:34 -07:00
Kurt Shuster 8da1cfb30d [lora][moe] Decoupled LoRA MoE backend with Marlin support (#21858) 2026-04-11 14:59:27 -07:00
Liangsheng Yin 7ab94e438c [Test] Fix flaky test_function_call_required by adding strict=True (#22586) 2026-04-11 02:14:22 -07:00
Baizhou Zhang d14d368191 [Kernel] Set sgl_per_token_group_quant_8bit_v2 as default choice (#22467) 2026-04-11 01:59:57 -07:00
cctryCheng WanCheng WanClaude Opus 4.6
 		f855a0bde6 Introduce CUDA graph debug mode with breakable CUDA graph (#19102) 
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-04-11 00:36:56 -07:00
YC Yen-Ching TsengandHAI 3ce72252de [AMD] Fix Timeout: stage-b-test-2-gpu-large-amd,stage-b-test-1-gpu-large-amd (#22228) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-04-10 22:55:44 -07:00
Khoa PhamandClaude Opus 4.6 04bd8e1218 [Spec][Ngram] Return token counts in list_external_corpora API (#22471) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-10 21:50:02 -07:00
Baizhou ZhangandClaude Opus 4.6 3c46ff2ac5 fix: restore CPU flash_attn test to use sgl_kernel directly (#22573) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-10 21:39:20 -07:00
Alex NailsandClaude Opus 4.6 8eac618a8d [tokenizer] lazy text accumulation + use deltas directly for streaming (#22548) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-10 21:26:04 -07:00
Xinyuan Tong 7c6db40540 Fix tool call constrained decoding and parsing for models with native formats (#21593) 2026-04-10 20:37:23 -07:00
Liangsheng Yin c2821dfbe9 [mem] Introduce PoolStats dataclass; unify pool metrics and token_usage (#22554) 2026-04-10 20:35:50 -07:00
Liangsheng Yin 6cd183ff6b Remove redundant test_page_size.py (#22571) 2026-04-10 20:35:04 -07:00
sglang-botCheng Wansglang-botCheng Wan
 		265696b176 chore: update CI test est_time values (#22565) 
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2026-04-10 18:15:02 -07:00
Alex Nails 0af9166474 [tokenizer] improve non streaming request processing + some small fixes. (#20310) 2026-04-10 15:46:12 -07:00
satyamk7054andSatyam Kumar 059b287e25 Add offline auto-tuning for LoRA CSGMV kernel (#20391) 
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
 2026-04-10 13:10:43 -07:00
Qiaolin Yuand0xNullPath d8831355a3 Fix multi_layer_eagle_worker_v2 draft extend selection, add chain style multi layer mtp test (#22340) 
Co-authored-by: 0xNullPath <luyan@nvidia.com>
 2026-04-10 12:44:52 -07:00
Trevor Morris 7dbd0dd9f0 MiniMax-M2.5 - Support dp attention, dp reduce scatter, FP4 all gather, AR fusion in prepare_attn (#20067) 2026-04-10 12:41:27 -07:00