minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity
11,550 Commits 2 Branches 0 Tags
bc1bfbf607704ac76016057491b1b2aabf3cc0ef
Commit Graph
11550 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ke Bao bc1bfbf607 Fix swa input length limitation (#22597) 2026-04-12 16:03:35 +08:00
Liangsheng Yin f2377a00cb Add SWA support for runtime busy memory check (#21499) 2026-04-12 00:39:51 -07:00
wufann 19cb918653 [Not-Merge][AMD] GLM-5 performance optimization (#21166) 2026-04-11 23:58:11 -07:00
Hubert LuandHAI edaa5973d4 [AMD][No-Merge] Simplify fused allreduce + RMSNorm and remove hidden_dim allowlist (#21986) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-04-11 23:47:08 -07:00
Xinyuan Tong 9a4e8089ff [Whisper] Batch encoder forward for concurrent prefill requests (#22361) 2026-04-12 14:15:14 +08:00
Zhai Feiyue 52750129ef fix prefill tps log accuracy (#22497) 2026-04-11 23:07:30 -07:00
Alex NailsandClaude Opus 4.6 c6fd9a00c7 [tokenizer] eliminate O(n²) copy in non-incremental streaming (#22567) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-11 23:05:36 -07:00
Prozac614daiweitaoSGLang CI
 		45472d70cc [diffusion] CI: dynamic load-balanced partitioning for diffusion CI (#15528) 
Co-authored-by: daiweitao <dwti614707404@163.com>
Co-authored-by: SGLang CI <ci@sglang.ai>
 2026-04-12 13:02:43 +08:00
Alison ShaoandAlison Shao d6c9d9116b [CI] Update B200 est_times to prevent timeouts on slower machine (#22609) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-11 21:40:34 -07:00
Alison ShaoandAlison Shao f21d23a211 ci: use local NVIDIA wheels to avoid re-downloading ~2GB every CI run (#22602) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-11 21:32:51 -07:00
Alison ShaoandAlison Shao 870a21bf39 [CI] Remove Slack bot from CI failure monitor (#21581) 
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
 2026-04-11 20:34:48 -07:00
Aurick Qiao cd2b2364ff [Bugfix] fix model_config deletion (#22281) 2026-04-12 11:24:26 +08:00
Baizhou Zhang 2e70e4f4f6 [CI] Little renaming of gb200 CI workflow (#22608) 2026-04-11 17:52:42 -07:00
Kurt Shuster 8da1cfb30d [lora][moe] Decoupled LoRA MoE backend with Marlin support (#21858) 2026-04-11 14:59:27 -07:00
Ziang Li 78043d4448 [Misc] [MXFP8] Drop sm100 mxfp8 warning (#21881) 2026-04-11 11:11:28 +00:00
Liangsheng Yin 61a62c6503 [mem] Flatten memory checkers into composable per-pool invariant checks (#22562) 2026-04-11 02:56:22 -07:00
dyhsup 8cca9747f5 [diffusion] model: support ERNIE-Image (#22439) 2026-04-11 17:18:11 +08:00
Liangsheng Yin 7ab94e438c [Test] Fix flaky test_function_call_required by adding strict=True (#22586) 2026-04-11 02:14:22 -07:00
Baizhou Zhang d14d368191 [Kernel] Set sgl_per_token_group_quant_8bit_v2 as default choice (#22467) 2026-04-11 01:59:57 -07:00
heziiop 4f45472f34 [NPU][Doc] add qwen3-30b-a3b low latency example (#22446) 2026-04-11 15:52:47 +08:00
cctryCheng WanCheng WanClaude Opus 4.6
 		f855a0bde6 Introduce CUDA graph debug mode with breakable CUDA graph (#19102) 
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-04-11 00:36:56 -07:00
Liangsheng Yin d11da2403c Add hisparse staging + decode offload guards to is_fully_idle() (#22577) 2026-04-11 00:12:10 -07:00
sushil DubeyandMa Mingfei e26c73c4e9 [diffusion] platform: support Intel XPU (#17920) 
Signed-off-by: sushil.dubey <sushil.dubey@intel.com>
Signed-off-by: Sushil Dubey <sushil.dubey@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-04-11 15:09:02 +08:00
YC Yen-Ching TsengandHAI 3ce72252de [AMD] Fix Timeout: stage-b-test-2-gpu-large-amd,stage-b-test-1-gpu-large-amd (#22228) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-04-10 22:55:44 -07:00
YC Yen-Ching Tseng cf1436d6ae [AMD] Diffusion - Enabel rocm miopen tuning on vae (#22428) 2026-04-10 22:47:25 -07:00
Jacob0226andClaude Opus 4.6 7e4e1dcd7a [AMD] Fuse RMSNorm + FP8 per-token quant for GLM-4.7-FP8 (#21403) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-04-10 22:45:31 -07:00
Khoa Pham aeeff58cd4 [Spec][Ngram] Clean up unused stateless batchMatch (#22487) 2026-04-10 21:52:56 -07:00
Khoa PhamandClaude Opus 4.6 04bd8e1218 [Spec][Ngram] Return token counts in list_external_corpora API (#22471) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-10 21:50:02 -07:00
Baizhou ZhangandClaude Opus 4.6 3c46ff2ac5 fix: restore CPU flash_attn test to use sgl_kernel directly (#22573) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-10 21:39:20 -07:00
Zhangheng f2af00d05a [HiSparse-pd] Add device-buffer budget and fix logical pool admission in decode side (#22453) 2026-04-11 12:30:38 +08:00
Alex NailsandClaude Opus 4.6 8eac618a8d [tokenizer] lazy text accumulation + use deltas directly for streaming (#22548) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-10 21:26:04 -07:00
Liangsheng Yin c7f93a2ce7 [metrics] Add PoolStats.update_scheduler_stats to deduplicate metrics assignment (#22559) 2026-04-10 21:04:18 -07:00
Bi Xue d30b3efa84 [sgl] _ATTN_TP and _ATTN_CP use message queue for broadcast on CPU (#22205) 2026-04-10 20:52:49 -07:00
Xinyuan Tong 7c6db40540 Fix tool call constrained decoding and parsing for models with native formats (#21593) 2026-04-10 20:37:23 -07:00
Liangsheng Yin c2821dfbe9 [mem] Introduce PoolStats dataclass; unify pool metrics and token_usage (#22554) 2026-04-10 20:35:50 -07:00
Liangsheng Yin 6cd183ff6b Remove redundant test_page_size.py (#22571) 2026-04-10 20:35:04 -07:00
Yuhao Yang 16f306fd85 [VLM] GPU Image Preprocessing for Kimi-K2.5 (#22368) 2026-04-11 11:13:30 +08:00
Yilong Zhao 58f863956c cuda graph: adjust capture time num-non-padded-tokens to align capture with replay (#22404) 2026-04-11 10:27:50 +08:00
Mick 0b4f5c9fcb [diffusion] CI: improve readability and fix bug of early-return (#22507) 2026-04-11 10:08:44 +08:00
Qiaolin Yu f41c810a2d [misc] update CI_PERMISSIONS.json (#22570) 2026-04-10 18:58:55 -07:00
Bingxu Chen 213027951a [AMD] Upgrade Aiter (#22264) 2026-04-10 18:40:43 -07:00
sglang-botCheng Wansglang-botCheng Wan
 		265696b176 chore: update CI test est_time values (#22565) 
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2026-04-10 18:15:02 -07:00
Cheng Wan b5e4ae7b1a fix: match est_time updates by backend, not just suite (#22563) 2026-04-10 17:54:50 -07:00
Alison ShaoandAlison Shao 75223c5404 [Diffusion][CI] Fix nunchaku unit test broken by #22365 (#22560) 
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
 2026-04-10 17:49:56 -07:00
Cheng Wan 0011d2aec0 fix: track est_time per suite instead of per backend (#22557) 2026-04-10 16:58:40 -07:00
Liangsheng Yin b4a1d8fd71 [mem] Fix idle token_usage missing mamba_usage; add FIXME for naming (#22555) 2026-04-10 16:20:33 -07:00
Alex Nails 0af9166474 [tokenizer] improve non streaming request processing + some small fixes. (#20310) 2026-04-10 15:46:12 -07:00
Sahithi Chigurupati 451320596f [CI] Add GB200 nightly perf regression pipeline (#22461) 2026-04-10 15:12:24 -07:00
Cheng WanandClaude Opus 4.6 3f39b3d811 feat: add weekly workflow to update CI test est_time values (#22545) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-04-10 15:03:37 -07:00
oriandzhiguo.qin f7a1740101 [MUSA][9/N] Add FA3 attention backend support through MATE (MUSA AI Tensor Engine) (#22051) 
Co-authored-by: zhiguo.qin <zhiguo.qin@mthreads.com>
 2026-04-10 14:18:39 -07:00