minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
12,296 Commits 2 Branches 0 Tags
a965f886bf8eb0a1b29b39827433795a0ee76a81
Commit Graph
12296 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Qiaolin Yu a965f886bf [misc] update CI_PERMISSIONS.json (#24468) 2026-05-05 18:37:18 -07:00
Lianmin Zheng b91b05ae27 Add --random-input-len to send_one.py (#24464) 2026-05-05 17:49:33 -07:00
cctry 22cf7d2b42 [Fix] Handle nixlRemoteDisconnectError in NixlKVSender (#24296) 2026-05-05 17:23:42 -07:00
Lianmin Zheng 64f80eabbe Register aten::rms_norm and aten::mm.dtype in batch invariant mode (#24459) 2026-05-05 17:21:34 -07:00
Lianmin Zheng 46bde1f426 Add fwd_occupancy metric to SchedulerStats and Prometheus collector (#24458) 2026-05-05 17:04:34 -07:00
Xinyuan Tong 1e404afec2 fix(req_pool): bump pool.size to match actual tensor row count after #24243 (#24439) 2026-05-05 16:58:26 -07:00
Lianmin Zheng 710fed10fb Revert "[fix] /pause_generation and /continue_generation wrong for --tokenizer-worker-num > 1" (#24461) 2026-05-05 16:44:34 -07:00
maocheng23andCursor 431ca54334 [fix] /pause_generation and /continue_generation wrong for --tokenizer-worker-num > 1 (#24445) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-05-05 16:27:58 -07:00
sglang-botsglang-botBaizhou Zhang
 		6764155914 chore: bump sgl-kernel version to 0.4.2.post1 (#24457) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-05-05 16:19:58 -07:00
Liangsheng YinYueming YuanfzyzcjyZiang Li
 		08d4c2072b move topk capturers to srt/state_capturer/ (#24450) 
Co-authored-by: Yueming Yuan <yym022502@gmail.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
Co-authored-by: Ziang Li <ziangli@umich.edu>
 2026-05-05 15:54:01 -07:00
Liangsheng Yin 47a416fc62 add indexer-topk capture (V3.2 NSA + infra) (#24392) 2026-05-05 15:05:15 -07:00
zijiexia 83b48fd523 [codex] update Nemotron3 Nano Omni cookbook benchmarks (#23998) 2026-05-05 14:53:15 -07:00
zijiexia e0faed8ebc [Docs] Add B200, GB200, GB300 NVIDIA hardware platform support for Kimi-K2.6 (#24441) 2026-05-05 14:53:05 -07:00
Liangsheng Yin c4c0376fcb consolidate routed-experts capturer onto reusable base (#24403) 2026-05-05 12:41:49 -07:00
Xinyuan Tong 8d1b6f0c00 Add zRzRzRzRzRzRzR to CI permissions (#24432) 2026-05-05 12:37:50 -07:00
Mick d23ef408f7 [diffusion] fix: fix RowParallel LoRA merged forwarding (#24410) 2026-05-06 00:30:16 +08:00
Khoa Pham 932d89690a Gemma4-mtp cookbook (#24433) 2026-05-05 23:04:41 +08:00
Mick cc54d8e8d0 [diffusion] chore: clean CUDA cache only at explicit release points (#24397) 2026-05-05 22:30:43 +08:00
Polisetty V R K Jyothendra Varma fdfc46f3a5 [Intel GPU] Enable DeepSeek V3.2 inference on XPU (#24356) 
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
 2026-05-05 20:47:40 +08:00
Zhangheng e299ec1bff [UnifiedRadixTree]: Fix flaky ci (#24421) 2026-05-05 20:22:19 +08:00
Khoa Pham d22853480d Fix deterministic inference on models with SWAKVPool (#24395) 2026-05-05 20:20:46 +08:00
Bi Xue 9fb9a1cca6 [sgl] expose swa and mamba cache metrics (#24396) 2026-05-05 20:19:50 +08:00
Xiaoyu Zhang 67e8bd7a80 [codex] Optimize Helios fused norm modulation (#24059) 2026-05-05 19:28:37 +08:00
Xiaoyu Zhang 8c703f215e Add HunyuanVideo ModelOpt FP8 diffusion support (#23199) 2026-05-05 19:27:28 +08:00
billishyahao 80ccb6b93c [AMD] fix tbo specv2 seq_lens_cpu NoneType error (#24319) 2026-05-05 01:54:43 -07:00
Baizhou ZhangandClaude Opus 4.7 e0af36a907 [Fix] Fix pypi release workflow (#24417) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-05 01:21:06 -07:00
Mick 177babcc38 [diffusion] optimize: fuse LTX2 split rotary embedding (#24411) 2026-05-05 16:07:40 +08:00
YC Yen-Ching Tseng 64613543ea [AMD] fix(docker): unbreak nightly when archive.ubuntu.com:80 is unreachable (#24407) 2026-05-05 00:39:14 -07:00
Hubert Luwunhuangsogalin
 		c2db19ffa4 [AMD] Enable EAGLE speculative decoding for Qwen3.5 FP8 and MXFP4 models with aiter's unified attention (#23146) 
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: sogalin <39478626+sogalin@users.noreply.github.com>
 2026-05-05 00:09:40 -07:00
Michael 244531bc4f [AMD] Add Kimi-K2.6 in nightly tests for MI30x and MI35x (#23848) 2026-05-04 23:37:14 -07:00
Yuhao YangandClaude Opus 4.6 6279aee716 [docs] Update B300 Pro cookbook with accuracy-verified serving configs (#24367) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-05-05 07:26:03 +01:00
Mick 04926e1d9f [diffusion] feat: cache encoder results for default negative prompt (#24304) 2026-05-05 11:56:01 +08:00
Mick e483e60b72 [diffusion] CI: pin diffusion consistency GT revision (#24400) 2026-05-05 11:53:22 +08:00
Ethan (Yusheng) SuandCursor 2b769d37a4 (2/n - prefill optimize)perf(lora): remove GPU-CPU sync barrier (.item()) in MoE LoRA path and remove duplicate code (#24246) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-05-04 18:11:28 -07:00
Mick 2f7d99b7f7 [diffusion] cli: support component attention backend overrides (#24320) 2026-05-05 08:39:27 +08:00
Xiaoyu ZhangandBBuf Codex 078f84d80d [SKILL] Add diffusion benchmark presets for edit and Hunyuan3D models (#24288) 
Co-authored-by: BBuf Codex <bbuf-codex@users.noreply.github.com>
 2026-05-05 08:18:12 +08:00
Ji Zeng 4b487ca98b [Fix] NGRAMWorker.update_weights_from_tensor — delegate to target worker (#24344) 2026-05-04 16:23:17 -07:00
Liangsheng YinandZhiqiang Xie 6a62eabed6 consolidate NSA pool construction (#24389) 
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2026-05-04 16:04:31 -07:00
Tarushii Goel d7c93e183b [sgl] reduce specdec cpu overhead (#23321) 2026-05-04 15:02:03 -07:00
Liangsheng Yinandfzyzcjy 4743cf6051 misc: add marlin to moe runner choices; drop dead env var doc (#24384) 
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
 2026-05-04 15:01:47 -07:00
Baizhou ZhangandClaude Opus 4.7 f059e0264a Fix sgl-deep-gemm release workflow (#24385) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-04 14:36:59 -07:00
Lianmin Zheng 29dd3a36c0 Refactor device timer installation and rename prefill prealloc to bootstrap (#24341) 2026-05-04 13:57:13 -07:00
Praneth Paruchuri e93bb638bf [docs]update sm75 to sm80 min gpu support (#24336) 2026-05-04 13:50:20 -07:00
Kangyan-ZhouandClaude Opus 4.7 0f283a515a [Docker] fix: install nixl stub alongside nixl-cuXX binary (#24369) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-04 12:46:38 -07:00
Vladislav Nosivskoy 60a1dacd89 [HiCache] return cached_tokens_details in sglext for streaming responses (#22055) 
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
 2026-05-04 12:30:17 -07:00
Kangyan-ZhouandClaude Opus 4.7 8ffd39e140 [CI] Exclude flaky h20 stage from check-stage-health root cause set (#24374) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-04 11:41:25 -07:00
Ke Bao 6dd7aebb36 Minor scheduler fixes (#24359) 2026-05-05 02:01:23 +08:00
Sam Shleifer e6f252e9b8 Cache FlashInfer autotune configs (#24156) 2026-05-05 02:00:40 +08:00
Kangyan-ZhouandClaude Opus 4.7 c545a5b1c0 [SMG][CI] Add K8s integration tests + wire into pr-test-rust (#24278) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-04 10:27:37 -07:00
Yuan Luoandluoyuan.luo e5c58eb9d6 [VLM] Optimize Gemma4 VLM with PCG and fuse RMSNorm + residual add + scalar (#24048) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-05-04 09:36:26 -07:00