minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
16,630 Commits 2 Branches 0 Tags
2a89c6823a5bad38f2ff00fd4ab96c0810ffa6a7
Commit Graph
16630 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
raghothamandehhuang 2a89c6823a fix: honor explicit model loader classes (#34880) 
Co-authored-by: ehhuang <yinghai@meta.com>
 2026-08-15 06:00:41 +00:00
Xinyuan Tong e99ecb6eee [CI] Path-gate Rust workspace tests in lint (#34864) 2026-08-14 22:41:54 -07:00
Zhiyao Jiang 7216a44dd8 [AMD] Broadcast the EAGLE greedy verify decision across TP ranks on ROCm (#34238) 2026-08-14 22:37:45 -07:00
ethcheandEthan Che aeee1562e6 [Kernel] Enable Helion backend for Kimi Delta-Attention (#32593) 
Co-authored-by: Ethan Che <eche@meta.com>
 2026-08-14 22:22:46 -07:00
Khoa PhamandClaude Opus 5 3adbbec2fd [MoE] Route every trtllm-gen MoE call site through one PDL guard (#34789) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-14 22:09:03 -07:00
Colin Z bc7e3ba66c [AMD][Quantization] Online MXFP4 quantization 4/N - NVFP4 to MXFP4 Online Requantization on AMD GPUs (#29328) 2026-08-14 21:59:39 -07:00
Xinyu JiangZhiyao JiangCursor AgentMichael
 		5afdb1caea [AMD CI] follow the miles nightly-prefixed MI350 suite names (#34877) 
Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
 2026-08-15 12:57:12 +08:00
Michael 2012b4b196 [AMD][CI] Fix stage-b: AttributeError on multimodal embedding requests (#34769) 2026-08-14 21:35:26 -07:00
hanwlax 8720a72814 fix(scheduler): track max prefill batch size over recent real admissions (#34284) 2026-08-15 10:48:03 +08:00
weireweireandweireweire 6eb941a34c [Spec] Support MegaMoE for DSpark under dp attention (#34844) 
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
 2026-08-14 17:20:01 -07:00
gilfordtingandClaude Fable 5 a5ba081fbb [Spec] Wire DFLASH aux-hidden capture into the Qwen3.5 text-only wrapper (#34771) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 17:10:09 -07:00
gilfordtingandJames Liu 6f005e4da1 [Fix] Require JSON booleans for response_format json_schema.strict (#34777) 
Co-authored-by: James Liu <jamesl@modal.com>
 2026-08-14 16:46:27 -07:00
Baizhou Zhang a1844709f1 [CI] Trim Qwen3.5 FP8 GB300 performance batches (#34882) 2026-08-14 16:45:11 -07:00
gilfordtingandJames Liu 3f64f14360 [Fix] Work around xgrammar 0.2.1 negative integer minimum in Kimi-K3 structural tags (#34778) 
Co-authored-by: James Liu <jamesl@modal.com>
 2026-08-14 16:41:06 -07:00
Nan Jiang be804c1b83 [RL] Expose top-p-only sampling masks (#33593) 2026-08-14 16:40:27 -07:00
Jason Mancuso 90b3db6dd8 [Fix: RL] Snapshot async state-capture outputs before overlap (#34319) 2026-08-14 16:39:35 -07:00
Baizhou Zhang 8b4faa3336 [Docs] Update Kimi-K3 installation options (#34886) 2026-08-14 16:19:23 -07:00
DanielSwift1992 17efe37428 Remove 11 dead CODEOWNERS rules (#34875) 2026-08-14 15:38:19 -07:00
Ziang Li a9654eacc1 fix(dsa): use FlashInfer fused top-k for packed PAGED rows (#33006) 2026-08-14 15:22:18 -07:00
Zhipeng WangRyan LucasKayhan BehdinZhipeng Wang
 		bfb224ff01 Add Reasoning-Aware Compression (RAC) pruning recipe for reasoning models (#32414) 
Co-authored-by: Ryan Lucas <ryanluc@mit.edu>
Co-authored-by: Kayhan Behdin <kbehdin@linkedin.com>
Co-authored-by: Zhipeng Wang <zwanga@wustl.edu>
 2026-08-14 15:13:45 -07:00
Vedant V JhaveriVedant JhaveriCopilot
 		03c1d58112 perf: add H200 Triton MoE configs for E256 N512 (#34150) 
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
 2026-08-14 14:37:58 -07:00
Han-Yin ChangandClaude Fable 5 22dde1dd5b [Docs] Fill GLM-5.2 H200 FP8 speed cells (low-latency, balanced); fix MTP notation (#31554) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 13:56:55 -07:00
sglang-botandsglang-bot b676793e5e docs: sync LMSYS SGLang blog cards (#32982) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-08-14 13:55:52 -07:00
Sidhartha Reddy PotuandXinyuan Tong 42e8718d3d fix(muse-glimmer): parse required/named tool calls natively (#34781) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-08-14 20:43:48 +00:00
Mohammad Miadh Angkad d7207be156 Fix startup weight load after TorchAO removal (#34869) 2026-08-14 13:18:53 -07:00
Jackey HuaandClaude Opus 5 1af761a09a [SM12x] Default the fused MHC post+pre path on (#34019) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 19:51:21 +00:00
DarkraiHLhjzhangYAMY
 		41cd5a7189 [Fix] Fix Qwen3.5 MTP startup with HiCache (#34560) 
Co-authored-by: hjzhang <76768149+1e4ves@users.noreply.github.com>
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
 2026-08-14 10:55:41 -07:00
Xun Sun d8399af70c fix(qwen3): support DeepEP-class backends and early EPLB state (#34810) 2026-08-15 01:27:39 +08:00
Ke Bao 7562e741e2 Retain SWA down to the last state checkpoint (#34729) 2026-08-15 01:12:38 +08:00
Ke Bao c20aceeb88 Fix mamba checkpoint depth under dcp (#34808) 2026-08-15 00:34:00 +08:00
zijiexiaXinyuan Tongyhyang201Claude Opus 5
 		70e291b70f [Docs] Add GB300 cells and benchmarks for Qwen3.8-27B (#34863) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 15:42:50 +00:00
zijiexiaBBufyhyang201Claude Opus 5
 		29c6be15a4 [Docs] Add Qwen3.8-27B cookbook page (#34860) 
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 15:23:39 +00:00
Xiaoyu Zhang 9c9a3273be [diffusion] Fix Helios denoising profiler stepping (#34826) 2026-08-14 23:21:54 +08:00
Xiaoyu Zhang 5f2a6d6422 [diffusion] Fix symbolic replicated-mode counting under torch.compile (#34824) 2026-08-14 23:20:29 +08:00
Yuan Luoandluoyuan.luo b95a746948 [MoE] Fuse swiglu moe up gemm epilogue (#32944) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-08-14 22:11:34 +08:00
Mohammad Miadh Angkad 9d2f1584fa Fix MiniMax-H3 Cache-DiT BCG warning (#34848) 2026-08-14 22:07:50 +08:00
Roger YoungxuebiXiaoyu Zhang
 		c939307e8a [MiniMax-M3] Overlap shared and routed experts (#34542) 
Co-authored-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 22:01:48 +08:00
Yuang Chen晟海liusy58Xiaoyu Zhang
 		1a178f7c7c [EPD] Batch embedding cache host-device range copies (#31574) 
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 22:01:12 +08:00
Brayden ZhongandBrayden Zhong 5e65dd01a7 Remove the torchao integration (--torchao-config) (#34304) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-08-14 21:49:11 +08:00
amote-i fe0c18effd [NPU] [DOC] Add Qwen3.8-Max deployment tutorial on Ascend NPUs (#34836) 2026-08-14 20:02:04 +08:00
Ke Bao 18107e38d2 Skip oow slot freeing under eagle (#34823) 2026-08-14 17:13:21 +08:00
chilltongxandchilltongx 4d94f1d310 [diffusion] fix: warn when bcg disables cache-dit (#34242) 
Co-authored-by: chilltongx <284668524+chilltongx@users.noreply.github.com>
 2026-08-14 16:45:36 +08:00
Liangsheng Yin f2c84de022 [Perf] Publish the WAR read-done event at DSPARK verify (#34816) 2026-08-14 00:46:52 -07:00
triple-muandMick a86edcdc0a [diffusion] feat: rebuild minimax-h3 adaln outputs on demand (#34650) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-08-14 15:33:51 +08:00
gilfordtingharmyaClaude Fable 5
 		2622e013eb [Fix] has_hf_quant_config crashes on local dirs without the config (#34774) 
Co-authored-by: harmya <harmya@modal.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 07:17:42 +00:00
kk 65d62109dd [AMD] Fix Triton 3.7 gfx950 extend-attention spills (#34741) 2026-08-14 00:05:42 -07:00
Dayananda V 7c15b9b7d0 [diffusion] fix: fix cache-first fast path accepting a metadata-only snapshot (#34121) 2026-08-14 14:52:52 +08:00
datdo-msftandXiaoyu Zhang 827552bc1d Fix eager AMX backend probe imports (#34496) 
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 14:44:14 +08:00
zijiecjacky.chengYC Yen-Ching Tseng
 		ba1d980b35 [AMD] Accelerate AITER unified-attention decode with scaled FP8 Q (#31856) 
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
 2026-08-13 23:42:25 -07:00
Mick 46d84f4b48 feat(cli): add extensible serve backend plugins (#34753) 2026-08-14 13:57:59 +08:00