minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
16,621 Commits 2 Branches 0 Tags
6eb941a34cb100b708a42ed1d26d2bdefafbd01e
Commit Graph
16621 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
weireweireandweireweire 6eb941a34c [Spec] Support MegaMoE for DSpark under dp attention (#34844) 
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
 2026-08-14 17:20:01 -07:00
gilfordtingandClaude Fable 5 a5ba081fbb [Spec] Wire DFLASH aux-hidden capture into the Qwen3.5 text-only wrapper (#34771) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 17:10:09 -07:00
gilfordtingandJames Liu 6f005e4da1 [Fix] Require JSON booleans for response_format json_schema.strict (#34777) 
Co-authored-by: James Liu <jamesl@modal.com>
 2026-08-14 16:46:27 -07:00
Baizhou Zhang a1844709f1 [CI] Trim Qwen3.5 FP8 GB300 performance batches (#34882) 2026-08-14 16:45:11 -07:00
gilfordtingandJames Liu 3f64f14360 [Fix] Work around xgrammar 0.2.1 negative integer minimum in Kimi-K3 structural tags (#34778) 
Co-authored-by: James Liu <jamesl@modal.com>
 2026-08-14 16:41:06 -07:00
Nan Jiang be804c1b83 [RL] Expose top-p-only sampling masks (#33593) 2026-08-14 16:40:27 -07:00
Jason Mancuso 90b3db6dd8 [Fix: RL] Snapshot async state-capture outputs before overlap (#34319) 2026-08-14 16:39:35 -07:00
Baizhou Zhang 8b4faa3336 [Docs] Update Kimi-K3 installation options (#34886) 2026-08-14 16:19:23 -07:00
DanielSwift1992 17efe37428 Remove 11 dead CODEOWNERS rules (#34875) 2026-08-14 15:38:19 -07:00
Ziang Li a9654eacc1 fix(dsa): use FlashInfer fused top-k for packed PAGED rows (#33006) 2026-08-14 15:22:18 -07:00
Zhipeng WangRyan LucasKayhan BehdinZhipeng Wang
 		bfb224ff01 Add Reasoning-Aware Compression (RAC) pruning recipe for reasoning models (#32414) 
Co-authored-by: Ryan Lucas <ryanluc@mit.edu>
Co-authored-by: Kayhan Behdin <kbehdin@linkedin.com>
Co-authored-by: Zhipeng Wang <zwanga@wustl.edu>
 2026-08-14 15:13:45 -07:00
Vedant V JhaveriVedant JhaveriCopilot
 		03c1d58112 perf: add H200 Triton MoE configs for E256 N512 (#34150) 
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
 2026-08-14 14:37:58 -07:00
Han-Yin ChangandClaude Fable 5 22dde1dd5b [Docs] Fill GLM-5.2 H200 FP8 speed cells (low-latency, balanced); fix MTP notation (#31554) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 13:56:55 -07:00
sglang-botandsglang-bot b676793e5e docs: sync LMSYS SGLang blog cards (#32982) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-08-14 13:55:52 -07:00
Sidhartha Reddy PotuandXinyuan Tong 42e8718d3d fix(muse-glimmer): parse required/named tool calls natively (#34781) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-08-14 20:43:48 +00:00
Mohammad Miadh Angkad d7207be156 Fix startup weight load after TorchAO removal (#34869) 2026-08-14 13:18:53 -07:00
Jackey HuaandClaude Opus 5 1af761a09a [SM12x] Default the fused MHC post+pre path on (#34019) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 19:51:21 +00:00
DarkraiHLhjzhangYAMY
 		41cd5a7189 [Fix] Fix Qwen3.5 MTP startup with HiCache (#34560) 
Co-authored-by: hjzhang <76768149+1e4ves@users.noreply.github.com>
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
 2026-08-14 10:55:41 -07:00
Xun Sun d8399af70c fix(qwen3): support DeepEP-class backends and early EPLB state (#34810) 2026-08-15 01:27:39 +08:00
Ke Bao 7562e741e2 Retain SWA down to the last state checkpoint (#34729) 2026-08-15 01:12:38 +08:00
Ke Bao c20aceeb88 Fix mamba checkpoint depth under dcp (#34808) 2026-08-15 00:34:00 +08:00
zijiexiaXinyuan Tongyhyang201Claude Opus 5
 		70e291b70f [Docs] Add GB300 cells and benchmarks for Qwen3.8-27B (#34863) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 15:42:50 +00:00
zijiexiaBBufyhyang201Claude Opus 5
 		29c6be15a4 [Docs] Add Qwen3.8-27B cookbook page (#34860) 
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 15:23:39 +00:00
Xiaoyu Zhang 9c9a3273be [diffusion] Fix Helios denoising profiler stepping (#34826) 2026-08-14 23:21:54 +08:00
Xiaoyu Zhang 5f2a6d6422 [diffusion] Fix symbolic replicated-mode counting under torch.compile (#34824) 2026-08-14 23:20:29 +08:00
Yuan Luoandluoyuan.luo b95a746948 [MoE] Fuse swiglu moe up gemm epilogue (#32944) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-08-14 22:11:34 +08:00
Mohammad Miadh Angkad 9d2f1584fa Fix MiniMax-H3 Cache-DiT BCG warning (#34848) 2026-08-14 22:07:50 +08:00
Roger YoungxuebiXiaoyu Zhang
 		c939307e8a [MiniMax-M3] Overlap shared and routed experts (#34542) 
Co-authored-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 22:01:48 +08:00
Yuang Chen晟海liusy58Xiaoyu Zhang
 		1a178f7c7c [EPD] Batch embedding cache host-device range copies (#31574) 
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 22:01:12 +08:00
Brayden ZhongandBrayden Zhong 5e65dd01a7 Remove the torchao integration (--torchao-config) (#34304) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-08-14 21:49:11 +08:00
amote-i fe0c18effd [NPU] [DOC] Add Qwen3.8-Max deployment tutorial on Ascend NPUs (#34836) 2026-08-14 20:02:04 +08:00
Ke Bao 18107e38d2 Skip oow slot freeing under eagle (#34823) 2026-08-14 17:13:21 +08:00
chilltongxandchilltongx 4d94f1d310 [diffusion] fix: warn when bcg disables cache-dit (#34242) 
Co-authored-by: chilltongx <284668524+chilltongx@users.noreply.github.com>
 2026-08-14 16:45:36 +08:00
Liangsheng Yin f2c84de022 [Perf] Publish the WAR read-done event at DSPARK verify (#34816) 2026-08-14 00:46:52 -07:00
triple-muandMick a86edcdc0a [diffusion] feat: rebuild minimax-h3 adaln outputs on demand (#34650) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-08-14 15:33:51 +08:00
gilfordtingharmyaClaude Fable 5
 		2622e013eb [Fix] has_hf_quant_config crashes on local dirs without the config (#34774) 
Co-authored-by: harmya <harmya@modal.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 07:17:42 +00:00
kk 65d62109dd [AMD] Fix Triton 3.7 gfx950 extend-attention spills (#34741) 2026-08-14 00:05:42 -07:00
Dayananda V 7c15b9b7d0 [diffusion] fix: fix cache-first fast path accepting a metadata-only snapshot (#34121) 2026-08-14 14:52:52 +08:00
datdo-msftandXiaoyu Zhang 827552bc1d Fix eager AMX backend probe imports (#34496) 
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 14:44:14 +08:00
zijiecjacky.chengYC Yen-Ching Tseng
 		ba1d980b35 [AMD] Accelerate AITER unified-attention decode with scaled FP8 Q (#31856) 
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
 2026-08-13 23:42:25 -07:00
Mick 46d84f4b48 feat(cli): add extensible serve backend plugins (#34753) 2026-08-14 13:57:59 +08:00
zijiexiaandClaude Opus 5 463981922c [Cookbook] Add DeepSeek-V4-Pro-0813 (Pro Official) serving recipes (#34809) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-13 22:53:41 -07:00
DarkSharpnessClaudeBBuf
 		b784726863 [kernel] Content-addressed JIT build cache, generated from our own ninja (#34274) 
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
 2026-08-14 13:41:04 +08:00
jacky.chengandsogalin_codegen 240a12b302 [AMD] Fuse shared_expert_gate GEMV into the MoE append kernel (HIP/aiter) (#28666) 
Co-authored-by: sogalin_codegen <39478626+sogalin@users.noreply.github.com>
 2026-08-13 21:32:27 -07:00
Baizhou Zhang 0a6bbbe128 [Fix] Restore layer-level DSV4 RoPE policy (#34788) 2026-08-13 21:26:45 -07:00
Runkai TaorunkaiXiaoyu Zhang
 		e1c4db9621 [quantization] Add tuned Triton tile configs for channelwise FP8 GEMM… (#34331) 
Co-authored-by: runkai <runkai@amazon.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 11:11:02 +08:00
Xinyuan Tongandhnyls2002 85cdf1178d [CI] Prune redundant CPU test overhead (#34309) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-08-13 19:51:17 -07:00
Yuhao YangandClaude 6ad3f2d8fd docs: link dots3.note checkpoints, add H100 cells (#34797) 
Co-authored-by: Claude <noreply@anthropic.com>
 2026-08-14 02:42:27 +00:00
ashwini rathiandarathi-hlab 456c5551cc [XPU][test] Add cache_salt=None to _make_req in test_lmcache_radix_cache.py (#34728) 
Co-authored-by: arathi-hlab <arathi.hlab@users.noreply.github.com>
 2026-08-14 10:27:15 +08:00
SII-yangdianandSII-yangdian f2b2b567aa perf(jit_kernel/deepseek_v4): optimize paged_mqa_metadata (#25855) 
Co-authored-by: SII-yangdian <yangdian@sii.edu.cn>
 2026-08-13 19:00:22 -07:00