minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
16,611 Commits 2 Branches 0 Tags
bfb224ff01d4f2d6108633dff39ad37284e8f29d
Commit Graph
16611 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Zhipeng WangRyan LucasKayhan BehdinZhipeng Wang
 		bfb224ff01 Add Reasoning-Aware Compression (RAC) pruning recipe for reasoning models (#32414) 
Co-authored-by: Ryan Lucas <ryanluc@mit.edu>
Co-authored-by: Kayhan Behdin <kbehdin@linkedin.com>
Co-authored-by: Zhipeng Wang <zwanga@wustl.edu>
 2026-08-14 15:13:45 -07:00
Vedant V JhaveriVedant JhaveriCopilot
 		03c1d58112 perf: add H200 Triton MoE configs for E256 N512 (#34150) 
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
 2026-08-14 14:37:58 -07:00
Han-Yin ChangandClaude Fable 5 22dde1dd5b [Docs] Fill GLM-5.2 H200 FP8 speed cells (low-latency, balanced); fix MTP notation (#31554) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 13:56:55 -07:00
sglang-botandsglang-bot b676793e5e docs: sync LMSYS SGLang blog cards (#32982) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-08-14 13:55:52 -07:00
Sidhartha Reddy PotuandXinyuan Tong 42e8718d3d fix(muse-glimmer): parse required/named tool calls natively (#34781) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-08-14 20:43:48 +00:00
Mohammad Miadh Angkad d7207be156 Fix startup weight load after TorchAO removal (#34869) 2026-08-14 13:18:53 -07:00
Jackey HuaandClaude Opus 5 1af761a09a [SM12x] Default the fused MHC post+pre path on (#34019) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 19:51:21 +00:00
DarkraiHLhjzhangYAMY
 		41cd5a7189 [Fix] Fix Qwen3.5 MTP startup with HiCache (#34560) 
Co-authored-by: hjzhang <76768149+1e4ves@users.noreply.github.com>
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
 2026-08-14 10:55:41 -07:00
Xun Sun d8399af70c fix(qwen3): support DeepEP-class backends and early EPLB state (#34810) 2026-08-15 01:27:39 +08:00
Ke Bao 7562e741e2 Retain SWA down to the last state checkpoint (#34729) 2026-08-15 01:12:38 +08:00
Ke Bao c20aceeb88 Fix mamba checkpoint depth under dcp (#34808) 2026-08-15 00:34:00 +08:00
zijiexiaXinyuan Tongyhyang201Claude Opus 5
 		70e291b70f [Docs] Add GB300 cells and benchmarks for Qwen3.8-27B (#34863) 
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 15:42:50 +00:00
zijiexiaBBufyhyang201Claude Opus 5
 		29c6be15a4 [Docs] Add Qwen3.8-27B cookbook page (#34860) 
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-14 15:23:39 +00:00
Xiaoyu Zhang 9c9a3273be [diffusion] Fix Helios denoising profiler stepping (#34826) 2026-08-14 23:21:54 +08:00
Xiaoyu Zhang 5f2a6d6422 [diffusion] Fix symbolic replicated-mode counting under torch.compile (#34824) 2026-08-14 23:20:29 +08:00
Yuan Luoandluoyuan.luo b95a746948 [MoE] Fuse swiglu moe up gemm epilogue (#32944) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-08-14 22:11:34 +08:00
Mohammad Miadh Angkad 9d2f1584fa Fix MiniMax-H3 Cache-DiT BCG warning (#34848) 2026-08-14 22:07:50 +08:00
Roger YoungxuebiXiaoyu Zhang
 		c939307e8a [MiniMax-M3] Overlap shared and routed experts (#34542) 
Co-authored-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 22:01:48 +08:00
Yuang Chen晟海liusy58Xiaoyu Zhang
 		1a178f7c7c [EPD] Batch embedding cache host-device range copies (#31574) 
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 22:01:12 +08:00
Brayden ZhongandBrayden Zhong 5e65dd01a7 Remove the torchao integration (--torchao-config) (#34304) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-08-14 21:49:11 +08:00
amote-i fe0c18effd [NPU] [DOC] Add Qwen3.8-Max deployment tutorial on Ascend NPUs (#34836) 2026-08-14 20:02:04 +08:00
Ke Bao 18107e38d2 Skip oow slot freeing under eagle (#34823) 2026-08-14 17:13:21 +08:00
chilltongxandchilltongx 4d94f1d310 [diffusion] fix: warn when bcg disables cache-dit (#34242) 
Co-authored-by: chilltongx <284668524+chilltongx@users.noreply.github.com>
 2026-08-14 16:45:36 +08:00
Liangsheng Yin f2c84de022 [Perf] Publish the WAR read-done event at DSPARK verify (#34816) 2026-08-14 00:46:52 -07:00
triple-muandMick a86edcdc0a [diffusion] feat: rebuild minimax-h3 adaln outputs on demand (#34650) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-08-14 15:33:51 +08:00
gilfordtingharmyaClaude Fable 5
 		2622e013eb [Fix] has_hf_quant_config crashes on local dirs without the config (#34774) 
Co-authored-by: harmya <harmya@modal.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 07:17:42 +00:00
kk 65d62109dd [AMD] Fix Triton 3.7 gfx950 extend-attention spills (#34741) 2026-08-14 00:05:42 -07:00
Dayananda V 7c15b9b7d0 [diffusion] fix: fix cache-first fast path accepting a metadata-only snapshot (#34121) 2026-08-14 14:52:52 +08:00
datdo-msftandXiaoyu Zhang 827552bc1d Fix eager AMX backend probe imports (#34496) 
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 14:44:14 +08:00
zijiecjacky.chengYC Yen-Ching Tseng
 		ba1d980b35 [AMD] Accelerate AITER unified-attention decode with scaled FP8 Q (#31856) 
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
 2026-08-13 23:42:25 -07:00
Mick 46d84f4b48 feat(cli): add extensible serve backend plugins (#34753) 2026-08-14 13:57:59 +08:00
zijiexiaandClaude Opus 5 463981922c [Cookbook] Add DeepSeek-V4-Pro-0813 (Pro Official) serving recipes (#34809) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-13 22:53:41 -07:00
DarkSharpnessClaudeBBuf
 		b784726863 [kernel] Content-addressed JIT build cache, generated from our own ninja (#34274) 
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: BBuf <1182563586@qq.com>
 2026-08-14 13:41:04 +08:00
jacky.chengandsogalin_codegen 240a12b302 [AMD] Fuse shared_expert_gate GEMV into the MoE append kernel (HIP/aiter) (#28666) 
Co-authored-by: sogalin_codegen <39478626+sogalin@users.noreply.github.com>
 2026-08-13 21:32:27 -07:00
Baizhou Zhang 0a6bbbe128 [Fix] Restore layer-level DSV4 RoPE policy (#34788) 2026-08-13 21:26:45 -07:00
Runkai TaorunkaiXiaoyu Zhang
 		e1c4db9621 [quantization] Add tuned Triton tile configs for channelwise FP8 GEMM… (#34331) 
Co-authored-by: runkai <runkai@amazon.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-14 11:11:02 +08:00
Xinyuan Tongandhnyls2002 85cdf1178d [CI] Prune redundant CPU test overhead (#34309) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-08-13 19:51:17 -07:00
Yuhao YangandClaude 6ad3f2d8fd docs: link dots3.note checkpoints, add H100 cells (#34797) 
Co-authored-by: Claude <noreply@anthropic.com>
 2026-08-14 02:42:27 +00:00
ashwini rathiandarathi-hlab 456c5551cc [XPU][test] Add cache_salt=None to _make_req in test_lmcache_radix_cache.py (#34728) 
Co-authored-by: arathi-hlab <arathi.hlab@users.noreply.github.com>
 2026-08-14 10:27:15 +08:00
SII-yangdianandSII-yangdian f2b2b567aa perf(jit_kernel/deepseek_v4): optimize paged_mqa_metadata (#25855) 
Co-authored-by: SII-yangdian <yangdian@sii.edu.cn>
 2026-08-13 19:00:22 -07:00
Xiaoyu ZhangandClaude Fable 5 704e512836 [GDN] Honor configured linear-attn verify backend in the kernel dispatcher (#34592) 
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
 2026-08-14 08:59:52 +08:00
Michael 34219ed9a7 [AMD] CI: pin antlr4-python3-runtime back after lmms-eval (unblocks ROCm 7.2 stage-b evals) (#34768) 2026-08-14 08:41:16 +08:00
Ziang Li 9d34c2809f [FlashInfer v0.6.16] Support FlashInfer CuTe DSL NVFP4 MoE quantization (#28354) 2026-08-13 17:33:46 -07:00
ormandj c4271c3fe1 [DSpark] Fix EP1 decode performance regression (#34759) 2026-08-13 17:00:54 -07:00
weireweireandweireweire 54c44fef73 [Perf] Skip trivial DSV4 nonpaged indexer logits (#33857) 
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
 2026-08-13 16:21:30 -07:00
Liangsheng Yin 151a314829 [Fix] Make the DSpark draft num_token_non_padded host-to-device copy non-blocking (#34782) 2026-08-13 16:10:54 -07:00
zijiexia abdef3c38e [Qwen] Update Docker image tag for MI300X to v0.5.17-rocm700-mi30x-20… (#34770) 2026-08-13 15:59:42 -07:00
MichaelandMichael 9720922671 [AMD][CI] Restore gfx942 Grok-1 INT4 and Grok-2 schedules (#34761) 
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
 2026-08-13 15:57:54 -07:00
Khoa PhamandClaude Opus 5 f3beb2c529 [CI] Disable the prefill CUDA graph on the P worker of test_kimi_linear_pd_dcp4 (#34779) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-13 15:26:21 -07:00
Khoa PhamandClaude Opus 5 81fe452810 [DCP] Share one pack kernel between both a2a backends (#34651) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-13 15:06:02 -07:00