minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
18,675 Commits 4 Branches 0 Tags
main
Commit Graph
18675 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Ke Bao ebc144ce3f Enable unified cache out-of-window slot freeing by default (#34653) 2026-08-13 14:31:42 +08:00
Mick e8c7dddfa0 [VLM] add content-addressed preprocessing cache infrastructure (#34398) 2026-08-13 14:09:07 +08:00
elvischenv 035c622a14 Reenable breakable CUDA graph for NemotronH (#34538) 2026-08-13 13:58:10 +08:00
xieminghe1undefinedxq25478xieminghe.simonXiaoyu Zhang
 		ef7208d41d [kernel] add triton moe TMA up support (#33559) 
Co-authored-by: undefined <zhouchen.arrebol@jd.com>
Co-authored-by: xq25478 <xq25478@qq.com>
Co-authored-by: xieminghe.simon <xieminghe.simon@jd.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
 2026-08-13 13:29:32 +08:00
Mick 69bf601e3c fix: restore VLM nightly regression coverage (#34662) 2026-08-12 21:47:16 -07:00
Zaili Wang 1286a50bb9 Add New Intel members into CI permission list (#34671) 2026-08-12 21:28:00 -07:00
Liangsheng Yin 8761b971f1 [CI] Fix nightly test failures (#34637) 2026-08-12 20:53:44 -07:00
Liangsheng Yin 26627e999d [Fix] Snapshot req.prefix_indices when the prefix cache is disabled (#34644) 2026-08-12 20:50:46 -07:00
MickandClaude Opus 5 a318e16956 [diffusion] feat: publish an index of nightly comparison runs (#34652) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-13 11:50:10 +08:00
+76
vstone-wClownBinhuangzhenyuclownbadmerLiangsheng YinYAMYShangming CaiMickBrayden ZhongBrayden ZhongJimmy ShongZijie XiaThomas WangsiyuYuang ChenYuang Chen黄孝君Xinyuan TongXiaoyu ZhangCursorClaude Fable 5TobyMintTobyMintCheng WanTan TrinhLifan ShenJustin TongQiaolin YuAMD-yanfeiwangQIN2DIMZhiyao JiangBrayden ZhongDevashishLal-CBDevashish LalAlex NailsMohammad Miadh AngkadBaizhou ZhangMichael GschwindweireweireweireweireKhoa PhammilesialelvischenvcctryJae B.MichaelforrestlEchOTanmay patilybyangHsiu-Chun, HungHungHaiShawBingxu ChenYC Yen-Ching TsengCherry_mingEven Zhousglang-npu-botZhiqiang XieTingwei HuangKaixigithub-actions[bot]Faradawn YangRyan StewartgjsheuJinyan YiKe BaohuangtingweiHanming LuJeremy ZhangDmitrii SergeevHao ZhangzhisbugDouglas Yanggongwei1027ilyasher-harmonicHanming Lusglang-botsglang-botJimmy Shonghnyls2002Meng, HengyuShu WangYanbin Jiangzijiec
 		bca8ed4afc [minimax m3][npu]Adaptation of Minimax M3(w8a8) for NPU platforms [1/2] (#32941) 
Signed-off-by: Devashish Lal <devcode@fb.com>
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Signed-off-by: Ryan Stewart <rystewart@nvidia.com>
Co-authored-by: ClownBin <chaobin1993@126.com>
Co-authored-by: huangzhenyu <q_m_p@qq.com>
Co-authored-by: clown <17490516+ClownBin@users.noreply.github.com>
Co-authored-by: badmer <374330057@qq.com.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: YAMY <74099316+YAMY1234@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Jimmy Shong <jimmysh341@gmail.com>
Co-authored-by: Zijie Xia <zijie.xia@radixark.ai>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: siyu <liusy58@linux.alibaba.com>
Co-authored-by: Yuang Chen <cya539102@antgroup.com>
Co-authored-by: Yuang Chen <1131578721@qq.com>
Co-authored-by: 黄孝君 <dingfangsu23@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
Co-authored-by: TobyMint <130973409+TobyMint@users.noreply.github.com>
Co-authored-by: TobyMint <tobymint@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Tan Trinh <84185999+tanth47@users.noreply.github.com>
Co-authored-by: Lifan Shen <draftbks@gmail.com>
Co-authored-by: Justin Tong <justintong0323@outlook.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: AMD-yanfeiwang <yanfei.wang@amd.com>
Co-authored-by: QIN2DIM <62018067+QIN2DIM@users.noreply.github.com>
Co-authored-by: Zhiyao Jiang <jessicajiang324@gmail.com>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: DevashishLal-CB <devashish@rivosinc.com>
Co-authored-by: Devashish Lal <devcode@fb.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Michael Gschwind <mkgschwind+private@gmail.com>
Co-authored-by: weireweire <weiliangl@nvidia.com>
Co-authored-by: weireweire <20922698+weireweire@users.noreply.github.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: milesial <milesial@users.noreply.github.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: cctry <csycfl@gmail.com>
Co-authored-by: Jae B. <jlee5814@gmail.com>
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
Co-authored-by: forrestl <16055533+forrestl111@users.noreply.github.com>
Co-authored-by: EchO <117733745+CyberSecurityErial@users.noreply.github.com>
Co-authored-by: Tanmay patil <tanmaypatil3151@gmail.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
Co-authored-by: Hsiu-Chun, Hung <160560375+Emmanuel0612@users.noreply.github.com>
Co-authored-by: Hung <Emmanuel0612@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
Co-authored-by: Cherry_ming <136634645@qq.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: Tingwei Huang <huangtingwei9988@gmail.com>
Co-authored-by: Kaixi <kaiximatteoc@nvidia.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Co-authored-by: Ryan Stewart <rystewart@nvidia.com>
Co-authored-by: gjsheu <gjsheu@163.com>
Co-authored-by: Jinyan Yi <yjy20010615@gmail.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
Co-authored-by: Jeremy Zhang <jeremy.zhang866@gmail.com>
Co-authored-by: Dmitrii Sergeev <dmi.sergeev@gmail.com>
Co-authored-by: Hao Zhang <zhisbug@users.noreply.github.com>
Co-authored-by: zhisbug <1654062+zhisbug@users.noreply.github.com>
Co-authored-by: Douglas Yang <dyang@college.harvard.edu>
Co-authored-by: gongwei1027 <gongwei833x@gmail.com>
Co-authored-by: ilyasher-harmonic <ilya.sherstyuk@harmonic.fun>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: sglang-bot <sglangbot@gmail.com>
Co-authored-by: sglang-bot <232288953+sglang-bot@users.noreply.github.com>
Co-authored-by: Jimmy Shong <69131491+Jiminator@users.noreply.github.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Meng, Hengyu <hengyu.meng@intel.com>
Co-authored-by: Shu Wang <shuw@nvidia.com>
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
Co-authored-by: zijiec <zijie.chen@amd.com>
 2026-08-13 11:23:14 +08:00
ashwini rathiandClaude Opus 4.7 d44c836cfd [XPU][CI] disable SYCL_CACHE_PERSISTENT to fix topk segfault (#34567) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-08-13 11:19:39 +08:00
Ke Bao 5efe9b104d Record both architectures in the bit-exact guard docstrings (#34656) 2026-08-13 10:55:35 +08:00
Xiaoyu Zhang 26579d893e [Diffusion][GLM-Image] Retune QK head LayerNorm for SM103 (#34619) 2026-08-13 10:49:13 +08:00
Liangsheng Yin 50cc1aa241 [CI] Route mmlu and GB300 MMMU-Pro evals through sgl-eval (#34477) 2026-08-12 19:33:21 -07:00
Khoa PhamandClaude Opus 5 cfdfd31826 Add thanhhao98 to CI_PERMISSIONS.json (#34649) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-12 19:02:03 -07:00
Carrie ChenandBrayden Zhong 6a5a9eccaa add flashinfer cute-dsl backend for mxfp8 gemm (#34042) 
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
 2026-08-13 08:50:01 +08:00
Lukas Humbel 40eaf34428 fix: make automatic NUMA binding configurable (#30394) 2026-08-12 17:40:28 -07:00
Mohammad Miadh Angkad aefe2d0207 Revert "[Kimi K3] Fuse MLA gate projection into QKV-A GEMM" (#34642) 2026-08-13 08:35:38 +08:00
MichaelCursor Agentquitenode
 		bbda7f32b1 [AMD][CI] CI: fix AMD 2-GPU multimodal-gen partition-count abort (#34328) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
 2026-08-13 08:32:33 +08:00
Baizhou Zhang 273d978bed [CI] Use default installer for B300 tests (#34635) 2026-08-12 16:21:40 -07:00
jthomson04 385903b0ac feat: add cache salt support to KV cache events (#30827) 
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
 2026-08-12 16:14:04 -07:00
Jimmy Shong 198b7e9240 [Docs] Use Meta's canonical Muse Glimmer GGUF filename (#34626) 2026-08-12 16:07:55 -07:00
Khoa PhamandClaude Opus 5 6c6294b7be [DCP] Fuse the a2a pack/unpack copies in the MLA LSE reduce (#34614) 
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
 2026-08-12 16:04:46 -07:00
Liangsheng Yin c05eb856f7 [CI] Fix nightly test failures (#34523) 2026-08-12 15:40:20 -07:00
binbin Deng 2b4381956f fix(glm5.2): restrict MoE weights to local PP layers (#33793) 2026-08-12 12:32:08 -07:00
elvischenv 4f883636a2 [Perf] FlashInfer MLA: remove blocking D2H in spec-decode plan (#27689) 2026-08-12 12:29:03 -07:00
Ke Bao 3974b00359 Add bit-exact unified radix cache KL test for hybrid SWA + mamba (#34607) 2026-08-13 02:15:36 +08:00
Oguz UlgenHanming LuLianmin Zhengwangwenchen0407Hanming Lu
 		773faf992d Reserve multimodal runtime allocations and keep padded inputs aligned (#34141) 
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: wangwenchen0407 <wangwenchen@meta.com>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
 2026-08-12 11:04:07 -07:00
YAMY e6250c7c70 docs: update Qwen3.8 disaggregated serving configs (#34601) 2026-08-12 11:02:35 -07:00
Ke Bao 126010c373 [misc] update CI_PERMISSIONS.json (#34610) 2026-08-13 01:58:21 +08:00
Chenchen HongXiaoyu ZhangBrayden Zhong
 		b501311fa1 [Kimi K3] Fuse MLA gate projection into QKV-A GEMM (#33623) 
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2026-08-13 00:21:34 +08:00
yiheng 8549cce11b [BugFix] Fix race in c128 prefill plan kernel on ragged extend (#32467) 
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
 2026-08-13 00:15:41 +08:00
Xinyuan Tong d21eefc94f [Docs] Rename Qwen3.8-Max-DSpark to Qwen3.8-2.4T-A95B-DSpark (#34590) 2026-08-12 15:25:48 +00:00
Mick ad47dde65c [diffusion] optimize: fuse cosmos qk norm, rope, and kv packing (#34275) 2026-08-12 23:18:16 +08:00
Yichi Zhang f28bc5a6de docs(cookbook): add BF16 recipes to Nemotron 3.5 Lightning (#34573) 2026-08-12 08:15:34 -07:00
zijiexiaandClaude Opus 5 8e7c07fae7 [Docs] Add Qwen3.8 cookbook (#34587) 
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
 2026-08-12 08:07:46 -07:00
McZyWu 197832bcf5 [Kimi-K3][NPU] Support Kimi-K3 on NPU (#33465) 2026-08-12 21:20:14 +08:00
Mick dc5f6c4883 [diffusion] optimize: stream and parallelize bit-exact video output saves (#34564) 2026-08-12 20:03:37 +08:00
Mick 9701cc138c [diffusion] optimize: optimize bit-exact h3 reference video ingress (#34563) 2026-08-12 20:02:49 +08:00
Zhaoyi Li 9deb6952af [AMD][DI][CI] Add GLM-5.2 MXFP4 wide-EP16 2P1D nightly recipes (#34476) 2026-08-12 03:53:14 -07:00
ajith-sirra-amdandgiovanniguastiamd b5d1453ed2 [AMD] GLM 5.2 MXFP4 SGLANG COOKBOOK (#34379) 
Signed-off-by: Sirra <asirra@amd.com>
Co-authored-by: giovanniguastiamd <giovanni.guasti@amd.com>
 2026-08-12 03:39:25 -07:00
YC Yen-Ching Tsengyctseng0211Chen
 		00bdafe944 [AMD][CI] Swap the AMD PR gate to ROCm 7.2 and demote ROCm 7.0 to a daily shadow (#34204) 
Co-authored-by: yctseng0211 <yctseng@smci355-ccs-aus-m12-17.cs-aus.dcgpu>
Co-authored-by: Chen <bingxche@amd.com>
 2026-08-12 03:31:03 -07:00
Mick b3bffef70a [diffusion] UX: suppress noisy worker startup warnings (#34512) 2026-08-12 17:53:45 +08:00
Mick 644d55ebfa [diffusion] feat: support native and peft minimax h3 loras (#34359) 2026-08-12 17:52:40 +08:00
Mohammad Miadh Angkad 00e57d74f0 Bump FlashInfer to 0.6.17 and remove Kimi K3 workarounds (#33997) 2026-08-12 02:17:26 -07:00
Yuzhen Zhou 2d76d537e5 feat: support deterministic FA4 for GLM-4.7-Flash (#33945) 2026-08-12 16:57:34 +08:00
Xiaoyu Zhang 1f008dc226 [Diffusion][LTX-2] Allocate AdaLN outputs from one contiguous slab (#34508) 2026-08-12 16:28:27 +08:00
Xiaoyu Zhang daae3acb36 [Diffusion][Z-Image] Tune native QK RMSNorm launch for SM103 (#34507) 2026-08-12 16:27:44 +08:00
Xiaoyu Zhang 4827061247 [Diffusion] Make weight-only FP8 dequant cache torch.compile-safe (#34506) 2026-08-12 16:26:31 +08:00
Xiaoyu Zhang 84ce7502cf [Diffusion][MiniMax H3] Extend exact QKNorm+RoPE rounding to SM103 (#34505) 2026-08-12 16:25:24 +08:00