minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
14,099 Commits 2 Branches 0 Tags
fcca4611fa516e2955b787e417ded5a6ff8fcad9
Commit Graph
568 Commits
Author SHA1 Message Date
Xinyu Zhang 1800d7caa6 Bump ray minimum version to 2.55.1 (#27724) 2026-06-12 20:49:11 -07:00
Khoa Pham a0c6e0b3a4 chore: bump tokenspeed_mla 0.1.1 -> 0.1.6 (#28116) 2026-06-12 19:57:36 -07:00
Mohammad Miadh Angkad 7f706f4cfb [Deps] Bump FI to 0.6.12 and cutedsl to 4.5.2 (#26854) 2026-06-03 12:09:18 -07:00
Baizhou Zhang 68caf49154 Update sgl-deep-gemm to 0.1.2 (#26993) 2026-06-02 13:51:54 -07:00
Mick 64a1dec8b6 [diffusion] feat: add realtime webui super resolution controls (#27026) 2026-06-02 20:29:21 +08:00
Mick 3b26644bc4 [diffusion] misc: add realtime-webui (#26959) 2026-06-02 14:13:02 +08:00
Mick 2fc548f250 [diffusion] model: support lingot-world (#26954) 2026-06-02 13:52:49 +08:00
popsiclexuandpopsiclexu 951fa05a09 [MoE] Support BF16 standard A2A with DeepGEMM runner (#26473) 
Co-authored-by: popsiclexu <zhenxue.xu@mthreads.com>
 2026-06-01 20:40:38 -07:00
Liangsheng Yin ed85bcf8c3 pin kernels<0.15 (#26704) 2026-05-29 01:46:57 -07:00
Xinyuan Tong 79c844527c Upgrade xgrammar to 0.2.1 (#25676) 2026-05-29 11:40:07 +08:00
sglang-botandsglang-bot 14f81a67d9 chore: bump sglang-kernel version to 0.4.3 (#26421) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-05-27 11:31:11 -07:00
Kangyan-ZhouandLiangsheng Yin caa9f08294 [CI] Force-reinstall nvidia-cutlass-dsl-libs-cu13 last to avoid wheel-mix TypeError (#25958) 
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-05-21 22:01:42 +08:00
Kangyan-Zhou 4ea8282cb7 [Revert] nvidia-cutlass-dsl[cu13] 4.5.1 -> 4.5.0 (#25938) 2026-05-21 14:36:56 +08:00
Mohammad Miadh Angkad a449ee4822 [Deps] Use cu13 extra for nvidia cutlass dsl (#25576) 2026-05-21 10:31:27 +08:00
Matt Van HornandMatt Van Horn e99f87c974 fix: add missing distro dependency to runtime docker image (#25817) 
Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com>
 2026-05-20 00:46:32 -07:00
Xinyuan Tong aad00b0ed8 Upgrade transformers to 5.8.1 (#25451) 2026-05-19 22:20:30 +08:00
Baizhou Zhangandhnyls2002 b79e4b1e68 [Fix] Try to fix error caused by latest cutedsl packages (#25690) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-05-18 16:51:32 -07:00
Baizhou Zhangsglang-botb8zhongmmangkad
 		0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
 2026-05-15 01:04:56 -07:00
Liangsheng Yin 22dfcdaa04 revert flashinfer 0.6.11 bumps (#25310) 2026-05-14 15:28:58 -07:00
Baizhou Zhangandpranjalssh b7f856df70 DeepSeek V4 w4a4 MegaMoE (#25052) 
Co-authored-by: pranjalssh <adkz.photos@gmail.com>
 2026-05-13 18:35:32 -07:00
Qiaolin Yu 7618ad7075 [attn backend] Integrate tokenspeed_mla prefill/decode kernels (fp8 kv cache, blackwell) (#24925) 2026-05-13 17:36:17 -07:00
Baizhou Zhang 51a9403104 Update flashinfer to 0.6.11.post1 (#25129) 2026-05-13 00:12:19 -07:00
Brayden Zhongandb8zhong d5f3254ed1 [Dependency] Flashinfer 0.6.8post1 -> 0.6.11 (#24452) 
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
 2026-05-12 14:38:32 -07:00
+6
Liangsheng YinBaizhou ZhangClaude Opus 4.7fzyzcjyispobockZhiqiang Xieyueming-yuanDarkSharpnessYuhao Yangyhyang201yhyang201Qiaolin YuEthan SuMingyiCheng WanYihao Wang
 		35870d55ac Deepseek V4 (#23882) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com>
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com>
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com>
 2026-05-07 18:32:21 -07:00
Baizhou Zhang ecb786c8d7 [Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268) 2026-05-06 18:59:01 -07:00
Linzhang LiXinyuan TongUbospicaXinyuan Tong
 		952b3caf18 feat: use structural tags to enable strict tool calling and reasoning for more models (#21722) 
Signed-off-by: Yuchuan <yuchuan.7streams@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-05-04 02:30:28 -07:00
Brayden ZhongKangyan ZhouClaude Opus 4.7Baizhou Zhangb8zhongMick
 		88bb5dffe4 [Dependency] Upgrade to Torch 2.11.0 (#21247) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-05-02 12:25:36 -07:00
Kangyan-ZhouandClaude Opus 4.7 cd27baaffd [ci][cu13] Bump torch_memory_saver to 0.0.9.post1; restore manual tests (#23182) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-01 22:50:38 -07:00
AlonKejzman 66ea0aee7f tokenizer: Add fastokens support (#23753) 2026-04-28 11:43:10 -07:00
Xinyuan Tong e5198386bd Upgrade transformers from 5.5.4 to 5.6.0 (#23525) 2026-04-26 22:33:54 -07:00
sglang-botsglang-botKangyan ZhouClaude Opus 4.7
 		9003f24e2b chore: bump sglang-kernel version to 0.4.1.post1 (#23733) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 23:23:49 -07:00
sglang-botandsglang-bot f3b88e080a chore: bump flashinfer version to 0.6.8.post1 (#23281) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-23 15:23:03 -07:00
Alex Nails 10e17cc55e [gRPC] Native gRPC server: proto + Rust crate scaffold + server args (#22736) 2026-04-20 12:39:35 +08:00
Baizhou ZhangKangyan ZhouClaude Opus 4.7Alison ShaoMick
 		6ecd6f84db [CI] Add per-job uv venv isolation and upgrade CI version to Cuda 13 (#23119) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-04-19 05:32:36 -07:00
Xinyuan Tong 34fef07a15 Upgrade transformers to 5.5.3 and refactor hf_transformers_utils into subpackage (#21569) 2026-04-15 20:03:44 -07:00
Baizhou Zhang b441317aa4 Revert "Upgrade CI default CUDA version from 12.9 to 13.0" (#22727) 2026-04-13 14:39:24 -07:00
Asish Kumar 39810762d2 fix: use describe mode for SGLang version detection (#22600) 
Signed-off-by: Asish Kumar <officialasishkumar@gmail.com>
 2026-04-13 09:45:45 -07:00
Alison Shao 3f4fbc165d Upgrade CI default CUDA version from 12.9 to 13.0 (#21441) 2026-04-12 21:48:40 -07:00
sglang-botandsglang-bot df3275bd6c chore: bump flashinfer version to 0.6.7.post3 (#22382) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-08 14:49:45 -07:00
Rain Jiang 1a8eb890f6 Kernels community fa3 (#20796) 2026-04-07 12:48:44 -07:00
Ke Bao be42fbbbd7 Support HTTP2 server (#21700) 2026-04-08 00:42:52 +08:00
Kangyan-ZhouClaude Opus 4.6Baizhou Zhang
 		93109cc89b [Fix] Fix setuptools-scm version resolution for rc tags (#22165) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-04-05 16:55:32 -07:00
sglang-botandsglang-bot 46bf19cdab chore: bump flashinfer version to 0.6.7.post2 (#22097) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-04 02:16:25 -07:00
sglang-botandsglang-bot 84118acf50 chore: bump sglang-kernel version to 0.4.1 (#22009) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-03 13:58:35 -07:00
Noa Neria 8d9145d97e Direct model loading from object storage with Runai Model Streamer (#17948) 
Signed-off-by: Noa Neria <noa@run.ai>
 2026-04-01 18:41:22 -07:00
Alison ShaoandAlison Shao 1ac74e652e [Misc] Fix comparator e2e tests: add polars dep + fix dp-attention test (#21804) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
 2026-04-01 15:44:35 -07:00
sglang-botsglang-botBaizhou Zhang
 		ca3ba05a7a chore: bump flashinfer version to 0.6.7 (#21422) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-31 21:18:16 -07:00
Anant Sharma f289d173aa [Deps] Bump xgrammar to 0.1.32 (#21032) 2026-03-26 01:22:37 -07:00
Alison ShaoAlison ShaoAlison Shaohnyls2002Liangsheng Yin
 		5297a3cb46 [CI] Rewrite killall_sglang as Python with CI/local dual mode (#21331) 
Co-authored-by: Alison Shao <alison.shao@mac.lan>
Co-authored-by: Alison Shao <alison.shao@MacBook-Pro-D2W773R9CD.local>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-03-24 23:54:01 -07:00
Xinyuan TongKangyan-ZhouAlison ShaoMick
 		d1e95af282 Upgrade transformers==5.3.0 (#17784) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
Co-authored-by: Alison Shao <alisonshao@mac.lan>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-18 13:50:43 -07:00