minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
15,115 Commits 2 Branches 0 Tags
80965db8d3fa89d97ef2d95d2cd1fd486caad963
Commit Graph
221 Commits
Author SHA1 Message Date
Mohammad Miadh Angkad 24d59d8d74 Fix CUDA 12 Docker dependency resolution (#30858) 2026-07-12 13:50:41 -07:00
Baizhou Zhang 3f1694f5e0 Update sgl-deep-gemm to 0.1.4.post1 (#30697) 2026-07-10 13:30:43 -07:00
Baizhou ZhangBrayden ZhongMohammad Miadh Angkad
 		2c6cd1ef41 [Dep] Upgrade flashinfer to 0.6.14 (#29910) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
 2026-07-09 17:52:33 -07:00
ishandhananiKangyan ZhouClaude Opus 4.8
 		b6907d9664 docker: install dynamo nightly in the dev image for rapid iteration/testing (#29634) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-29 22:58:19 -07:00
Douglas Yang 105e095e00 [Docker] Fix cu12 dev image build: pin torch reinstall + JIT-fallback for missing x86 cubins (#28632) 2026-06-18 10:51:57 +02:00
sglang-botandsglang-bot b1d18d562b chore: bump sglang-kernel version to 0.4.4 (#28572) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-06-17 16:13:39 -07:00
Baizhou Zhang 27291118b9 Upgrade sgl-deep-gemm to 0.1.3 (#28402) 2026-06-16 23:06:36 -07:00
Caio RochaCaio Rochaempyreus
 		c2eae96c56 MSCCL++ Integration (#22734) 
Co-authored-by: Caio Rocha <caiorocha@microsof.com>
Co-authored-by: empyreus <rjsouza1995@gmail.com>
 2026-06-08 21:13:13 -07:00
Mohammad Miadh Angkad 7f706f4cfb [Deps] Bump FI to 0.6.12 and cutedsl to 4.5.2 (#26854) 2026-06-03 12:09:18 -07:00
Baizhou Zhang 68caf49154 Update sgl-deep-gemm to 0.1.2 (#26993) 2026-06-02 13:51:54 -07:00
popsiclexuandpopsiclexu 951fa05a09 [MoE] Support BF16 standard A2A with DeepGEMM runner (#26473) 
Co-authored-by: popsiclexu <zhenxue.xu@mthreads.com>
 2026-06-01 20:40:38 -07:00
WingEdge777 20f47cfe8e fix : add sglang script as entry bin for runtime docker image (#26895) 2026-06-01 09:22:37 +02:00
Baizhou Zhang 435c4ffb30 [CI] Clean DeepSeek V4 tests and installation scripts (#26609) 2026-05-28 15:22:59 -07:00
sglang-botandsglang-bot 14f81a67d9 chore: bump sglang-kernel version to 0.4.3 (#26421) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-05-27 11:31:11 -07:00
Shangming Cai 7f2829af39 chore: bump mooncake version to 0.3.11.post1 (#25989) 2026-05-25 16:51:03 +08:00
Baizhou Zhangsglang-botb8zhongmmangkad
 		0c19540550 [Fix] Fix gpt oss triton kernels and upgrade flashinfer back to 0.6.11.post1 (#25335) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: mmangkad <mmangkad@users.noreply.github.com>
 2026-05-15 01:04:56 -07:00
Liangsheng Yin 22dfcdaa04 revert flashinfer 0.6.11 bumps (#25310) 2026-05-14 15:28:58 -07:00
Baizhou Zhang f7efff321d [Docker] Fix several dependencies in Dockerfile (#25215) 2026-05-13 20:18:26 -07:00
Cheng WanandClaude Opus 4.7 72b49bfac6 docker, ci: swap GB DeepEP source from fzyzcjy fork to deepseek-ai/DeepEP@hybrid-ep (#25113) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-13 13:25:15 -07:00
Baizhou Zhang 51a9403104 Update flashinfer to 0.6.11.post1 (#25129) 2026-05-13 00:12:19 -07:00
Brayden Zhongandb8zhong d5f3254ed1 [Dependency] Flashinfer 0.6.8post1 -> 0.6.11 (#24452) 
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
 2026-05-12 14:38:32 -07:00
+6
Liangsheng YinBaizhou ZhangClaude Opus 4.7fzyzcjyispobockZhiqiang Xieyueming-yuanDarkSharpnessYuhao Yangyhyang201yhyang201Qiaolin YuEthan SuMingyiCheng WanYihao Wang
 		35870d55ac Deepseek V4 (#23882) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com>
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com>
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com>
 2026-05-07 18:32:21 -07:00
Baizhou Zhang ecb786c8d7 [Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268) 2026-05-06 18:59:01 -07:00
Kangyan-ZhouandClaude Opus 4.7 0f283a515a [Docker] fix: install nixl stub alongside nixl-cuXX binary (#24369) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-04 12:46:38 -07:00
mispa-msandClaude Opus 4.7 62a4df0067 [docker] Fix silently-masked cubin download failure; skip prebuilt cubins on aarch64 (#24234) 
Signed-off-by: misunp <misunp@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-05-04 09:08:01 -07:00
Kangyan-ZhouClaude Opus 4.7Baizhou Zhang
 		52b4609789 [Docker] Prep for torch 2.11: cu129 fix, image validator, dep cleanup (#23593) 
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-05-04 00:37:55 -07:00
Brayden ZhongKangyan ZhouClaude Opus 4.7Baizhou Zhangb8zhongMick
 		88bb5dffe4 [Dependency] Upgrade to Torch 2.11.0 (#21247) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-05-02 12:25:36 -07:00
AlecandKangyan-Zhou 9d95783603 Add Docker image provenance metadata (#24090) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-04-30 21:40:42 -07:00
sglang-botsglang-botKangyan ZhouClaude Opus 4.7
 		9003f24e2b chore: bump sglang-kernel version to 0.4.1.post1 (#23733) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-25 23:23:49 -07:00
sglang-botandsglang-bot f3b88e080a chore: bump flashinfer version to 0.6.8.post1 (#23281) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-23 15:23:03 -07:00
Teng MaandShangming Cai 97fc950635 [Docker] chore: update mooncake wheel version (#20731) 
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2026-04-22 13:36:10 -07:00
mispa-msandClaude Opus 4.7 d8d9d32b29 [docker] Fix stray backslash dropping sgl-model-gateway COPY (#23097) 
Signed-off-by: misunp <misunp@nvidia.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
 2026-04-20 13:44:05 -07:00
ishandhanani 6f6843c582 [Docker] Move Rust toolchain install to torch_deps stage (#23278) 2026-04-20 13:13:10 -07:00
Alex Nails 332ec5e5ee [release] install rust toolchain in main dockerfile (#23014) 2026-04-20 09:50:08 -07:00
Alexis MacAskill e15401ee0e Add runai-model-streamer into Python packages installed in Dockerfile and fix NotADirectoryError Docker regression (#22537) 2026-04-14 16:25:41 -07:00
Mohammad Miadh Angkad 90ef8ce54d [Docker] Remove flashinfer cache copy (#22653) 2026-04-13 09:48:22 -07:00
Mohammad Miadh Angkad 701a0e0c25 [CI/Docker] Clean up redundant flashinfer cubin downloads (#22491) 2026-04-12 12:30:41 -07:00
ishandhanani aa103eab8d [Docker] Optimize Dockerfile for BuildKit layer caching (#22160) 2026-04-09 15:34:57 -07:00
Kangyan-ZhouandClaude Opus 4.6 9d905efa2c [Docker] Fix Trivy CVEs, cubin download 403s, and kernels command order (#22322) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-09 12:26:22 -07:00
sglang-botandsglang-bot df3275bd6c chore: bump flashinfer version to 0.6.7.post3 (#22382) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-08 14:49:45 -07:00
Rain Jiang 1a8eb890f6 Kernels community fa3 (#20796) 2026-04-07 12:48:44 -07:00
sglang-botandsglang-bot 46bf19cdab chore: bump flashinfer version to 0.6.7.post2 (#22097) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-04 02:16:25 -07:00
sglang-botandsglang-bot 84118acf50 chore: bump sglang-kernel version to 0.4.1 (#22009) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-04-03 13:58:35 -07:00
sglang-botsglang-botBaizhou Zhang
 		ca3ba05a7a chore: bump flashinfer version to 0.6.7 (#21422) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-31 21:18:16 -07:00
Kangyan-ZhouandClaude Opus 4.6 ea6b22fb85 Fix CVEs in Docker image: pillow, linux-libc-dev, and broken sgl-model-gateway build (#21789) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-31 20:07:15 -07:00
Rain Jiang cb1e63aba4 bump fa4 to official released fa4 pkg (#20303) 2026-03-17 17:22:56 -07:00
Xiaoyu ZhangandBaizhou Zhang 15097c5c3b Release sglang kernel 0.4.0 (#20440) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-16 20:34:58 +08:00
sglang-botandsglang-bot 93afe15b43 chore: bump flashinfer version to 0.6.6 (#20480) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-03-14 13:05:10 -07:00
Rain Jiang ab4b863546 fix ci by removing nvidia-cutlass-dsl-libs-base and force reinstall n… (#20380) 2026-03-11 13:37:33 -07:00
Mohammad Miadh Angkad 6822941514 [FlashInfer] Bump FlashInfer version from 0.6.3 to 0.6.4 (#19005) 2026-03-02 16:12:09 -08:00