Commit Graph
85 Commits
Author SHA1 Message Date
+26 abddb1c7e9 [Kimi] Support kimi-k3 (#32541)
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Ziyi Xu <ziyi.xu@radixark.ai>
Co-authored-by: Zijie Xia <37504505+zijiexia@users.noreply.github.com>
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com>
Co-authored-by: zhangxiaohao <1024393531@qq.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Julien Lin <jullin@nvidia.com>
Co-authored-by: Hao Phan <htphan@nvidia.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: RolaoDenthu <xinyisong0111@gmail.com>
Co-authored-by: pigeonsoup <32922982+pigeonsoup@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>
Co-authored-by: Lee Nau <lee.nau@gmail.com>
Co-authored-by: HMING <126185151+Hearum@users.noreply.github.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai>
Co-authored-by: Claude Opus 5 <noreply@anthropic.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>
Co-authored-by: BBuf <xiaoyu.zhang@radixark.ai>
Co-authored-by: Hanming Lu <hanminglu@meta.com>
Co-authored-by: Xinyi Song <xinyis10@illinois.edu>
2026-08-04 13:22:49 -07:00
Liangsheng Yin 157401f050 [CI] Build the Rust extensions on the 5090 pool and seed the cache from main (#33460) 2026-08-03 23:33:20 -07:00
Liangsheng Yin cdff33d738 [CI] Build the Rust extension modules once per run instead of in every CUDA job (#33384) 2026-08-03 18:56:48 -07:00
Liangsheng Yin c949e91f18 [CI] Remove the orphaned site-packages sglang skeleton that shadows the checkout (#33441) 2026-08-03 16:31:25 -07:00
Liangsheng Yin 22c2e2bcad [CI] Persist the cargo build cache across CUDA CI jobs (#33361) 2026-08-03 16:23:09 -07:00
Liangsheng Yin b8f6181bff [CI] Build the Rust extensions with the pinned toolchain instead of the image default (#33437) 2026-08-03 16:16:34 -07:00
Xiaoyu Zhang c32c4ef79c [Kernel] Move sgl-kernel under sglang.kernels.aot (#32648) 2026-07-29 17:25:00 +08:00
Shangming Cai bdd0698541 chore: bump mooncake version to 0.3.12.post1 (#32302) 2026-07-25 14:12:46 +08:00
3079157175 Fix PyPI release: drop the git-only sgl-eval dep from packaged metadata (#32354)
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-07-24 20:00:57 -04:00
Mohammad Miadh Angkad 3d82dacd58 Bump CuTe DSL to 4.6.0 (#31714) 2026-07-20 02:11:59 -07:00
Hank Han b22f20b660 [CI] Fix CUDA 12 NVIDIA wheel cleanup (#31035)
Signed-off-by: Hank Han <hanhan7630@outlook.com>
2026-07-15 10:06:11 +08:00
7431f35fd8 Delete CUTLASS FP8 blockwise for SM90 and SM100, move SM120 to JIT and add SwapAB (#30438)
Co-authored-by: Brayden Zhong <brayden.zhong@radixark.ai>
Co-authored-by: Claude Sonnet 5 <noreply@anthropic.com>
Co-authored-by: root <root@sgl-b300-inference.datacrunch.io>
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-07-14 09:31:32 +08:00
Alison Shao 32cb89d412 ci: prune uv cache in job teardown to bound its growth (#30813) 2026-07-11 18:01:23 +08:00
Xinyuan Tong b76dd0be69 Fix Mistral GSM8K chat eval (#27757) 2026-07-09 21:08:48 -07:00
2c6cd1ef41 [Dep] Upgrade flashinfer to 0.6.14 (#29910)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-07-09 17:52:33 -07:00
Xiaoyu Zhang 6dd0cefb2a [CI] Revert ModelOpt NVFP4 threshold relax (#29844) 2026-07-04 21:17:32 +08:00
Shangming Cai 43b1fb95f6 [CI] Optimize nixl dependency installation script (#28950)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-06-23 01:58:22 +08:00
Shangming Cai 06e001347a [CI] Update nixl installation to include nixl-cu13 for h20 runner (#28930) 2026-06-22 20:35:14 +08:00
Shangming Cai b8e64fb56d [CI] Modify nixl installation to force reinstall (#28927) 2026-06-22 19:26:26 +08:00
Lianmin Zheng 3975ea5ac7 Fix H20 torch import reinstall fallback (#28818) 2026-06-21 04:50:46 -07:00
Kangyan-ZhouandClaude Fable 5 cad43d3212 [CI] Reclaim leaked /dev/shm segments on server startup (#28089)
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
2026-06-15 16:14:08 -07:00
Baizhou Zhang 435c4ffb30 [CI] Clean DeepSeek V4 tests and installation scripts (#26609) 2026-05-28 15:22:59 -07:00
Shangming Cai 7f2829af39 chore: bump mooncake version to 0.3.11.post1 (#25989) 2026-05-25 16:51:03 +08:00
Liangsheng Yin acb8310183 ci: self-heal $GITHUB_PATH/$GITHUB_ENV writes (#26037) 2026-05-21 21:28:43 -07:00
Kangyan-ZhouandLiangsheng Yin caa9f08294 [CI] Force-reinstall nvidia-cutlass-dsl-libs-cu13 last to avoid wheel-mix TypeError (#25958)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-21 22:01:42 +08:00
Baizhou Zhang cd012ada58 [Fix] Fix extra uninstall of cutlass packages (#25756) 2026-05-19 10:01:38 -07:00
Baizhou Zhangandhnyls2002 b79e4b1e68 [Fix] Try to fix error caused by latest cutedsl packages (#25690)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-05-18 16:51:32 -07:00
Alison Shao b71d74673c ci: combine H200 8-GPU warmup steps and surface server log on every path (#24253) 2026-05-13 20:09:52 -07:00
Cheng WanandClaude Opus 4.7 72b49bfac6 docker, ci: swap GB DeepEP source from fzyzcjy fork to deepseek-ai/DeepEP@hybrid-ep (#25113)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-13 13:25:15 -07:00
Hank Han c027ae677c ci: align torch CUDA wheel checks (#24940) 2026-05-11 16:22:20 +08:00
ef5e9f8aba [DSV4] Cherry pick missing commits from deepseek_v4 branch and enhance tests (#24793)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
2026-05-09 04:15:37 -07:00
+6 35870d55ac Deepseek V4 (#23882)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: yueming-yuan <yym022502@gmail.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Qiaolin Yu <90088090+qiaolin-yu@users.noreply.github.com>
Co-authored-by: Ethan (Yusheng) Su <11704492+yushengsu-thu@users.noreply.github.com>
Co-authored-by: Mingyi <27337995+wisclmy0611@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Yihao Wang <42559837+againstentropy@users.noreply.github.com>
2026-05-07 18:32:21 -07:00
Baizhou Zhang ecb786c8d7 [Kernel] Deprecate DeepGemm in sgl kernel and apply custom wheel sgl-deep-gemm (#24268) 2026-05-06 18:59:01 -07:00
Mohammad Miadh Angkad b7d8ceb444 [CI] Keep custom sgl-kernel wheel in CUDA CI (#24291) 2026-05-02 21:53:21 -07:00
88bb5dffe4 [Dependency] Upgrade to Torch 2.11.0 (#21247)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: b8zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-05-02 12:25:36 -07:00
24a6b3084d [CI] drop --prerelease allow from uv pip install suffix (#24265)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2026-05-02 12:25:01 -07:00
Kangyan-ZhouandClaude Opus 4.7 2e72a36420 [CI] Restore SMG e2e on 2-gpu-h100 / 4-gpu-h100 runners (#24222)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-01 23:55:20 -07:00
ishandhanani 5b7ce417d0 [P/D disagg] - support decode side radix cache (#19746) 2026-05-01 21:55:34 +08:00
Alison Shao dc395bc059 ci: run setup_ld_library_path before install_sglang_kernel (#24141) 2026-04-30 10:55:45 -07:00
Alex NailsandClaude Opus 4.7 c3ab5bec7d ci: consolidate rust + protoc install across workflows (#23700)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-29 13:39:02 -07:00
Kangyan-ZhouandClaude Opus 4.7 feec1ac7f9 ci: clean up stale-CUDA mooncake variant in install_extra_deps (#23960)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-28 19:32:38 -07:00
Lianmin Zheng a4facdf3f6 [CI] Refactor ci_install_dependency.sh into standalone functions (#23592) 2026-04-24 17:39:39 -07:00
Jia Guo 6428392b6f ci: fix cu129 wheel tagging + pipefail-abort in install script (follow-up to #23497) (#23587) 2026-04-23 14:52:58 -07:00
Jia Guo b3e6cf60aa ci: build sgl-kernel wheels for both cu129 and cu130 (#23497) 2026-04-22 18:08:36 -07:00
Shangming Cai fa85bdf4ed chore: bump mooncake version to 0.3.10.post2 (#23439) 2026-04-22 15:01:47 +08:00
6ecd6f84db [CI] Add per-job uv venv isolation and upgrade CI version to Cuda 13 (#23119)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Co-authored-by: Alison Shao <a.shao@wustl.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-04-19 05:32:36 -07:00
Alex Nails 43eb66028f ci: install rust toolchain in ci_install_dependency.sh (#23017) 2026-04-16 23:18:22 -07:00
Baizhou ZhangandClaude Opus 4.6 8fe9bbffb6 [CI] Reinstall flashinfer-jit-cache on CUDA version mismatch (#22741)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-13 23:04:23 -07:00
Baizhou Zhang b441317aa4 Revert "Upgrade CI default CUDA version from 12.9 to 13.0" (#22727) 2026-04-13 14:39:24 -07:00
Alison Shao 3f4fbc165d Upgrade CI default CUDA version from 12.9 to 13.0 (#21441) 2026-04-12 21:48:40 -07:00