minke.yu
566176d0cf
deps: pin sglang-kernel back to 0.4.7 for torch 2.13 ABI
...
da343ba5d1 (#42604 cherry-pick) bumped sglang-kernel to 0.4.9, whose
wheels are compiled against torch 2.14 (requires_dist torch==2.14.1 and
references c10::cuda::CUDAErrorLogCapture, absent in torch 2.13).
Import died with undefined symbol on this torch-2.13 branch.
sgl-deep-gemm 0.2.2 has no torch pin and stays.
2026-10-19 23:02:11 +08:00
Vladislav Nosivskoy
da343ba5d1
[SM90] Use native block32 DeepGEMM for DeepSeek-V4.1 ( #42604 )
...
Co-authored-by: BBuf <1182563586@qq.com >
(cherry picked from commit 2ff3e6dce1 )
2026-10-19 10:38:40 +08:00
Kangyan-Zhou and Baizhou Zhang
d7ff74b984
[Cherry-pick to release/v0.5.21] [Fix] Restore deferred layer dumps and pin SentencePiece for InternVL ( #41777 ) ( #41788 )
...
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com >
2026-09-29 17:30:38 -07:00
Yoni Gozlan and Yoni Gozlan
583fada954
Port chat_parsing core ( #40477 )
...
Co-authored-by: Yoni Gozlan <yonigozlan@users.noreply.github.com >
2026-09-27 16:14:24 -07:00
17a7484c06
[chore] surface the cookbook to users who pip install sglang ( #40866 )
...
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
2026-09-24 22:56:41 +08:00
Liangsheng Yin
b18ca9ca44
[CI] Bump sgl-eval to 0.1.2 ( #40620 )
2026-09-21 13:00:54 -07:00
ae7a516ba7
feat: use XGrammar V4.1 DSML parameter constraints ( #39026 )
...
Co-authored-by: yuchuan <yuchuan.7streams@gmail.com >
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com >
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com >
2026-09-21 12:12:28 -07:00
DefTruth and copilot-swe-agent[bot]
f1fbbd17bb
[diffusion] chore: update Cache-DiT to 1.5.1 for DMD Calibrator, SVDQuant DQ, etc ( #40104 )
...
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com >
2026-09-19 11:14:33 +08:00
Baizhou Zhang
2fca6d69aa
bumping sgl-deep-gemm to 0.2.0 ( #39371 )
2026-09-14 15:30:31 -07:00
sglang-bot and sglang-bot
96a95171c7
chore: bump sglang-kernel version to 0.4.7 ( #39346 )
...
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com >
2026-09-13 20:49:37 -07:00
06dfe05d65
[Deps] Raise smg-grpc-servicer floor to >=0.9.0 to unbreak SMG E2E CI ( #38801 )
...
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-09-10 13:55:36 -07:00
1b77f498a0
[NVIDIA] Support flashinfer Mega Moe ( #31470 )
...
Co-authored-by: djns99 <40156487+djns99@users.noreply.github.com >
Co-authored-by: 云挚 <ningyunxiao.nyx@antgroup.com >
Co-authored-by: Yangmin Li <yangminl@nvidia.com >
Co-authored-by: Po-Han Huang (NVIDIA) <53919306+nvpohanh@users.noreply.github.com >
2026-09-10 00:22:47 -07:00
Liangsheng Yin
ebfd8c60e5
[CI] Install sgl-eval from PyPI through the test extra ( #37504 )
2026-09-02 01:45:25 -07:00
Baizhou Zhang
07c8f7294d
Bump sgl-deep-gemm to 0.1.7 ( #37279 )
2026-08-31 17:16:34 -07:00
9cf157c252
[Radix Cache] Add Rust TreeCore backend with shared parity tests ( #32710 )
...
Co-authored-by: alphabetc1 <2508695655@qq.com >
Co-authored-by: ispobock <ispobaoke@gmail.com >
2026-09-01 00:26:20 +08:00
Mohammad Miadh Angkad
4f761e8649
[Deps] Bump FlashInfer to 0.6.18 ( #36954 )
2026-08-30 19:02:39 -07:00
Baizhou Zhang
a7ee399904
Bump sgl-deep-gemm to v0.1.6 ( #36998 )
2026-08-29 19:51:02 -07:00
YAMY
137fab2f48
fix(deps): pin compressed-tensors to 0.18.0 ( #36794 )
2026-08-27 22:52:47 -07:00
guzekai01
21258b7a35
feat(humming): FP8 DeepEP dispatch for humming MoE backend ( #31429 )
2026-08-24 18:59:07 +08:00
Mick
46cb12ab45
[diffusion] fix: fix hunyuan3d stale extension lock hangs ( #35989 )
2026-08-22 23:08:44 +08:00
Baizhou Zhang
d287880a7a
Update deepep for SBO feature ( #35450 )
2026-08-19 23:37:13 -07:00
elvischenv and Claude Opus 4.8
1df78c2cf1
chore: bump tilelang to 0.1.12 ( #30874 )
...
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-08-19 17:01:19 -07:00
Baizhou Zhang
cfc6dfb364
Apply latest DeepEP branch ( #34923 )
2026-08-18 16:24:50 -07:00
Lianmin Zheng
a779a2a2a5
[Chore] Move version tag helper to release scripts ( #35196 )
2026-08-18 00:11:12 -07:00
Lianmin Zheng
67e12131df
Build Rust extensions on demand in source checkouts ( #34994 )
2026-08-16 14:58:06 -07:00
Baizhou Zhang
7769f54feb
[Kimi-K3] Use explicit SiTU activation for MegaMoE ( #34883 )
2026-08-15 01:41:59 -07:00
Brayden Zhong and Brayden Zhong
5e65dd01a7
Remove the torchao integration (--torchao-config) ( #34304 )
...
Co-authored-by: Brayden Zhong <brayden@radixark.ai >
2026-08-14 21:49:11 +08:00
Mohammad Miadh Angkad
00e57d74f0
Bump FlashInfer to 0.6.17 and remove Kimi K3 workarounds ( #33997 )
2026-08-12 02:17:26 -07:00
Mohammad Miadh Angkad
a3bd7d9401
Bump CuTeDSL to 4.6.2 ( #34372 )
2026-08-12 00:35:35 +08:00
Liangsheng Yin
c80a38edcd
[Fix] Pin cuda-tile to 1.6.0rc5 to unblock Python 3.10 x86_64 installs ( #34321 )
2026-08-10 15:09:47 -07:00
Sam Shleifer and Claude Fable 5
afb4f37ca5
[Inkling] silu_and_mul: replace helion kernels with plain Triton ( #33903 )
...
Co-authored-by: Claude Fable 5 <noreply@anthropic.com >
2026-08-08 15:00:23 +08:00
f64328c7f6
[diffusion] feat: support quant-videogen prq kv-cache quantization (memory-saving) for causal-dit ( #32581 )
...
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
Co-authored-by: Mick <mickjagger19@icloud.com >
2026-08-08 12:56:54 +08:00
Baizhou Zhang
eb3cc879e0
Install DeepEP from release wheels ( #33932 )
2026-08-07 15:38:44 -07:00
Mohammad Miadh Angkad and Brayden Zhong
434e646282
[Deps] Upgrade CUDA PyTorch stack to 2.13 ( #28836 )
...
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca >
2026-08-06 12:08:44 -07:00
+26
abddb1c7e9
[Kimi] Support kimi-k3 ( #32541 )
...
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com >
Co-authored-by: Xiaoyu Zhang <1182563586@qq.com >
Co-authored-by: Mick <mickjagger19@icloud.com >
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com >
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com >
Co-authored-by: Ke Bao <ispobaoke@gmail.com >
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com >
Co-authored-by: Chunan Zeng <zcnrex@gmail.com >
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai >
Co-authored-by: Ziyi Xu <ziyi.xu@radixark.ai >
Co-authored-by: Zijie Xia <37504505+zijiexia@users.noreply.github.com >
Co-authored-by: Yuwei An <ayw.sirius19@gmail.com >
Co-authored-by: zhangxiaohao <1024393531@qq.com >
Co-authored-by: Yangmin Li <yangminl@nvidia.com >
Co-authored-by: Julien Lin <jullin@nvidia.com >
Co-authored-by: Hao Phan <htphan@nvidia.com >
Co-authored-by: Thomas Wang <1am9trash@gmail.com >
Co-authored-by: RolaoDenthu <xinyisong0111@gmail.com >
Co-authored-by: pigeonsoup <32922982+pigeonsoup@users.noreply.github.com >
Co-authored-by: HaiShaw <hixiao@gmail.com >
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com >
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com >
Co-authored-by: Lee Nau <lee.nau@gmail.com >
Co-authored-by: HMING <126185151+Hearum@users.noreply.github.com >
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com >
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com >
Co-authored-by: Byron Hsu <byron+per@periodiclabs.ai >
Co-authored-by: Claude Opus 5 <noreply@anthropic.com >
Co-authored-by: Thomas Wang <thomawan@amd.com >
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com >
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com >
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai >
Co-authored-by: BBuf <xiaoyu.zhang@radixark.ai >
Co-authored-by: Hanming Lu <hanminglu@meta.com >
Co-authored-by: Xinyi Song <xinyis10@illinois.edu >
2026-08-04 13:22:49 -07:00
Oguz Ulgen and Cheng Wan
c113ead98a
Bump helion version to 1.4 ( #32562 )
...
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com >
2026-08-03 19:10:31 -07:00
Xiaoyu Zhang
c32c4ef79c
[Kernel] Move sgl-kernel under sglang.kernels.aot ( #32648 )
2026-07-29 17:25:00 +08:00
Cheng Wan and Shu Wang
659d349b61
[core/loader] Add presharded load format ( #24256 )
...
Co-authored-by: Shu Wang <shuwanguc@google.com >
2026-07-25 13:03:39 -07:00
3079157175
Fix PyPI release: drop the git-only sgl-eval dep from packaged metadata ( #32354 )
...
Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai >
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com >
2026-07-24 20:00:57 -04:00
962c076934
Decode input_audio media containers with PyAV & Update memory profiler ( #31832 )
...
Signed-off-by: Shiyan Deng <dsy842974287@meta.com >
Signed-off-by: Lianmin Zheng <lianminzheng@gmail.com >
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com >
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com >
2026-07-24 16:18:45 -07:00
Baizhou Zhang
f15b43242b
Bump sgl-deep-gemm to 0.1.5 ( #32345 )
2026-07-24 14:03:38 -07:00
Rain Jiang
7fe82dd02e
create rust workspace ( #32014 )
2026-07-23 12:02:41 -07:00
Xiaoyu Zhang and Claude Opus 4.8
99f636a86f
[Kernel] RFC #29630 finale: retire sglang.jit_kernel into sglang.kernels ( #32072 )
...
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com >
2026-07-23 08:35:09 +08:00
Mohammad Miadh Angkad and Brayden Zhong
0c29c8fece
Bump FlashInfer to 0.6.15.post1 ( #31927 )
...
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca >
2026-07-22 14:21:59 -07:00
Mohammad Miadh Angkad
3d82dacd58
Bump CuTe DSL to 4.6.0 ( #31714 )
2026-07-20 02:11:59 -07:00
02236fa38c
Add Inkling model support ( #31681 )
...
Co-authored-by: Chunan Zeng <zcnrex@gmail.com >
Co-authored-by: Ke Bao <ispobaoke@gmail.com >
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com >
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com >
Co-authored-by: Qiaolin Yu <qiaolin.yu@radixark.ai >
Co-authored-by: Zhichen Zeng <zczeng@uw.edu >
Co-authored-by: Aurick Qiao <aurick@thinkingmachines.ai >
Co-authored-by: Joseph <jk@thinkingmachines.ai >
2026-07-19 22:57:37 -07:00
Baizhou Zhang
304a529558
Revert "Bump FlashInfer to 0.6.15 and revert regressions" ( #31625 )
2026-07-17 16:46:33 -07:00
Lianmin Zheng
c95026aed3
Upgrade llguidance to 1.7.6 ( #31484 )
2026-07-17 16:31:44 -07:00
sglang-bot and sglang-bot
0ad0ff2e9e
chore: bump sglang-kernel version to 0.4.5 ( #31618 )
...
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com >
2026-07-17 15:58:36 -07:00
Mohammad Miadh Angkad and Brayden Zhong
d67aa05697
Bump FlashInfer to 0.6.15 and revert regressions ( #31502 )
...
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca >
2026-07-17 00:50:12 -07:00