Commit Graph
121 Commits
Author SHA1 Message Date
e9b22a0818 [Perf] [AMD] monokernels: Let a plugin skip per-step attention metadata (#44601)
Co-authored-by: Kevin Mi <kevin.mi@radixark.ai>
Co-authored-by: kkHuang-amd <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-18 14:04:57 +00:00
Zhaoyi Li 8a4239fbdc [Fix] [AMD] mooncake: Bump Mooncake to v0.3.14-rc1 for cross-node KV transfer (#44404) 2026-10-18 00:22:55 -07:00
YC Yen-Ching Tseng 9246acd462 [CI] [AMD] aiter: pin aiter commit to 2bb549 for rocm10.1 gfx1250 (#44620) 2026-10-16 17:50:20 +08:00
kkandwunhuang 536cdb4b04 [Feat] [AMD] docker: Install the sgl-amd-mono monokernel plugin in the ROCm image (#44621)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-10-16 01:20:40 -07:00
Michael bba535ebb4 [Fix] [AMD] docker: Repair the AITER build step after the 2bb549102 pin bump (#44534) 2026-10-15 11:18:41 -07:00
YC Yen-Ching Tseng e87e32b311 [Feat] [AMD] docker: Release ROCm 10.1 for gfx1250 in parallel with ROCm 10.0 (#42699) 2026-10-15 22:59:54 +08:00
kangwangamd 28703575f9 [AMD] Update ROCm AITER pin to 2bb549102 (#44379) 2026-10-15 16:10:41 +08:00
Duyi-Wang 6781da8e5b [AMD] [Docker] Update MoRI to v1.2.4 (#43834) 2026-10-12 14:45:42 -07:00
Xinyi Song 23f890613e [AMD] Patch aiter's group32 MXFP8 GEMM masked-scale fix (#43319) 2026-10-09 02:08:44 -07:00
Yihao WangandClaude Opus 5.5 11972e5207 [deps] bump transformers to 5.19.0 (#42784)
Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-07 17:04:08 +08:00
Michael 2cd92d10b9 [AMD] Skip the AITER #6042/#5967 patches on gfx1250 (#42219) 2026-10-02 21:10:01 +08:00
Thomas Wang ffb134188b [AMD] Update aiter version for v41 (#42023) 2026-10-01 01:49:45 -07:00
547286bb5a [Deps] Bump transformers to 5.17.0 (#39012)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-09-30 12:52:02 -07:00
34f090053e [AMD] [Docker] Remove unused LLVM 18 setup from ROCm TileLang build (#41387)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
2026-09-27 22:41:08 -07:00
Thomas Wang 1446e24d13 [AMD] Add .co for deepseek v4 fp8 decode kernel and add group decode opt (#41120) 2026-09-24 12:21:34 -07:00
kangwangamd 264da63319 [AMD] Update ROCm AITER pin to acf8fdf9 (#39965) 2026-09-21 22:01:17 -07:00
Duyi-Wang 80e9a4ec74 [AMD] [Docker] Update MoRI to v1.2.3 (#38411) 2026-09-07 21:24:43 -07:00
Thomas Wang 503511c963 [AMD] Cherry-pick aiter commit for dsv4 a8w8 bpreshuffle gemm config (#38256) 2026-09-07 11:29:31 +08:00
kangwangamd b9b39f222d [AMD] Update ROCm AITER pin to 4ad9983 (#37784) 2026-09-06 19:22:37 -07:00
f8cbf000f4 [AMD] Enable FP4 indexer for Deepseek V4 (#37353)
Co-authored-by: 1am9trash <1am9trash@gmail.com>
Co-authored-by: AMD-yanfeiwang <256076023+AMD-yanfeiwang@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-09-02 09:45:08 -07:00
ce7e79b32c [AMD] Fix nightly ROCm 7.0 image build: patch missing <optional> include in AITER topk kernel (#36216)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
Co-authored-by: Chen <bingxche@amd.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
2026-09-01 19:06:32 +08:00
Zhaoyi Li 458987b5ac [AMD][MORI] Bump MoRI to 7c51d18 for ionic RoCE dmabuf fix (#509) (#37286) 2026-08-31 21:37:05 -07:00
+1 3865efc9f7 [AMD] support gfx1250 on ROCM 10 (#36871)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Kao <akao@amd.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: sogalin_codegen <39478626+sogalin@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-08-31 01:19:11 -07:00
Thomas Wang 67bd163a48 [AMD] Cherry-pick dsv4 fp4 kv-cache fix aiter commit (#37083) 2026-08-29 21:17:36 -07:00
Bingxu Chen 9579bff860 [AMD] Add ROCm 10 (gfx942 / gfx950) release images (#36434) 2026-08-28 08:03:39 -07:00
Bingxu Chen 6a12583679 [AMD] Update ROCm AITER pin to c16d44b (#35810) 2026-08-21 00:02:17 -07:00
Bingxu Chen 78c964d9d7 [AMD] Retry transient network failures in ROCm Dockerfile curl fetches (#35654) 2026-08-20 21:54:24 -07:00
chuyehandChen c7478228dd [AMD] [Docker] Upgrade Python 3.12 + torch 2.11 + triton 3.7 in ROCm 7.2.4 (#30984)
Co-authored-by: Chen <bingxche@amd.com>
2026-08-19 18:18:31 -07:00
Lianmin Zheng 67e12131df Build Rust extensions on demand in source checkouts (#34994) 2026-08-16 14:58:06 -07:00
Brayden ZhongandBrayden Zhong 5e65dd01a7 Remove the torchao integration (--torchao-config) (#34304)
Co-authored-by: Brayden Zhong <brayden@radixark.ai>
2026-08-14 21:49:11 +08:00
Bingxu ChenandYC Yen-Ching Tseng 6f3fe13a9c [AMD] Install AITER's pinned Triton wheel in the ROCm 7.2 image (#34364)
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
2026-08-11 16:36:45 +08:00
Zhaoyi Li b327d76682 [AMD] Bump mori to latest in sglang (#33462) 2026-08-04 15:12:40 -07:00
Bingxu ChenandCursor Agent 48c1b37a33 [AMD] Update ROCm AITER pin to d9e5ef7 (#32939)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2026-07-30 22:05:03 +08:00
Bingxu Chen 3d6e1e6f81 [AMD] Revert ROCm AITER pin to 9127c94 (#32879) 2026-07-30 11:53:49 +08:00
Baizhou Zhang d12ea3e9ba docker: add Kimi K3 images (#32760) 2026-07-29 03:02:28 -07:00
Xiaoyu Zhang c32c4ef79c [Kernel] Move sgl-kernel under sglang.kernels.aot (#32648) 2026-07-29 17:25:00 +08:00
02236fa38c Add Inkling model support (#31681)
Co-authored-by: Chunan Zeng <zcnrex@gmail.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
Co-authored-by: Yanbin Jiang <jybsuper@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Qiaolin Yu <qiaolin.yu@radixark.ai>
Co-authored-by: Zhichen Zeng <zczeng@uw.edu>
Co-authored-by: Aurick Qiao <aurick@thinkingmachines.ai>
Co-authored-by: Joseph <jk@thinkingmachines.ai>
2026-07-19 22:57:37 -07:00
YC Yen-Ching Tseng 8c5e0cee18 [AMD] Bump MoRI to f7e6ac6 to fix ROCm install_dependency build break (#31406) 2026-07-15 23:40:18 -07:00
karverma-amd ec32590025 feat(moriep): add fp4 combine dtype (SGLANG_MORI_COMBINE_DTYPE=fp4) (#30706) 2026-07-15 14:21:41 -07:00
YC Yen-Ching Tseng 80965db8d3 [AMD] Pin cmake==4.3.4 in ROCm Dockerfile to fix MoRI gtest_discover build break (#30942) 2026-07-12 18:20:17 -07:00
Duyi-Wang c9ceab34cf [AMD] [Docker] Update MoRI to v1.2.1 (#29394) 2026-07-05 19:37:04 -07:00
Zhaoyi Li 0ab095eb3f [AMD]: hot-patch transformers dynamic_module_utils symlink bug (#29986) 2026-07-03 18:20:36 +08:00
Zhaoyi LiandMichael a3f6680874 [AMD]: docker(rocm) bump Mooncake to latest main + enable multi-protocol (#27730)
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
2026-07-01 17:41:46 -07:00
Bingxu Chen 81a472efcc [AMD] Update ROCm AITER pin to 9127c94 (#29816) 2026-07-01 01:09:11 -07:00
Zhaoyi Liandbingxche 6bf15aa2b9 [AMD]: Enable NIXL PD disaggregation for ROCm(1/n) (#28348)
Co-authored-by: bingxche <bingxche@amd.com>
2026-06-29 21:23:09 -07:00
Xinyuan Tong 7c23d2255a [minimax-m3] Split 1/4: sparse attention ops + JIT kernels + config foundation (#28712) 2026-06-22 13:10:43 -07:00
Bingxu Chen 9864059e2b [AMD] Update AITER commit (#28249) 2026-06-15 02:04:34 -07:00
Thomas Wang ddbe5ff2f1 [AMD] Pin maturin<1.14 to fix ROCm image build failure (#27999) 2026-06-11 22:13:27 -07:00
Bingxu Chen 4704b10d0d [AMD] Update MoRI to v1.2.0 (#27669) 2026-06-09 22:41:53 -07:00
Bingxu Chen 3607cbd65a [AMD] update ROCm AITER commit (#27555) 2026-06-08 08:49:10 -07:00