minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
12,825 Commits 2 Branches 0 Tags
f5049709b3239cd754f09f779bd85644b01ac4a2
Commit Graph
79 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
YC Yen-Ching Tseng 22bfae0d1d [AMD] Auto-fallback NSA indexer to page_size=1 when aiter preshuffle gluon kernel is unavailable (Deepseek v3.2) (#25205) 2026-05-14 00:01:56 -07:00
YC Yen-Ching Tseng cf92ccbf18 [AMD] Run jit kernel PR test through run_suite.py register mechanism (#24987) 2026-05-13 02:57:08 -07:00
YC Yen-Ching Tseng 72b266d59b [AMD] Disable unittest fail-fast for deepseekv4 perf test (#25039) 2026-05-12 22:47:31 -07:00
YC Yen-Ching Tseng 6b6963f426 [AMD] Update scripts/ci/amd/ensure_vram_clear.sh (#24586) 2026-05-11 18:47:09 +08:00
YC Yen-Ching Tseng 126a36a986 [AMD] VRAM cleanup step to AMD nightly test workflows (#24612) 2026-05-11 11:08:51 +08:00
YC Yen-Ching Tseng b35d14b64d [AMD] Retry logic for lmms-eval installation (#24615) 2026-05-11 10:55:24 +08:00
YC Yen-Ching Tseng e1150f66db [AMD][diffusion] Temporal-unfolded batched Conv2D for ROCm VAE decode (#22971) 2026-05-08 02:32:14 -07:00
YC Yen-Ching Tsengandbingxche c18879054f [AMD] Route PR multimodal tests to MI325 (#24614) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-05-07 23:26:05 +08:00
YC Yen-Ching Tseng 64613543ea [AMD] fix(docker): unbreak nightly when archive.ubuntu.com:80 is unreachable (#24407) 2026-05-05 00:39:14 -07:00
YC Yen-Ching Tsengandbingxche cf4f462094 [AMD] Nightly image release for deepseek v4 (#24155) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-30 23:49:13 +08:00
YC Yen-Ching Tseng 9e68c8527e [AMD] Update AMD Nightly Test checkout mechanism (#24112) 2026-04-30 11:36:18 +08:00
YC Yen-Ching Tsengandbingxche 155e333039 [AMD] Update AMD CI workflow concurrency group (#24065) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-29 22:39:18 +08:00
YC Yen-Ching Tseng adc59325bc [AMD] Optimize MiniMax-M2.5 - enable fused Triton kernel for FP8 KV cache write in aiter decode path (#23620) 2026-04-24 22:23:49 -07:00
YC Yen-Ching Tseng fb272d27db [AMD] Optimize MiniMax-M2.5 - use aiter biased_grouped_topk for sigmoid scoring in MoE routing (#23611) 2026-04-24 22:18:08 -07:00
YC Yen-Ching Tsengandbingxche b060a5ccfd [AMD] Fix nightly version tag selection (#23644) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-24 17:39:47 +08:00
YC Yen-Ching Tsengandbingxche 30909cbeeb [AMD] upd local registry address (#23607) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-24 12:07:09 +08:00
YC Yen-Ching Tseng 74fdf9cd77 [AMD] CI - Fix the cancelled guard to AMD CI (#23338) 2026-04-21 15:45:26 +08:00
YC Yen-Ching Tseng da62e90904 [AMD] Fix multimodal timeout issue : rocm7.2 PR Test (#23247) 2026-04-20 18:36:08 +08:00
YC Yen-Ching Tsengandbingxche cf4b84f839 [AMD] Update AMD workflow name (#23245) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-20 18:18:24 +08:00
YC Yen-Ching Tseng 32b7777f6c [AMD]Fix AMD multimodal-gen-test-2-gpu timeout by adding partition for standalone test (#23130) 2026-04-19 23:16:18 +08:00
YC Yen-Ching Tseng 5d4e899477 [AMD] Fix AMD Multimodal Test - skip nvfp4 tests (#23045) 2026-04-17 09:02:39 -07:00
YC Yen-Ching Tsengandbingxche f399997d2f [AMD] mirror nightly images to local registry and prefer LAN pulls (#23073) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-17 19:49:26 +08:00
YC Yen-Ching Tsengandbingxche 8c13295842 [AMD] fix AMD CI gate (#22974) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-17 18:32:26 +08:00
YC Yen-Ching Tseng f0f0148167 Revert "feat: Support MXFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#19143)" (#23031) 2026-04-16 21:53:25 -07:00
YC Yen-Ching Tsengandbingxche d44eb16ac6 [AMD] Replace push trigger with scheduled runs and enable parallel stage execution (#22489) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-14 13:33:29 +08:00
YC Yen-Ching TsengandHAI 3ce72252de [AMD] Fix Timeout: stage-b-test-2-gpu-large-amd,stage-b-test-1-gpu-large-amd (#22228) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-04-10 22:55:44 -07:00
YC Yen-Ching Tseng cf1436d6ae [AMD] Diffusion - Enabel rocm miopen tuning on vae (#22428) 2026-04-10 22:47:25 -07:00
YC Yen-Ching Tseng e14876742a [AMD] Fix test_kimi_k25_mxfp4.py : stage-c-test-large-8-gpu-amd-mi35x (linux-mi35x-gpu-8, 1) (#22188) 2026-04-07 13:48:37 -07:00
YC Yen-Ching TsengBingxu ChenHaiShaw
 		a188208e9a [AMD] Optimize Qwen3-VL decode - fuse QK-norm + 3D mRoPE + KV cache write (#21458) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-31 23:34:07 -07:00
YC Yen-Ching Tseng 448b528720 [AMD] Adjust AMD 4gpu partitions (#21533) 2026-03-27 15:59:26 +08:00
YC Yen-Ching Tseng 013fa55630 [AMD] CI - fix amd 4-GPU PR test (#21444) 2026-03-26 18:16:33 +08:00
YC Yen-Ching Tseng c494e47843 [AMD] Fix stage-b-test-small-1-gpu-amd (test_tool_choice.py) (#19868) 2026-03-25 01:10:21 -07:00
YC Yen-Ching Tsengandbingxche 71f5ae3f9a [AMD] Fix AMD Nightly Test - Transformers 5.3.0 incompatibility and gemma2-27b kv issue (#21193) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-24 10:41:44 -07:00
YC Yen-Ching Tsengandwunhuang f97c09dac1 [AMD] Enable aiter unified attention for non-SWA models (Qwen3-VL) (#20897) 
Co-authored-by: wunhuang <wunhuang@amd.com>
 2026-03-20 12:07:41 -07:00
YC Yen-Ching Tseng 9e629d31fd [AMD] CI - Fix AMD CI (multimodal test, move flaky test to non-deterministic group) (#20815) 2026-03-19 11:50:19 -07:00
YC Yen-Ching TsengandBingxu Chen 671bd266c1 [AMD] CI - update amd nightly cronjob (#20928) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-03-19 18:10:17 +08:00
YC Yen-Ching Tseng 41c8651c0d Revert "[AMD] CI - skip tests on mi325 (#20660)" (#20802) 2026-03-18 09:01:51 +08:00
YC Yen-Ching Tsengandbillisyahao 18dd5c972d [AMD] Fix AMD CI : stage-c-large-8-gpu-amd-mi35x (#20521) 
Co-authored-by: billisyahao <bill.he@amd.com>
 2026-03-16 23:53:33 -07:00
YC Yen-Ching Tsengandbingxche a92872cbc3 [AMD] CI - skip tests on mi325 (#20660) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-03-16 13:35:04 +08:00
YC Tseng c37ef7f18b [AMD] diffusion refactor: move ROCM VAE optimization to Platform abstraction (#20496) 2026-03-13 13:10:05 -07:00
YC TsengandHaiShaw 78a467c74a [AMD] [diffusion] feat: enable AITer GroupNorm for VAE decode on ROCm (#20170) 
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-12 16:38:19 -07:00
YC TsengAlan KaoClaude Sonnet 4.6
 		1aa56cca37 [AMD] Add wheel support for sglang (#16782) 
Co-authored-by: Alan Kao <akao@amd.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-09 22:42:41 -07:00
YC Tseng c267bdb805 [AMD] Fix AMD CI - stage-b-small-1-gpu-amd (partition 7) (#20028) 2026-03-06 23:49:14 -08:00
YC Tsengandbingxche 23eb24ddfe [AMD] Update/fix AMD CI workflow dispatch mechanism (#20014) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-06 15:27:44 +08:00
YC Tsengandbingxche b5edab57f2 [AMD] CI - Add MI35x nightly/PR tests for kv-cache-fp8 and allreduce-fusion (DeepSeek) (#19834) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-05 07:09:57 -08:00
YC Tseng 525d046990 [AMD] CI - new runner label for MI325 8gpu (#19815) 2026-03-04 10:45:23 +08:00
YC Tsengandbingxche 060720c573 [AMD] AMD new CI runner (#19739) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-03 11:17:12 +08:00
YC Tsengandbingxche 8b4c387aa2 [AMD] Update AITER Scout Workflow (#19735) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-03 10:14:31 +08:00
YC TsengandBingxu Chen f2c5503542 [AMD] AMD AITER Scout Workflow (#19467) 
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
 2026-03-02 16:10:44 +08:00
YC TsengandBingxu Chen 0404ef9023 [AMD] Add triggering path for multimodal test in pr-test-amd (#19515) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-02-28 12:46:37 +08:00
YC Tseng d6f0ef677b [AMD] reset AMD image release time and reduce CI queue time (#18707) 2026-02-12 01:05:53 -08:00
YC TsengAlan KaobingxcheMichael
 		20554a0a4f [AMD] rocm 7.2 image release, PR test, Nightly Test (#17799) 
Co-authored-by: Alan Kao <akao@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
 2026-02-11 21:29:25 -08:00
YC Tsengandbingxche d94d0af573 [AMD] Turn on aiter-prebuild (#18425) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-02-10 00:49:35 -08:00
YC TsengandBingxu Chen 28717e3d28 [AMD] CI - Fix AMD daily image release and install dependency (#18452) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-02-08 22:20:09 -08:00
YC Tseng ea04bc1dd6 [AMD] Fix aiter version in rocm image (#18076) 2026-02-01 19:00:38 -08:00
YC Tseng b7b1ba329e [AMD] fix pip sglang version (#17950) 2026-01-29 17:19:57 -08:00
YC TsengandBingxu Chen 52bca42870 [AMD] CI - enable deepseekv3.2 on MI325-8gpu and merge perf/accuracy test suites into stage-b suites (#17633) 
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
 2026-01-27 18:54:36 -08:00
YC TsengBingxu Chenbingxchemichaelzhang-ai
 		04a10c9bc2 [AMD] CI - migrate perf test and fix stage-b-test-1-gpu-amd (#17340) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-22 18:45:05 -08:00
YC Tsengandmichaelzhang-ai 17807caf82 [AMD] fix amd ci dpskv32 (#17432) 
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-21 20:34:24 -08:00
YC Tseng b827e9d381 [AMD] CI - Fix sgl-kernel unittest (#17490) 2026-01-21 09:23:28 -08:00
YC Tseng e9a44ea607 [AMD] fix perf ci errors (#17363) 2026-01-19 13:04:15 -08:00
YC Tseng 1a053a810c [AMD] CI - add partitions for stage-b-test-small-1-gpu-amd (#17345) 2026-01-19 08:16:07 -08:00
YC Tseng 968c4f55b1 [AMD] Enable DeepseekV3.2 test for AMD CI (#16934) 2026-01-15 21:58:46 -08:00
YC Tseng b1ee75ae7b [AMD] CI - enable test case for amd ci : triton_attention_kernels , torch_compile_moe (#16559) 2026-01-12 00:06:31 -08:00
YC Tseng ccd0fb3291 [AMD] Change AITER package name (#16721) 2026-01-08 21:17:20 -08:00
YC TsengandBingxu Chen 4e999404c3 [AMD] Fix CI - unit-test-backend-1-gpu-amd-mi35x and unit-test-backend-2-gpu-amd, stage-b-test-small-1-gpu-amd (#16675) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-08 10:16:27 -08:00
YC Tseng 3d51ae18a1 [AMD] Turn on AMD CI if rocm.Dockerfile changed (#16634) 2026-01-07 22:51:53 -08:00
YC Tseng 48381c3b6d [AMD] suppress warning for amd (#16620) 2026-01-07 01:37:40 -08:00
YC Tseng 8bce085321 [AMD] CI - add 2 pp test cases to performance-test-2-gpu-amd (#16514) 2026-01-06 23:52:46 -08:00
yctseng0211andBingxu Chen c371df2f25 [AMD] Fix CI and add retry logic for git clone timeout (#15663) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-05 12:37:52 -08:00
yctseng0211 e50f356f6f [AMD] CI - Detect the aiter version and rebuild if needed (#15460) 2025-12-22 22:42:48 -08:00
yctseng0211 6468cb5823 [AMD] remove the redundant projection (#15178) 2025-12-19 22:10:46 -08:00
yctseng0211andSai Enduri af780c59f3 [AMD] add unit-test-backend-8-gpu-amd back (#15253) 
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>
 2025-12-19 00:59:28 -08:00
yctseng0211andbingxche a21aa87ec5 [AMD] Fix and add accuracy-test-2-gpu-amd back (#15415) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2025-12-19 00:41:14 -08:00
yctseng0211 763888b5a8 [AMD] change fused rms quant interface for aiter upgrade (#14497) 2025-12-08 09:09:23 -08:00
yctseng0211 d6c490192d [AMD] fix the regression issue for DeepseekV3 on MI300 (#14383) 2025-12-03 23:30:11 -08:00
yctseng0211rootjacky.cheng
 		c8ede0e93c [ROCM] Optimized deepseek-r1 fp8 model with + triton_gemm_a8w8 + batch_gemm_a8w8 + fused set_mla_kv_buffer kernel (#13617) 
Co-authored-by: root <root@smci355-ccs-aus-m12-17.cs-aus.dcgpu>
Co-authored-by: jacky.cheng <yichiche@amd.com>
 2025-11-20 00:29:56 -08:00
yctseng0211 28b8c5792d Upgrade to ROCm 7.0 image (#13105) 2025-11-11 19:14:28 -08:00
yctseng0211 4a78031a71 [ROCM] Optimized deepseek-r1 model with rmsnorm + fp8 quant fusion (#12689) 
should be clean after https://github.com/sgl-project/sglang/pull/13017 landed
 2025-11-11 02:59:10 -08:00