minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
15,115 Commits 2 Branches 0 Tags
80965db8d3fa89d97ef2d95d2cd1fd486caad963
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
YC Yen-Ching Tseng 80965db8d3 [AMD] Pin cmake==4.3.4 in ROCm Dockerfile to fix MoRI gtest_discover build break (#30942) 2026-07-12 18:20:17 -07:00
YC Yen-Ching Tseng fc378f843e [AMD] Temporarily reduce AMD scheduled test frequency to save resource (#30534) 2026-07-08 09:30:59 -07:00
YC Yen-Ching Tseng 669b4bc72b [AMD] Gate stage-c on stage-b-test-1-gpu-large-amd (#30496) 2026-07-08 15:41:21 +08:00
YC Yen-Ching Tsengandbingxche 9bf122a455 [AMD] Run MI355X disaggregation Nightly Test with runtime checkout code mechanism (#30386) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-07-08 09:27:49 +08:00
YC Yen-Ching Tseng 67697fb891 [AMD] Temporarily disabled: every-6-hours rocm 7.2 test (#30014) 2026-07-03 15:38:07 +08:00
YC Yen-Ching Tseng 05bc3f2aa7 [AMD] Gate broken CK block-FP8 GEMM shapes to aiter-triton-GEMM to fix ROCm 7.0 Qwen3.5 accuracy (#29918) 2026-07-02 18:18:37 -07:00
YC Yen-Ching Tseng 2a6e5c60fe [AMD] Rebalance stage-c-large-8-gpu-mi35x partitions to fix 60-min timeout (#29726) 2026-07-01 08:17:00 -07:00
YC Yen-Ching Tseng 308d89e042 [AMD] Split qwen3.5 triton DCP test into its own nightly job (#29409) 2026-07-01 00:39:39 -07:00
YC Yen-Ching Tsengandbingxche c70cc96905 [AMD] Stop rocm720 pr auto-runs (#29768) 
Co-authored-by: bingxche <bingxche@users.noreply.github.com>
 2026-06-30 23:58:25 +08:00
YC Yen-Ching Tsengandbingxche f2756f53f3 [AMD] Update AMD local registry address (#29765) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-06-30 23:40:00 +08:00
YC Yen-Ching Tseng 7d9116d9d7 Fix test_type_based_dispatcher after TokenizedGenerateReqInput field changes (#29376) 2026-06-29 22:22:22 -07:00
YC Yen-Ching Tsengandbingxche 5169df70f6 [AMD] Sgl-data mount opt-in (#29661) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-06-29 22:11:37 +08:00
YC Yen-Ching Tseng 5eebb4b2e8 [AMD] Fix fused append+remap DeepEP equivalence test on aiter path (#29377) 2026-06-26 16:04:20 -07:00
YC Yen-Ching Tseng bc150173b2 [AMD] Fix stage-b-test-1-gpu-small-amd-nondeterministic timeout after VLM model swap (#29234) 2026-06-25 03:56:04 -07:00
YC Yen-Ching TsengbingxcheClaude Opus 4.8
 		b42c79c4eb [AMD] Fix AMD extra scheduled runs cancelling each other (#28989) 
Co-authored-by: bingxche <bingxche@amd.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
 2026-06-23 11:48:32 +08:00
YC Yen-Ching Tseng dd39ef6cec [AMD] Pin httpx>=0.25.0 to fix anthropic SDK socket_options error (#28869) 2026-06-22 07:25:22 -07:00
YC Yen-Ching Tseng 73448b0d70 [AMD] Temporarily disable deepseek V4 in AMD PR test (#28871) 2026-06-22 10:48:38 +08:00
YC Yen-Ching Tseng 3b5aae278e Fix EagleDraftExtendInput missing kv_indptr crash with triton/DP attention (#28221) 2026-06-17 14:54:33 -07:00
YC Yen-Ching Tseng 9b8c41171a [AMD] Fall back to layer_first layout for kernel write-back on ROCm (#28473) 2026-06-17 03:01:43 -07:00
YC Yen-Ching Tseng 102392df5b [AMD][Fix] Skip EPLB topk remap when global server args are unset (#28404) 2026-06-16 01:13:22 -07:00
YC Yen-Ching TsengbingxcheCursor
 		ed9024e09f [AMD] Fix AITER Scout workflow permissions (#28360) 
Co-authored-by: bingxche <bingxche@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-06-16 11:21:39 +08:00
YC Yen-Ching Tsengandbingxche 19e85868f6 [AMD] Point AITER scout at amd/aiter-ci (#28313) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-06-15 22:50:16 +08:00
YC Yen-Ching Tseng 17d8c5801d [AMD] Fix test_deepseek_r1_mxfp4_8gpu.py : disable async-assert probes on AMD CI (#27505) 2026-06-09 08:12:35 -07:00
YC Yen-Ching Tseng a26587dd4e [AMD][diffusion] Add FlyDSL fused normalization kernels for ROCm diffusion models optimization (#22786) 2026-06-08 02:42:39 -07:00
YC Yen-Ching TsengbingxcheCursor
 		66b932154f [AMD] fix(ci): run partition 3 of stage-c-test-large-8-gpu-amd (#27352) 
Co-authored-by: bingxche <bingxche@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-06-05 15:06:36 +08:00
YC Yen-Ching Tseng 69623f4b11 [AMD] Guard aiter greedy_sample OOB token id (fixes VLM MMMU CI) (#27247) 2026-06-04 12:53:58 -07:00
YC Yen-Ching Tseng ff93a576e5 [AMD] Minimax M25 : FP8 block-scale GEMM dispatch for ROCm 7.0 on gfx950 (#27111) 2026-06-04 00:41:42 -07:00
YC Yen-Ching TsengbingxcheCursor
 		04c16fc1e5 [AMD][CI] Remove transformers pin from GLM-5.x nightly jobs (#27232) 
Co-authored-by: bingxche <bingxche@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-06-04 14:34:07 +08:00
YC Yen-Ching Tseng 6dcd78a37f [AMD] Add MiniMax-M2.5 TP=4 nightly accuracy test for MI355X (#27126) 2026-06-03 22:17:40 -07:00
YC Yen-Ching Tseng d1bc06b63b [AMD] Disable AITER custom all-gather in DeepSeek-R1-MXFP4 8-GPU test (#27163) 2026-06-03 13:38:34 -07:00
YC Yen-Ching TsengCursor AgentBingxu ChenBingxu Chen
 		b14fba17d9 [AMD] make bypass-fastfail label also disable within-suite fast-fail (#26909) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-06-01 16:17:59 +08:00
YC Yen-Ching Tseng f60710a1d7 [AMD] Fix stage-b-test-large-8-gpu-mi35x-disaggregation-amd : switch CACHE_HOST to a fresh path to fix "No space left on device" (#26905) 2026-06-01 16:00:58 +08:00
YC Yen-Ching Tseng 272066566f [AMD] Pin compressed-tensors<0.16.0 for srt_hip (fixes ROCm 7.2 nightly build) (#26591) 2026-05-29 11:34:45 +08:00
YC Yen-Ching Tseng 505f37a63d [AMD] force AITER checkout to bypass CSV CRLF/LF smudge dirty state (#26535) 2026-05-28 14:05:53 +08:00
YC Yen-Ching Tseng f32ca1e0e5 [AMD] AＭD CI - temporarily change to mi325 (#26443) 2026-05-27 13:55:03 +08:00
YC Yen-Ching Tseng d25a220fdb [AMD] Relaxing timeout for AMD CI (#26392) 2026-05-26 17:25:05 +08:00
YC Yen-Ching TsengCursor AgentBingxu Chenbingxche
 		8562d5ae94 [AMD] Relaxing Timeout for AMD stage-a (#25978) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
Co-authored-by: bingxche <bingxche@amd.com>
 2026-05-21 17:32:51 +08:00
YC Yen-Ching Tseng 90efa9c83f [AMD] Fix AMD stage-a-test-small-1-gpu (#25932) 2026-05-20 20:51:49 -07:00
YC Yen-Ching Tseng 7c3f614e23 [AMD] Bump amd/Kimi-K2.5-MXFP4 revision to align with shared-experts fusion (#25740) 2026-05-18 22:47:05 -07:00
YC Yen-Ching Tseng 22bfae0d1d [AMD] Auto-fallback NSA indexer to page_size=1 when aiter preshuffle gluon kernel is unavailable (Deepseek v3.2) (#25205) 2026-05-14 00:01:56 -07:00
YC Yen-Ching Tseng cf92ccbf18 [AMD] Run jit kernel PR test through run_suite.py register mechanism (#24987) 2026-05-13 02:57:08 -07:00
YC Yen-Ching Tseng 72b266d59b [AMD] Disable unittest fail-fast for deepseekv4 perf test (#25039) 2026-05-12 22:47:31 -07:00
YC Yen-Ching Tseng 6b6963f426 [AMD] Update scripts/ci/amd/ensure_vram_clear.sh (#24586) 2026-05-11 18:47:09 +08:00
YC Yen-Ching Tseng 126a36a986 [AMD] VRAM cleanup step to AMD nightly test workflows (#24612) 2026-05-11 11:08:51 +08:00
YC Yen-Ching Tseng b35d14b64d [AMD] Retry logic for lmms-eval installation (#24615) 2026-05-11 10:55:24 +08:00
YC Yen-Ching Tseng e1150f66db [AMD][diffusion] Temporal-unfolded batched Conv2D for ROCm VAE decode (#22971) 2026-05-08 02:32:14 -07:00
YC Yen-Ching Tsengandbingxche c18879054f [AMD] Route PR multimodal tests to MI325 (#24614) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-05-07 23:26:05 +08:00
YC Yen-Ching Tseng 64613543ea [AMD] fix(docker): unbreak nightly when archive.ubuntu.com:80 is unreachable (#24407) 2026-05-05 00:39:14 -07:00
YC Yen-Ching Tsengandbingxche cf4f462094 [AMD] Nightly image release for deepseek v4 (#24155) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-30 23:49:13 +08:00
YC Yen-Ching Tseng 9e68c8527e [AMD] Update AMD Nightly Test checkout mechanism (#24112) 2026-04-30 11:36:18 +08:00
YC Yen-Ching Tsengandbingxche 155e333039 [AMD] Update AMD CI workflow concurrency group (#24065) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-29 22:39:18 +08:00
YC Yen-Ching Tseng adc59325bc [AMD] Optimize MiniMax-M2.5 - enable fused Triton kernel for FP8 KV cache write in aiter decode path (#23620) 2026-04-24 22:23:49 -07:00
YC Yen-Ching Tseng fb272d27db [AMD] Optimize MiniMax-M2.5 - use aiter biased_grouped_topk for sigmoid scoring in MoE routing (#23611) 2026-04-24 22:18:08 -07:00
YC Yen-Ching Tsengandbingxche b060a5ccfd [AMD] Fix nightly version tag selection (#23644) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-24 17:39:47 +08:00
YC Yen-Ching Tsengandbingxche 30909cbeeb [AMD] upd local registry address (#23607) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-24 12:07:09 +08:00
YC Yen-Ching Tseng 74fdf9cd77 [AMD] CI - Fix the cancelled guard to AMD CI (#23338) 2026-04-21 15:45:26 +08:00
YC Yen-Ching Tseng da62e90904 [AMD] Fix multimodal timeout issue : rocm7.2 PR Test (#23247) 2026-04-20 18:36:08 +08:00
YC Yen-Ching Tsengandbingxche cf4b84f839 [AMD] Update AMD workflow name (#23245) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-20 18:18:24 +08:00
YC Yen-Ching Tseng 32b7777f6c [AMD]Fix AMD multimodal-gen-test-2-gpu timeout by adding partition for standalone test (#23130) 2026-04-19 23:16:18 +08:00
YC Yen-Ching Tseng 5d4e899477 [AMD] Fix AMD Multimodal Test - skip nvfp4 tests (#23045) 2026-04-17 09:02:39 -07:00
YC Yen-Ching Tsengandbingxche f399997d2f [AMD] mirror nightly images to local registry and prefer LAN pulls (#23073) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-17 19:49:26 +08:00
YC Yen-Ching Tsengandbingxche 8c13295842 [AMD] fix AMD CI gate (#22974) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-17 18:32:26 +08:00
YC Yen-Ching Tseng f0f0148167 Revert "feat: Support MXFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#19143)" (#23031) 2026-04-16 21:53:25 -07:00
YC Yen-Ching Tsengandbingxche d44eb16ac6 [AMD] Replace push trigger with scheduled runs and enable parallel stage execution (#22489) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-04-14 13:33:29 +08:00
YC Yen-Ching TsengandHAI 3ce72252de [AMD] Fix Timeout: stage-b-test-2-gpu-large-amd,stage-b-test-1-gpu-large-amd (#22228) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-04-10 22:55:44 -07:00
YC Yen-Ching Tseng cf1436d6ae [AMD] Diffusion - Enabel rocm miopen tuning on vae (#22428) 2026-04-10 22:47:25 -07:00
YC Yen-Ching Tseng e14876742a [AMD] Fix test_kimi_k25_mxfp4.py : stage-c-test-large-8-gpu-amd-mi35x (linux-mi35x-gpu-8, 1) (#22188) 2026-04-07 13:48:37 -07:00
YC Yen-Ching TsengBingxu ChenHaiShaw
 		a188208e9a [AMD] Optimize Qwen3-VL decode - fuse QK-norm + 3D mRoPE + KV cache write (#21458) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-31 23:34:07 -07:00
YC Yen-Ching Tseng 448b528720 [AMD] Adjust AMD 4gpu partitions (#21533) 2026-03-27 15:59:26 +08:00
YC Yen-Ching Tseng 013fa55630 [AMD] CI - fix amd 4-GPU PR test (#21444) 2026-03-26 18:16:33 +08:00
YC Yen-Ching Tseng c494e47843 [AMD] Fix stage-b-test-small-1-gpu-amd (test_tool_choice.py) (#19868) 2026-03-25 01:10:21 -07:00
YC Yen-Ching Tsengandbingxche 71f5ae3f9a [AMD] Fix AMD Nightly Test - Transformers 5.3.0 incompatibility and gemma2-27b kv issue (#21193) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-24 10:41:44 -07:00
YC Yen-Ching Tsengandwunhuang f97c09dac1 [AMD] Enable aiter unified attention for non-SWA models (Qwen3-VL) (#20897) 
Co-authored-by: wunhuang <wunhuang@amd.com>
 2026-03-20 12:07:41 -07:00
YC Yen-Ching Tseng 9e629d31fd [AMD] CI - Fix AMD CI (multimodal test, move flaky test to non-deterministic group) (#20815) 2026-03-19 11:50:19 -07:00
YC Yen-Ching TsengandBingxu Chen 671bd266c1 [AMD] CI - update amd nightly cronjob (#20928) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-03-19 18:10:17 +08:00
YC Yen-Ching Tseng 41c8651c0d Revert "[AMD] CI - skip tests on mi325 (#20660)" (#20802) 2026-03-18 09:01:51 +08:00
YC Yen-Ching Tsengandbillisyahao 18dd5c972d [AMD] Fix AMD CI : stage-c-large-8-gpu-amd-mi35x (#20521) 
Co-authored-by: billisyahao <bill.he@amd.com>
 2026-03-16 23:53:33 -07:00
YC Yen-Ching Tsengandbingxche a92872cbc3 [AMD] CI - skip tests on mi325 (#20660) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-03-16 13:35:04 +08:00
YC Tseng c37ef7f18b [AMD] diffusion refactor: move ROCM VAE optimization to Platform abstraction (#20496) 2026-03-13 13:10:05 -07:00
YC TsengandHaiShaw 78a467c74a [AMD] [diffusion] feat: enable AITer GroupNorm for VAE decode on ROCm (#20170) 
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-12 16:38:19 -07:00
YC TsengAlan KaoClaude Sonnet 4.6
 		1aa56cca37 [AMD] Add wheel support for sglang (#16782) 
Co-authored-by: Alan Kao <akao@amd.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-09 22:42:41 -07:00
YC Tseng c267bdb805 [AMD] Fix AMD CI - stage-b-small-1-gpu-amd (partition 7) (#20028) 2026-03-06 23:49:14 -08:00
YC Tsengandbingxche 23eb24ddfe [AMD] Update/fix AMD CI workflow dispatch mechanism (#20014) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-06 15:27:44 +08:00
YC Tsengandbingxche b5edab57f2 [AMD] CI - Add MI35x nightly/PR tests for kv-cache-fp8 and allreduce-fusion (DeepSeek) (#19834) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-05 07:09:57 -08:00
YC Tseng 525d046990 [AMD] CI - new runner label for MI325 8gpu (#19815) 2026-03-04 10:45:23 +08:00
YC Tsengandbingxche 060720c573 [AMD] AMD new CI runner (#19739) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-03 11:17:12 +08:00
YC Tsengandbingxche 8b4c387aa2 [AMD] Update AITER Scout Workflow (#19735) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-03 10:14:31 +08:00
YC TsengandBingxu Chen f2c5503542 [AMD] AMD AITER Scout Workflow (#19467) 
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
 2026-03-02 16:10:44 +08:00
YC TsengandBingxu Chen 0404ef9023 [AMD] Add triggering path for multimodal test in pr-test-amd (#19515) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-02-28 12:46:37 +08:00
YC Tseng d6f0ef677b [AMD] reset AMD image release time and reduce CI queue time (#18707) 2026-02-12 01:05:53 -08:00
YC TsengAlan KaobingxcheMichael
 		20554a0a4f [AMD] rocm 7.2 image release, PR test, Nightly Test (#17799) 
Co-authored-by: Alan Kao <akao@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
 2026-02-11 21:29:25 -08:00
YC Tsengandbingxche d94d0af573 [AMD] Turn on aiter-prebuild (#18425) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-02-10 00:49:35 -08:00
YC TsengandBingxu Chen 28717e3d28 [AMD] CI - Fix AMD daily image release and install dependency (#18452) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-02-08 22:20:09 -08:00
YC Tseng ea04bc1dd6 [AMD] Fix aiter version in rocm image (#18076) 2026-02-01 19:00:38 -08:00
YC Tseng b7b1ba329e [AMD] fix pip sglang version (#17950) 2026-01-29 17:19:57 -08:00
YC TsengandBingxu Chen 52bca42870 [AMD] CI - enable deepseekv3.2 on MI325-8gpu and merge perf/accuracy test suites into stage-b suites (#17633) 
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
 2026-01-27 18:54:36 -08:00
YC TsengBingxu Chenbingxchemichaelzhang-ai
 		04a10c9bc2 [AMD] CI - migrate perf test and fix stage-b-test-1-gpu-amd (#17340) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-22 18:45:05 -08:00
YC Tsengandmichaelzhang-ai 17807caf82 [AMD] fix amd ci dpskv32 (#17432) 
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-21 20:34:24 -08:00
YC Tseng b827e9d381 [AMD] CI - Fix sgl-kernel unittest (#17490) 2026-01-21 09:23:28 -08:00
YC Tseng e9a44ea607 [AMD] fix perf ci errors (#17363) 2026-01-19 13:04:15 -08:00