minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 10 Packages Projects Releases Wiki Activity
18,687 Commits 2 Branches 0 Tags
b081dd3d234b30029fabba7dc358d76834a40e3a
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
MichaelCursor Agentquitenode
 		d006f40e24 [AMD][CI] Retire the ROCm 7.0 kernel wheel (#38767) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
 2026-09-11 08:25:55 +08:00
MichaelCursor AgentMichael
 		13fb796c81 [AMD][CI] Drop the dead miles ROCm 7.0 nightly image build (#38694) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
 2026-09-10 00:00:28 -07:00
Michael 026e61bd94 [AMD] Restore AMD CI registrations dropped by #37436 (#38581) 2026-09-09 23:59:10 -07:00
Michael f3152439d0 [AMD][CI] Publish ROCm 10 release images and kernel wheel (#38763) 2026-09-09 23:57:00 -07:00
MichaelCursor AgentquitenodeChenYC Yen-Ching Tseng
 		ce7e79b32c [AMD] Fix nightly ROCm 7.0 image build: patch missing <optional> include in AITER topk kernel (#36216) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
Co-authored-by: Chen <bingxche@amd.com>
Co-authored-by: YC Yen-Ching Tseng <yctseng@amd.com>
 2026-09-01 19:06:32 +08:00
MichaelCursor Agentquitenode
 		e283c9f8ea [AMD][CI] Merge the four MI35x DeepSeek-V3.2 nightly jobs into two to save runtime (#36736) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
 2026-08-27 15:40:27 -07:00
Michael 1c8f2b38cb [AMD][CI] Add DeepSeek-V4-Flash FP8 accuracy coverage on MI30x (#36396) 2026-08-26 19:30:07 -07:00
MichaelCursor Agentquitenode
 		586a50cd96 [AMD][CI] Restore MiniMax-M2.5 4-GPU MI35x nightly job (#36393) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
 2026-08-26 09:34:51 +08:00
Michael 6569125e3a [AMD][CI] Add MiniMax-M3-MXFP8 MI35x nightly perf benchmark (#36142) 2026-08-25 14:05:01 -07:00
Michael 20064623ab [AMD][CI] Add the Qwen3.8 MXFP4 MI35x nightly (#35383) 2026-08-23 17:17:10 -07:00
MichaelCursor Agentquitenode
 		a688682f4b [AMD][CI] Fix ROCm 7.0's dead apt index fail the MORI dependency install (#35764) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
 2026-08-20 22:13:09 -07:00
Michaelandquitenode f64080fbaf [AMD] CI: cut two setup cycles from the AMD multimodal-gen lanes (#34483) 
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
 2026-08-20 22:01:51 -07:00
Michael 02b93e7e01 [AMD] Add GLM-5.2 MI35x nightly accuracy and perf benchmark (#32570) 2026-08-19 22:49:43 -07:00
MichaelMichaelChen
 		09b7af1371 [CI] Surface AMD ROCm 7.2 state in the PR CI-states block (#34813) 
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: Chen <bingxche@amd.com>
 2026-08-20 13:18:30 +08:00
MichaelCursor Agentquitenode
 		dc175b3ad2 [CI][AMD] Run the profiling suite without CUDA graphs on ROCm (#34452) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
 2026-08-20 09:41:28 +08:00
MichaelandCursor Agent e805a8f98e [AMD] Keep the PTX-inline-asm diffusion norm fusions off on ROCm (fix FLUX warmup crash) (#34481) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
 2026-08-20 08:55:28 +08:00
MichaelCursor AgentMichael
 		f4158719d1 [AMD] Let the diffusion AITer backend take grouped-query K/V (fix Cosmos3-Nano startup) (#34485) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
 2026-08-19 00:17:40 -07:00
MichaelCursor AgentMichael
 		8ea5229d42 [AMD] Add the Kimi-K3 MI35x perf benchmarks in nightly (#34985) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
 2026-08-17 21:23:51 -07:00
MichaelCursor AgentMichael
 		816ea65058 [AMD] Add Kimi-K3 8-GPU MI35x nightly accuracy CI (#32568) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
 2026-08-17 14:48:29 -07:00
MichaelCursor AgentMichael
 		d91c3682b0 [AMD][CI] Add GPT-OSS perf benchmarks to the ROCm 7.2 nightly (#34645) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
 2026-08-16 16:35:09 -07:00
Michael 2012b4b196 [AMD][CI] Fix stage-b: AttributeError on multimodal embedding requests (#34769) 2026-08-14 21:35:26 -07:00
Michael 34219ed9a7 [AMD] CI: pin antlr4-python3-runtime back after lmms-eval (unblocks ROCm 7.2 stage-b evals) (#34768) 2026-08-14 08:41:16 +08:00
MichaelandMichael 9720922671 [AMD][CI] Restore gfx942 Grok-1 INT4 and Grok-2 schedules (#34761) 
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
 2026-08-13 15:57:54 -07:00
MichaelCursor AgentMichael
 		07821e9d56 [AMD][CI] Stop scheduling Grok-1 and Grok-2 on MI30x (#34643) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
 2026-08-13 22:22:42 +08:00
MichaelCursor Agentquitenode
 		bbda7f32b1 [AMD][CI] CI: fix AMD 2-GPU multimodal-gen partition-count abort (#34328) 
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
 2026-08-13 08:32:33 +08:00
Michael 8d050dd880 [AMD][CI] Run MI300 8-GPU stage-C shards two at a time (#34324) 2026-08-11 09:49:08 +08:00
MichaelandHAI f2a4c4c847 [AMD] [CI] Enable 3 nested unit tests needing harness stub fixes (#31843) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-08-10 16:09:00 +08:00
Michael 967cac801c [AMD] [CI] Register the DeepSeek-V4-Pro-DSpark MI35x nightly job so its suite actually runs (#34147) 2026-08-09 14:10:28 -07:00
Michael 407a65d3cb [AMD] [CI] Track the MI355X disagg nightly in the AMD CI job monitor (#33753) 2026-08-06 11:02:22 +08:00
Michael d90ef69802 [AMD] ci: run vetted nested multimodal_gen unit tests on AMD (#31483) 2026-08-06 09:39:33 +08:00
Michael c4c405a46b [AMD] batch 3: register newly-added JIT kernel benchmarks for jit-kernel-benchmark-test-amd (#31615) 2026-07-20 23:51:51 -07:00
Michael 7fbe91c6ea [AMD] register 8 JIT kernel benchmarks to jit-kernel-benchmark-test-amd (#31492) 2026-07-17 23:00:00 -07:00
Michael c546afc147 [AMD] Register 2 CPU/triton unit + kernel tests for AMD 1-GPU PR CI (#31379) 2026-07-17 09:01:46 -07:00
Michael 67148447a6 [AMD] Register 3 CPU-bound / triton unit + light-integration tests for AMD 1-GPU PR CI (#31088) 2026-07-15 14:36:05 -07:00
Michael cf8f1df6e8 [AMD] add dedicated jit-kernel-benchmark-test-amd stage + register portable JIT benches (#30307) 2026-07-08 18:09:05 -07:00
Michael c55190a638 [AMD] Register 2 CPU-bound 1-GPU tests (phase_checker, scripted_runtime_core) for AMD PR CI (#30446) 2026-07-08 14:04:23 -07:00
Michael 47a6dfd708 [AMD] Register 3 ROCm-portable JIT kernel tests for AMD CI (#30212) 2026-07-08 13:38:17 -07:00
Michael b363249423 [AMD] ci: run multimodal_gen unit suite on AMD (#30309) 2026-07-07 16:02:58 -07:00
Michael 60f502a4fd [AMD] Register 2 hardware-agnostic 1-GPU PR tests for AMD CI (#30207) 2026-07-07 14:46:22 -07:00
Michael 090efa27a2 [AMD] Register 5 CI-verified 1-GPU kernel/attention unit tests for AMD PR CI (#30290) 2026-07-07 14:44:45 -07:00
Michael bee0f34e68 [AMD] Accept ROCm tensors in JIT kernel TensorMatcher + register 4 kernel tests (#29822) 2026-07-02 19:29:47 -07:00
Michael 8519be82e8 [AMD][DeepSeek V4] Fix default FlashMLA sparse prefill off on ROCm/HIP (#29982) 2026-07-02 16:00:09 -07:00
Michael 0ae76117ef [AMD] Register 2 CPU/ROCm-safe tests for AMD 1-GPU PR CI (#29680) 2026-07-02 00:25:32 -07:00
Michael 3adfd0f34b [AMD] Register 3 unit mem_cache + utils tests for stage-b-test-1-gpu-small-amd (#29782) 2026-07-01 12:57:48 -07:00
Michael 8361561c24 [AMD] Fix int8 per-token quant Triton portability + register test for AMD nightly CI (#29694) 2026-07-01 12:56:33 -07:00
Michael 69ce72020a [AMD] Register ltx2_ada_values JIT kernel test for AMD nightly CI (#29693) 2026-07-01 01:13:55 -07:00
Michael 7da4e30d9b [AMD] Register fused_metadata_copy JIT kernel test for AMD nightly CI (#29671) 2026-06-29 21:26:11 -07:00
Michael c470acde2b [AMD] Register 1 kernel unit test for AMD nightly CI (#29333) 2026-06-26 16:06:02 -07:00
Michael e6efe10072 [AMD] Register 5 JIT kernel unit tests for AMD nightly CI (#29197) 2026-06-25 13:12:58 -07:00
Michael ec12a28a87 [AMD] Register 7 JIT kernel unit tests for AMD nightly CI (#28967) 2026-06-25 01:51:30 -07:00
Michael 4ba8634780 [AMD] Register scripted-core chunked-prefill test for AMD extra-a CI (#29058) 2026-06-25 01:50:08 -07:00
Michael c07811bfc6 [AMD] Register MI355X 2N 1P1D disagg nightly workflow for testing (#29091) 2026-06-24 08:41:55 +08:00
Michael 28d5627fd8 [AMD] register kv_canary + mock_model e2e tests to extra-a (1-gpu-small + 2-gpu-large) (#28850) 2026-06-22 19:06:31 -07:00
Michael 653f6735a0 [AMD] add nightly kv_canary JIT benchmark suite (#28611) 2026-06-19 19:46:34 -07:00
Michael 871ed0dc0c Revert "ci: add 4-GPU mi35x runner and rebalance off the saturated 8-GPU pool" (#28751) 2026-06-19 16:23:18 -07:00
Michael 420004827c [AMD] register 3 tests to stage-b-test-1-gpu-large-amd (batch-6) (#28736) 2026-06-19 15:45:16 -07:00
Michaelandmichaelzhang-ai 13aab2fc06 ci: add 4-GPU mi35x runner and rebalance off the saturated 8-GPU pool (#28745) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
 2026-06-19 15:41:19 -07:00
Michael 7c505c2927 [AMD] fix(jit): port kv_canary write/verify/plan kernels to ROCm (#28357) 2026-06-19 12:19:37 -07:00
Michael 62ab09a478 [AMD] register 2 spec tests to stage-b-test-1-gpu-large-amd (batch-5) (#28558) 2026-06-18 16:33:23 -07:00
Michael 5d1949152d [AMD] ci: add extra-a 1-gpu-large tier (fp8kv-triton, streaming-session, spec-standalone) (#28458) 2026-06-17 23:31:32 -07:00
Michaelandmichaelzhang-ai 0e5a66dca4 [AMD] Register 3 JIT kernel unit tests for AMD CI (#27837) 
Co-authored-by: michaelzhang-ai <michaelzhang@example.com>
 2026-06-17 23:28:56 -07:00
Michael a2aa51c818 [AMD] register 4 2-gpu tests to stage-b-test-2-gpu-large-amd (#28344) 2026-06-16 21:58:34 -07:00
Michael 72d962be88 [AMD] Fix jit-kernel-unit-test-amd: activation.cuh ROCm build + per_token CUDA-only (R165) (#27947) 2026-06-15 23:44:26 -07:00
Michael c6d9d73fd6 [Spec][test] fix(kv_canary): assert draft-extend-v2 oracle tokens in token_oracle test (#28325) 2026-06-15 19:14:09 -07:00
Michael c127ba6483 [AMD] ci: fix scheduled AMD runs startup failure when calling extra-a suite (#28214) 2026-06-14 17:43:47 -07:00
Michael 053e153183 [AMD] ci: register 8 attention-backend unit tests to run on AMD CI (#27817) 2026-06-12 20:52:45 -07:00
Michael 54989b1fd0 [AMD] ci: add label-gated extra-a tier (kv_canary + mock_model unit tests) (#27822) 2026-06-12 15:12:56 -07:00
Michael 65d76bd3f6 [AMD] Fix CI base-a fwd_occupancy: disable SGLANG_SANITIZE_NAN_LOGITS in AMD CI (#28075) 2026-06-12 14:14:34 -07:00
Michael 12d3f02be8 [AMD] Fix DSA device-to-host direct test on rocm720 (page_size%16 assert) (#27850) 2026-06-11 14:24:23 -07:00
Michael 6a16f29af6 [AMD] ci: register 8 framework / unit tests to run on AMD CI (#25939) 2026-06-10 08:41:22 -07:00
Michaelandmichaelzhang-ai f42a093261 [AMD] Migrate 2-GPU kernel allreduce tests into the registered system (#27722) 
Co-authored-by: michaelzhang-ai <michaelzhang@example.com>
 2026-06-09 19:39:03 -07:00
Michael 5babb902a9 [AMD] fix: handle per-frame 4D shift in native scale-shift kernel (#27581) 2026-06-09 10:31:00 -07:00
Michael a32aeb688a [AMD] Fix AttributeError in GeneratedSharedPrefixDataset.from_args for in-process callers (#27580) 2026-06-08 21:53:14 -07:00
Michael 569ee93357 [AMD] ci: switch CACHE_HOST to a fresh path to fix "No space left on device" (#26642) 2026-05-29 10:40:54 +08:00
Michael 9409969fd5 Revert "[perf][spec decoding] Skip full-vocab softmax in EAGLE draft when topk == 1 (#26235)" (#26358) 2026-05-26 02:47:52 -07:00
Michael 7fda3caea4 [AMD] test(sgl-kernel): seed RNG on ROCm in test_moe_topk_sigmoid to fix tie-break flake (#25356) 2026-05-19 23:01:13 -07:00
MichaelandHAI 4ef9bad223 [AMD] ci: register 5 framework tests to run on AMD CI (#25208) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-05-16 22:56:57 -07:00
Michael 9dad37f254 [AMD] Bump --timeout-per-file 1800->2400 for stage-b-test-1-gpu-small-amd (#25112) 2026-05-15 15:10:04 +08:00
Michael 245f7d8026 [AMD] Register 5 server-style 1-GPU tests for AMD PR CI (#24572) 2026-05-12 22:45:52 -07:00
Michael 190b15c8fe [AMD] Register 8 CPU-bound unit tests for AMD 1-GPU PR CI (#24569) 2026-05-08 16:01:58 -07:00
Michael 244531bc4f [AMD] Add Kimi-K2.6 in nightly tests for MI30x and MI35x (#23848) 2026-05-04 23:37:14 -07:00
Michael 39c6bf730c [AMD][CI] Add GLM-5-MXFP4 accuracy and perf nightly tests for MI35x (#21773) 2026-04-14 18:55:36 -07:00
MichaelandHaiShaw eab045b2b7 [AMD] Add MiniMax-M2.7 accuracy and performance nightly tests (#22722) 
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-04-14 00:30:11 -07:00
Michael ef6bfc1197 [AMD] Add GLM-5.1-FP8 nightly accuracy and performance benchmarks for MI30x and MI35x (#22336) 2026-04-08 22:57:43 -07:00
Michael db60a620db [AMD] Add GLM-5-FP8 nightly performance benchmarks for MI30x and MI35x (#21710) 2026-04-07 22:43:14 -07:00
Michael ba78f6e0ef [AMD] Add Qwen3.5-397B FP8 nightly perf benchmarks for MI30x and MI35x (#21669) 2026-04-06 23:46:00 -07:00
Michael d07d0a15ce [AMD] Add MiniMax-M2.5 nightly perf benchmarks for MI30x and MI35x (#21524) 2026-04-03 01:01:03 -07:00
Michael 8d919bbd44 [AMD] Fix Handle missing rope_theta in get_rope_config for Grok-1 (#21518) 2026-03-31 10:58:12 -07:00
MichaelandBingxu Chen 80389fec00 [AMD] Fix AMD CI: mark /sglang-checkout as git safe.directory in container (#21423) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-03-26 10:18:19 +08:00
Michaelandbingxche f81dec090b [AMD] Fix CI: correct stage-b job dependency names in AMD CI workflows (#21357) 
Co-authored-by: bingxche <bingxche@amd.com>
 2026-03-25 11:48:47 +08:00
Michael 6cb1c2d53d [AMD] Add 4-GPU test suite for MI325 runners (#20294) 2026-03-24 14:04:49 -07:00
Michael da24478913 [AMD] Fix CI: update transformers in Qwen 3.5 and GLM-5 nightly tests (#20750) 2026-03-17 22:07:07 -07:00
Michael 7a1ca53805 [AMD] Fix JSON mode streaming test flake on AMD CI (#20293) 2026-03-10 17:24:11 -07:00
Michael dc4380e33a [AMD] [DeepSeek-OCR-2 Day 0] Enable DeepSeek-OCR-2 on AMD GPUs and add nightly test (#19732) 2026-03-10 17:04:35 -07:00
Michael 203cd8eb02 [AMD] [Z-Image-Turbo Day 0] Add Z-Image-Turbo nightly test for AMD GPUs (#19733) 2026-03-05 08:36:17 -08:00
Michael c6850ac30c [AMD] Fix Qwen3-Coder-Next: Add missing k_scale/v_scale args to extend_attention_fwd in aiter_backend (#19736) 2026-03-03 22:01:08 -08:00
Michael 6b8e62f94f [AMD] [Qwen 3.5 Day 0] Add Qwen 3.5 nightly accuracy tests (#19479) 2026-03-02 19:42:42 -08:00
Michaelmichaelzhang-aibingxcheyctseng0211
 		1b79934d34 [AMD] Fix AMD CI test of TestToolChoiceLfm2Moe (#19113) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: yctseng0211 <yctseng@amd.com>
 2026-02-27 10:18:15 -08:00
Michael 403195d59d [AMD] [MiniMax-M2.5 Day 0] Add MiniMax-M2.5 nightly accuracy test (#19443) 2026-02-27 02:39:33 -08:00
Michael f230967e65 [AMD] Fix ROCm Docker builds, update apache-tvm-ffi (#19359) 2026-02-26 10:16:28 +08:00