Commit Graph
156 Commits
Author SHA1 Message Date
JohnQinAMDandClaude Opus 5.5 964fd6af92 [ROCm] GLM-5.2: gfx950 four-kernel fused DSA indexer decode path (#38583)
Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
2026-09-29 21:52:00 -07:00
MichaelandClaude 5828cd4927 [AMD] Add GLM-5.3 MI30x and MI35x nightly accuracy tests (#41602)
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-29 02:49:01 -07:00
25de80780a [AMD] Add GLM-5.3-Flash MI35x nightly test (#36903)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: quitenode <quitenode@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
2026-09-27 22:40:03 -07:00
Liangsheng Yin f337f01b80 [Test] Remove dead eval modules and point GSM8K/MMLU docs to sgl-eval (#41215) 2026-09-25 12:50:31 -07:00
Xiaoyu Zhang ea5baf4022 [Refactor] Retire the model-specific Kimi K3 kernel namespace (#40922) 2026-09-24 21:25:00 +08:00
32290dda2c [AMD] Small-M MXFP4 fused-MoE kernel for gfx950 (Qwen) (#40204)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-09-23 22:45:33 -07:00
fanxingranandThomas Wang 0dc8b29e15 [ROCm][DSA] Enable AITER fused FP8 indexer writer (#40710)
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-09-23 21:46:35 -07:00
Liangsheng Yin 78980a3b0b [misc] Remove deprecated endpoints, env vars and aliases past two releases (#40795) 2026-09-22 18:14:45 -07:00
720617bb5b [AMD] Reuse KV gather indices across ASM context prefill layers (#39901)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-09-22 12:08:05 -07:00
d00adfd19c [AMD] Fix deferred Kimi-K3 forget gate in fused in-projection (#39525)
Co-authored-by: Tom Jen <tomjen12@localhost.localdomain>
Co-authored-by: HAI <hixiao@gmail.com>
2026-09-22 01:07:25 -07:00
6412ad8c64 [AMD] Pack Qwen3.5 GDN input projections on ROCm (#39902)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-09-22 00:52:40 -07:00
jacky.cheng 90b3f8544c [AMD] Use Triton softmax routing for Qwen3.5 on gfx950 (#39986) 2026-09-21 12:02:29 -07:00
Sasha Sidorov 59dd2fc734 [2/N] [Kernel] Fuse padding-preserving HiSparse slot translation (#39837) 2026-09-20 12:04:03 +08:00
Liangsheng Yin 1f0c73e9bd [DSV4] Generalize attention metadata, sparse prefill, and KV pool over compress ratios (#39921) 2026-09-17 15:55:19 -07:00
chuyehandjacky.cheng 71ef869ece [AMD][Bugfix] Fix vattn_asm HIP error 709 under CUDA graph capture on ROCm 10 (#39513)
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-09-17 01:06:04 -07:00
AMD-yanfeiwangandDuyi-Wang a813224e78 [ROCm][DSV4] Enable breakable CUDA graph prefill (#37810)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
2026-09-16 08:52:11 -07:00
3eeb7d37f9 [AMD] gfx950 assembly attention: length-aware split-KV for dynamic workload (#39172)
Co-authored-by: Zijie Chen <300606707+zijiecode@users.noreply.github.com>
Co-authored-by: jacky.cheng <yichiche@amd.com>
2026-09-13 23:48:03 -07:00
Xinyi Song 21289cfd50 [AMD] Fix Dspark accept length and reduce host bubble on DSV4 (#39116) 2026-09-12 15:21:43 -07:00
YC Yen-Ching Tseng 6b2e13bcb0 [AMD] Fix the diffusion perf fixture lookup (#38686) 2026-09-10 00:07:08 -07:00
Cheng Wan db272201a2 [Config] Retire get_global_server_args, and clear the deprecated flags that have a replacement (#38375) 2026-09-08 16:42:12 -07:00
Baizhou Zhang 85d39401c8 [CP V1 Deprecation 3.5/5] Deprecate HIP/NPU/MUSA prefill CP and remove legacy implementation (#38293) 2026-09-07 15:39:34 -07:00
Xiaoyu ZhangandMick Qian 4d23a4fa6d [Test] Consolidate test cleanup and CI taxonomy (net -11.4K lines) (#37436)
Co-authored-by: Mick Qian <mickqian@users.noreply.github.com>
2026-09-07 15:13:59 +08:00
Yu-Yun ChangandHAI cb32dbc9e0 [AMD] [Kimi-K3] Fuse the KDA input projection into a single GEMM on ROCm (#35176)
Co-authored-by: HAI <hixiao@gmail.com>
2026-09-03 23:30:08 -07:00
Alex NailsandAlison Shao 28262c20df [CI][RFC] Replace black-jupyter with ruff-format (#37210)
Co-authored-by: Alison Shao <a.shao@wustl.edu>
2026-09-02 19:46:08 -07:00
Alison Shao db1eb48651 [CI] Graceful teardown for the PD and HiSparse server fixtures (#37485) 2026-09-02 17:22:18 -07:00
Liangsheng YinandBaizhou Zhang 95f0f41021 [CI] Move tests onto the right CI stages (#34074)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-08-31 12:39:59 -07:00
+1 3865efc9f7 [AMD] support gfx1250 on ROCM 10 (#36871)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Kao <akao@amd.com>
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: sogalin_codegen <39478626+sogalin@users.noreply.github.com>
Co-authored-by: Thomas Wang <thomawan@amd.com>
2026-08-31 01:19:11 -07:00
Liangsheng Yin 3a6ed55999 [Fix] Shut hicache test servers down gracefully before SIGKILL (#37194) 2026-08-30 22:45:40 -07:00
jacky.cheng c967cd19b5 [AMD] Optimize Qwen3.5 MTP unified attention on gfx950 (#36330) 2026-08-27 00:13:49 -07:00
Michael 1c8f2b38cb [AMD][CI] Add DeepSeek-V4-Flash FP8 accuracy coverage on MI30x (#36396) 2026-08-26 19:30:07 -07:00
Michael 6569125e3a [AMD][CI] Add MiniMax-M3-MXFP8 MI35x nightly perf benchmark (#36142) 2026-08-25 14:05:01 -07:00
Michael 20064623ab [AMD][CI] Add the Qwen3.8 MXFP4 MI35x nightly (#35383) 2026-08-23 17:17:10 -07:00
Shangming Cai ac179eec11 fix(disagg): PD transfer-failure injection was silently inert (#35890) 2026-08-22 11:51:16 +08:00
Michael 02b93e7e01 [AMD] Add GLM-5.2 MI35x nightly accuracy and perf benchmark (#32570) 2026-08-19 22:49:43 -07:00
8ea5229d42 [AMD] Add the Kimi-K3 MI35x perf benchmarks in nightly (#34985)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
2026-08-17 21:23:51 -07:00
Baizhou Zhang bc312d185d Clean deprecated DeepSeek V4 Environs (#34926) 2026-08-17 16:07:00 -07:00
816ea65058 [AMD] Add Kimi-K3 8-GPU MI35x nightly accuracy CI (#32568)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
2026-08-17 14:48:29 -07:00
Wang, FangYuan eb61cb2823 [AMD] Support prefill context parallel two batch overlap for DeepSeek V4 (#33480) 2026-08-16 22:40:29 -07:00
d91c3682b0 [AMD][CI] Add GPT-OSS perf benchmarks to the ROCm 7.2 nightly (#34645)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: Michael <michaelzhang-ai@users.noreply.github.com>
2026-08-16 16:35:09 -07:00
jacky.chengandsogalin_codegen 240a12b302 [AMD] Fuse shared_expert_gate GEMV into the MoE append kernel (HIP/aiter) (#28666)
Co-authored-by: sogalin_codegen <39478626+sogalin@users.noreply.github.com>
2026-08-13 21:32:27 -07:00
e74ea5b1d7 [ROCm/gfx95] Fix fp8 per-channel attention for Kimi-K2.7-code-mxfp4 o… (#31105)
Co-authored-by: Hung <Emmanuel0612@users.noreply.github.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
2026-08-11 00:51:57 -07:00
Wang, FangYuan ba7abd4f92 [AMD] Support DeepSeek V4 DSpark on AMD HIP platform (#30964) 2026-08-08 15:22:14 -07:00
a59bb931c6 Fix DCP KV head mapping for GQA models (#32858)
Co-authored-by: Khoa Pham <khoa.pham@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-08 14:25:09 -07:00
Baizhou Zhang 0e584529f5 [CI] Remove profiling from nightly tests (#33832) 2026-08-06 01:16:08 -07:00
YC Yen-Ching Tseng eaf5c29cc5 [AMD] Enable block-fp8 + quick INT4 all-reduce in MiniMax-M3 MI35x nightly Test (#33402) 2026-08-04 01:55:06 -07:00
Bingxu Chen bfc450248e [AMD] Replace MI325 with MI300 CI Runners (#31409) 2026-07-29 08:18:07 -07:00
YC Yen-Ching Tseng 1d0cd2e473 [AMD] Nightly Test Coverage - Minimax-M3-MXFP8 Accuracy Test (#30613) 2026-07-25 23:52:22 -07:00
e8e765b9d6 [AMD] Add fused all-reduce RMSNorm per-group quant for Qwen3.5 FP8 (#24651)
Co-authored-by: jacky.cheng <yichiche@amd.com>
Co-authored-by: yctseng0211 <yctseng@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2026-07-22 07:33:03 -07:00
Wang, FangYuan e2d021d4ab [AMD] Support two batch overlap with MTP on DeepSeekV4 (#30238) 2026-07-16 02:34:04 -07:00
Liangsheng Yin e2728ac504 [Spec] Remove dead padded_static_len and stale SGLANG_ENABLE_SPEC_V2 references (#30998) 2026-07-13 15:30:31 -05:00