Commit Graph
22 Commits
Author SHA1 Message Date
Thomas Wangandbingxche b0d888a195 [CI] Remove AMD DSv4 Docker publish job (#27795)
Co-authored-by: bingxche <bingxche@amd.com>
2026-06-10 17:50:28 +08:00
Thomas WangandXinyi Song f2bcdb0508 [AMD] Add unified kv attention support in dpsk-v4 (#27380)
Co-authored-by: Xinyi Song <86638975+RolaoDenthu@users.noreply.github.com>
2026-06-09 23:13:37 -07:00
Thomas Wang 9ab7a64ee1 [AMD] Update amd qwen3.5 cookbook (#27660) 2026-06-09 16:26:33 -07:00
Thomas Wang d15a2dc72c [AMD] dpsk-v4 swa loc cache support (#26931) 2026-06-01 22:37:07 -07:00
Thomas Wang 6e9bd82714 [AMD][CI] Update v4 CI setting and move the task to main branch (#26662) 2026-05-29 00:12:40 -07:00
Thomas Wang a9359707c1 [AMD] Enable preshuffle paged MQA and page_size=64 for NSA indexer (#23562) 2026-05-13 02:33:57 -07:00
Thomas Wang 19afe73e03 [AMD] Cherry-pick aiter commit for mhc_pre fix (#24665) 2026-05-07 23:49:39 -07:00
Thomas Wang 57ecce9807 [AMD] Enable MTP for GLM-5-mxfp4 model (#23219) 2026-04-20 16:09:07 -07:00
Thomas Wang 03828f4205 [AMD] Reduce NSA indexer kernels (weights_proj, k-cache store kernel fusion) (#22850) 2026-04-19 00:18:11 -07:00
Thomas Wang 4a746ea462 [AMD] Remove aiter hotfixes in Dockerfile covered by aiter v0.1.12.post1 (#22657) 2026-04-13 00:01:37 -07:00
Thomas Wang 729b74d8dd [AMD] Fix GLM-5 fp8 KV quant path dispatch on MI300 (#22314) 2026-04-07 21:16:02 -07:00
Thomas Wang 7431db7392 [AMD] Enable FP8 KV cache and FP8 attention kernel for NSA on MI300/MI355 with TileLang backend (#21511) 2026-04-03 00:58:23 -07:00
Thomas Wang 5628e908ae [AMD] Use tgemm.mm for MoEGate router gemm in deepseek_v2.py (#21657) 2026-03-31 00:55:40 -07:00
Thomas Wang 855d15adf6 [AMD] Tilelang sparse fwd for dsv32 mi355/mi300 (#19945) 2026-03-24 02:01:39 -07:00
Thomas Wang c0a4408f78 [AMD] Fix dpsk-v32 accuracy issue on mi355 (#20840) 2026-03-18 02:06:15 -07:00
Thomas Wang 5172c37845 [AMD] Use fused GEMM with FP8 cast for FP8 prefill (#19422) 2026-02-26 15:14:52 -08:00
e20e6c28b9 [AMD] Fix accuracy issue when running TP4 dsv3 model with mtp (#18607)
Co-authored-by: YC Tseng <yctseng@amd.com>
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
2026-02-12 01:13:16 -08:00
Thomas WangandkkHuang-amd a8eef53dc4 Fp8 prefill attn kernel integration (#18528)
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
2026-02-10 23:23:48 -08:00
Thomas Wangandkk 4262f5259b Tilelang sparse decode fwd for dsv32 mi355 (#18488)
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
2026-02-10 09:53:26 -08:00
Thomas Wang 6988a0f570 Disable mla persistent kernel when not using fp8 kv_cache (#17327) 2026-01-19 20:29:54 -08:00
Thomas Wang 820e97d6c9 Upgrade aiter version (#16619) 2026-01-06 22:20:42 -08:00
Thomas Wang 5a8adca900 Turn off PREBUILD aiter in MI355 (#13963) 2025-11-25 22:30:39 -08:00