Commit Graph
14 Commits
Author SHA1 Message Date
b16af90bc3 AMD/ROCm: update base image string (#4137)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: yichiche <yichiche@amd.com>
2025-03-06 03:38:54 -08:00
kk e0a2c96308 Fix breakage problem when using custom_ar (#4052) 2025-03-04 02:59:03 -08:00
kkandwunhuang 11eea69e70 Fix assert options.num_stages != 0 error in the latest ROCm build image (#4049)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-03-03 20:37:03 -08:00
kkandwunhuang 4885b90802 Use forward_cuda to execute custom op for hip platform (#3305)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-02-05 02:58:17 +00:00
kkandwunhuang b8cd09f27a update ROCm docker for layernorm kernel optimization (#2885)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-01-14 16:59:43 +08:00
kkandLin, Soga 42f3909963 Unify sglang coding style (#2856)
Co-authored-by: Lin, Soga <soga.lin@amd.com>
2025-01-13 02:12:44 -08:00
e808c1df3e Integrate ROCm ater package for ck moe function feasibility (#2854)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>
2025-01-13 08:23:07 +00:00
kkandwunhuang 148254d4db Improve moe reduce sum kernel performance (#2705)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-01-02 01:11:06 -08:00
kkandwunhuang b6e0cfb5e1 ROCm base image update (#2692)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-01-01 12:12:19 +08:00
70dc2fbe2d Change extend attention kernel launch parameter for ROCm platform to … (#2610)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2024-12-27 00:32:17 -08:00
kkandwunhuang b438a2e512 Fix triton kernel performance regression (#2611)
Co-authored-by: wunhuang <wunhuang@amd.com>
2024-12-27 15:54:38 +08:00
kkandwunhuang 7ca751ff7d Fused moe triton cfg opt for rocm (#2612)
Co-authored-by: wunhuang <wunhuang@amd.com>
2024-12-26 23:38:22 -08:00
a9ca297d76 [3rdparty, document] Updated Documentation that for triton fused_moe kernel tuning for AMD Instinct GPUs (#2191)
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
2024-11-28 02:23:10 +08:00
kkandwunhuang 8cdc76f6d4 [Performance, Hardware] MoE tuning on AMD MI300x GPUs (#1554)
Co-authored-by: wunhuang <wunhuang@amd.com>
2024-10-02 09:52:46 -07:00