Commit Graph
52 Commits
Author SHA1 Message Date
jacky.cheng bc30fa1759 [AMD][Fix] AgentX HIP TPOT regression when SGLANG_SIMULATE_ACC_LEN is set (#40598) 2026-09-21 19:16:15 -07:00
jacky.cheng 31b577bb08 [AMD] Pad QSA MQA decode Q-heads to 16 for ROCm MFMA (#38875) 2026-09-21 17:43:46 -07:00
jacky.cheng e0c2e8dc4d [AMD] Tune Qwen3.5 TP4 GDN recurrent launch on gfx950 (#39987) 2026-09-21 13:20:54 -07:00
jacky.cheng 90b3f8544c [AMD] Use Triton softmax routing for Qwen3.5 on gfx950 (#39986) 2026-09-21 12:02:29 -07:00
jacky.cheng 11c35b8433 [AMD] Load fused shared experts for Qwen4-Exp and Qwen3.5 MTP (#38878) 2026-09-17 19:56:31 +08:00
jacky.chengandChangLiu0709 a9bb4d7d45 [AMD] Align Qwen3.5 MI355X HiCache cookbook with kernel / page_first (#39572)
Co-authored-by: ChangLiu0709 <cliu1004@amd.com>
2026-09-16 11:22:28 +08:00
jacky.cheng 2f5cc8e33e [AMD] Align Qwen3.5 MI355X cookbook with AttnFP8-V2 and HiCache direct / page_first_direct (#39358) 2026-09-14 12:46:17 +08:00
jacky.chengandHAI d6fabb74b4 [AMD][Fix] Fix aiter bpreshuffle GEMM for output sizes it cannot dispatch for qwen3.5 mxfp-attn-fp8-v2 TP4 (#37564)
Co-authored-by: HAI <hixiao@gmail.com>
2026-09-12 23:11:44 -07:00
jacky.cheng 0bdc15d20f [AMD] Fix ROCm VAE Conv2D fast path breaking spatial-parallel decode (#34424) 2026-09-05 01:00:25 -07:00
jacky.cheng c967cd19b5 [AMD] Optimize Qwen3.5 MTP unified attention on gfx950 (#36330) 2026-08-27 00:13:49 -07:00
jacky.cheng f775db03aa [AMD] Fix int32 seqused_k overflow in aiter draft-extend attention (#36541) 2026-08-26 22:06:39 -07:00
jacky.cheng 6a81038317 [AMD] Drop redundant FP8 bpreshuffle scale transpose via fused AR kernel (#33021) 2026-08-25 02:49:57 -07:00
jacky.cheng 9eee990ce1 [AMD] cookbook: add HiCache host-DRAM KV tier for Qwen3.5 MXFP4 on MI355X (#36245) 2026-08-25 12:55:52 +08:00
jacky.cheng 0d5b5ae620 [AMD] Fix Qwen3.5 MTP dropping fused shared-expert weights (#35719) 2026-08-24 13:18:42 -07:00
jacky.cheng 0665740953 [AMD][Fix] Route MoRI through the Qwen MoE all-to-all path (#32039) 2026-08-24 13:04:08 -07:00
jacky.cheng 574274660f [AMD] cookbook: serve Qwen3.5 MXFP4 on MI355X with an fp8_e4m3 KV cache (#35445) 2026-08-19 18:49:32 +08:00
jacky.cheng 6314e9e4f5 [AMD][Fix] Qwen3.5: guard zero-grid launch in fused_qk_gemma_rmsnorm(_with_gate) (HIP invalid configuration on idle DP rank) (#31794) 2026-08-15 21:02:54 -07:00
jacky.chengandsogalin_codegen 240a12b302 [AMD] Fuse shared_expert_gate GEMV into the MoE append kernel (HIP/aiter) (#28666)
Co-authored-by: sogalin_codegen <39478626+sogalin@users.noreply.github.com>
2026-08-13 21:32:27 -07:00
jacky.cheng b7f87a2513 [AMD][Perf] Fuse GatedDeltaNet QKVZBA split/reshape/cat into a single Triton kernel for Qwen3.5-architecture MoE on HIP (#34421) 2026-08-13 00:18:35 -07:00
jacky.cheng 723c277640 [AMD] [Fix] Enable aiter hd256 FP8 prefill FMHA on gfx950 (#33399) 2026-08-04 02:40:33 -07:00
jacky.cheng 0d186f49be [AMD][Fix] Restore aiter-padded MoE weight dims for serialized checkpoints (#33090)
AMD only change
2026-07-31 22:09:37 -07:00
jacky.cheng 833e1bc601 [Fix][AMD] Qwen3.5 MoE: disable global-slot shared-expert fusion under per-rank EP backends (MoRI + dp-attention init crash) (#31793) 2026-07-25 23:59:47 -07:00
jacky.cheng 17fdd8487f [AMD] Update qwen3.5 cookbook (#31737) 2026-07-20 14:14:14 +08:00
jacky.cheng e78051a419 [AMD] [Fix] Fix --attention-backend triton work for DeepSeek MLA on MI355 (null-K + decode dispatch + RoPE) (#30355) 2026-07-15 14:19:23 -07:00
jacky.cheng 96368a5f77 [AMD] Fuse shared-expert sigmoid + bf16->fp32 cast into the MoE append kernel (3 kernels -> 1) (#28658) 2026-07-08 02:34:20 -07:00
jacky.cheng 149fabcca7 [AMD] Fuse sigmoid + mul into single Triton kernel for shared expert gating (#27636) 2026-06-16 01:16:58 -07:00
jacky.cheng 22c7285a26 [AMD] Fuse sigmoid + mul attention output gate into single Triton kernel (#27630) 2026-06-11 02:05:05 -07:00
jacky.cheng f4b3b99413 [AMD] Enable fused GDN QKV split Triton kernel on HIP (#27583) 2026-06-11 02:01:27 -07:00
jacky.cheng 0da18f8d91 [AMD][Perf] Fuse QK RMSNorm + gate extraction Triton kernel for Qwen3.5 on HIP (#27656) 2026-06-10 14:29:33 -07:00
jacky.cheng 2fef951fe8 [AMD] Replace fp8 mla with fp8 mha kernel for diffusion model aiter backend (#23927) 2026-06-09 14:46:41 -07:00
jacky.cheng 7aee2ff31b [AMD] Remove BF16-to-FP32 elementwise cast from compressor GEMM on HIP (#26914) 2026-06-04 00:58:02 -07:00
jacky.cheng 1dd9432889 [AMD] Fuse compress norm+rope+hadamard into single Triton kernel (#26894) 2026-06-03 14:20:40 -07:00
jacky.cheng f21d4868dc [AMD] Replace naive triton RMSNorm with aiter RMSNorm for diffusion model (#24360) 2026-05-08 02:44:13 -07:00
jacky.cheng 76a1f169b3 [AMD] Add AMD FP8 MLA attention test for Wan2.2-T2V-A14B (#23955) 2026-05-08 01:03:51 -07:00
jacky.cheng b22d3cd606 [AMD] Support fp8 MLA for diffusion model (#20319) 2026-05-08 00:56:24 -07:00
jacky.chengandBingxu Chen 180bb2624f [AMD] Fix CI RuntimeError: opentelemetry package is not installed (#23940)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-04-29 18:02:44 +08:00
jacky.cheng d95715ec65 [AMD] Fix CI test_diffusion_generation[flux_2_image_t2i_2_gpus] (#23944) 2026-04-28 23:06:29 +08:00
jacky.cheng d283808457 [AMD] Replace triton rotary_emb with aiter rotary_emb for Wan2.2 denoise (#22422) 2026-04-09 18:21:02 -07:00
jacky.cheng 8ba992411d [AMD] Fix CI multimodal-gen-test-1-gpu-amd for gen model (#21621) 2026-03-30 23:02:20 -07:00
jacky.chengandHaiShaw c86f6c2831 [AMD] Add peft>=0.18.0 to diffusion_hip deps for transformers 5.x compat for AMD diffusion model (#21442)
Co-authored-by: HaiShaw <hixiao@gmail.com>
2026-03-28 20:28:05 -07:00
jacky.cheng b4d3fb001d [AMD] Add fused GemmaRMSNorm forward_hip to use aiter/vllm kernels for qwen3.5 (#21188) 2026-03-23 10:21:36 -07:00
jacky.cheng 1e2983c98e [AMD] Fix FP8 assertion failure in aiter MLA decode by falling back to self.k_scale (#19935) 2026-03-12 01:48:51 -07:00
jacky.cheng 98f47d8175 [AMD] Add Qwen3-Coder-Next accuracy and functionality test scripts for MI35x 8-GPU (#18608) 2026-03-01 23:52:47 -08:00
jacky.chengandyichiche@amd.com b2c46fc60b [AMD] Support Qwen3-Coder-Next on AMD platform (#18355)
Co-authored-by: yichiche@amd.com <jacky.cheng>
2026-02-25 11:06:22 -08:00
jacky.chengandyichiche@amd.com e138f7960a [AMD] Fix accuracy while using --enable-dp-attention (#19247)
Co-authored-by: yichiche@amd.com <jacky.cheng>
2026-02-24 20:50:28 -08:00
jacky.cheng 8ac350f335 [AMD] Support fused_rms_mxfp4_quant in the prefill stage for DeepSeek-R1-MXFP4 (#14975) 2025-12-16 12:03:58 -08:00
jacky.chengandyctseng0211 eff7df6d0a [AMD] Enable fused shared expert append and flatten quant for fp8 deepseekR1 model (#13705)
Co-authored-by: yctseng0211 <yctseng@amd.com>
2025-11-21 02:48:28 -08:00
jacky.cheng 99c92ff24b [AMD] Support a new flag to disable quant on parallelLinear layer if required (#11811) 2025-10-22 19:16:15 -07:00
jacky.cheng b00a0c786f [Fix] Update to v0.1.5.post4 and refine HIP attention backend selection (#11161) 2025-10-02 21:19:30 -07:00
jacky.cheng 5991119541 [Fix] Resolve performance drop in speculative decoding aiter backend (#11087) 2025-09-29 23:51:30 -07:00
jacky.cheng efb0de2c8d Update wave-lang to 3.7.0 and unify Wave kernel buffer options (#10069) 2025-09-05 16:01:52 -07:00
25caa7a8a9 [AMD] Support Wave attention backend with AMD GPU optimizations (#8660)
Signed-off-by: Stanley Winata <stanley.winata@amd.com>
Signed-off-by: Harsh Menon <harsh@nod-labs.com>
Signed-off-by: nithinsubbiah <nithinsubbiah@gmail.com>
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
Signed-off-by: xintin <gaurav.verma@amd.com>
Co-authored-by: Harsh Menon <harsh@nod-labs.com>
Co-authored-by: Stanley Winata <stanley.winata@amd.com>
Co-authored-by: Stanley Winata <68087699+raikonenfnu@users.noreply.github.com>
Co-authored-by: Stanley Winata <stanley@nod-labs.com>
Co-authored-by: Ivan Butygin <ivan.butygin@gmail.com>
Co-authored-by: nithinsubbiah <nithinsubbiah@gmail.com>
Co-authored-by: Nithin Meganathan <18070964+nithinsubbiah@users.noreply.github.com>
Co-authored-by: Ivan Butygin <ibutygin@amd.com>
2025-08-12 13:49:11 -07:00