Commit Graph
16 Commits
Author SHA1 Message Date
Qi YuhangandFan Yin 7ea5b42d70 [sgl-kernel][5/N]Support Expert Specialization Grouped GEMM (#12666)
Co-authored-by: Fan Yin <1106310035@qq.com>
2025-11-11 21:23:25 -08:00
Qi Yuhang ce112c07fe [sgl-kernel][4/N]Support Expert Specialization Grouped GEMM (#12080) 2025-10-27 01:20:01 -07:00
Qi Yuhang 6c01844f45 [sgl-kernel][3/N]Support Expert Specialization Grouped GEMM (#11674) 2025-10-15 13:39:31 -07:00
Qi Yuhang dc48c4c0e3 [sgl-kernel][2/N]Support Expert Specialization Grouped GEMM (#11534) 2025-10-13 16:24:48 -07:00
9a30914e94 [sgl-kernel][1/N]Support Expert Specialization Grouped GEMM (#11432)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: PGFLMG <1106310035@qq.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2025-10-12 20:19:21 -07:00
Qi Yuhang 0f04a5f428 Optimize cutlass int8 gemm kernel for large M on SM89 Ada GPU (#10714) 2025-09-21 17:04:27 -07:00
Qi Yuhang 9b876889b7 Update CUTLASS. Refine KernelSchedule for fp8 (grouped) gemm. (#10491) 2025-09-16 02:47:37 -07:00
Qi Yuhang 85ed8e0a5e Optimize nvfp4 block scaled gemm kernel when M is small. (#10101) 2025-09-06 22:31:00 -07:00
Qi Yuhang fda4792620 Update CUTLASS 4.2 & Enable K-Major Scale Factor for SM90 FP8 Blockwise Group GEMM (#9559) 2025-08-24 23:24:43 -07:00
Qi Yuhang d9def43dcd [Perf]Use Cooperative Schedule for H100 & H200 & H800 in fp8_blockwise_scaled_grouped_mm (#8722) 2025-08-02 21:13:47 -07:00
Qi Yuhang 9b9e82539b [Fix]Fix index oob in get_group_gemm_starts kernel. (#8564) 2025-07-30 19:49:35 -07:00
Qi Yuhang 426b74936a Add nvfp4 scaled mm benchmark. (#8401) 2025-07-26 23:18:04 -07:00
Qi Yuhang 6e92da8fca [Fix][Ready]Fix register spilling in cutlass nvfp4 gemm kernel on Blackwell (#8127) 2025-07-17 20:49:36 -07:00
Qi Yuhang c268c11c71 [feat]Support fusion kernel for constructing quant input and scale factor for fp8_blockwise_scaled_grouped_mm (#8023) 2025-07-15 00:02:44 -07:00
Qi Yuhang 26118a133d [fix]Update unitest for fp8_blockwise_scaled_grouped_mm kernel (#7932) 2025-07-11 14:29:13 -07:00
Qi Yuhang 8e9fb43d82 Optimize Hopper CUTLASS FP8 Blockwise Grouped GEMM Kernel in Small K Scenario (#7782) 2025-07-04 22:25:49 -07:00