 saltyfish66
|
133ded039a
|
perf: update H20 fused_moe_triton kernel config to get higher throughput during prefilling (#5716)
|
2025-04-26 18:15:07 -07:00 |
|
|
saltyfish66andyuethe
|
2aa3f5e2d0
|
[feature] Add H20 fp8_w8a8 FusedMoE config for --n-share-experts-fusion=16 (#5641)
Co-authored-by: yuethe <yuethe@tencent.com>
|
2025-04-22 09:33:13 -07:00 |
|
|
saltyfish66andyuethe
|
e41549c3d6
|
fix: fix illegal cuda memory access at fused_moe_kernel (#4727)
Co-authored-by: yuethe <yuethe@tencent.com>
|
2025-04-03 00:07:32 -07:00 |
|