4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Cheng Wan	7b5fc71972	fix SUPPORT_CUTLASS_BLOCK_FP8 flag (#4640)	2025-03-20 21:45:07 -07:00
Cheng Wan	3196999f63	Reduce computation and communication in DP attention (#4521)	2025-03-18 13:41:36 -07:00
Cheng WanandAbatom	2f6bacee03	[moe] fix: correct the cache size in the last chunk (#3679) ... Co-authored-by: Abatom <abzhonghua@gmail.com>	2025-03-12 22:22:13 -07:00
Cheng Wan	6b0aeb58fd	[moe] optim: reduce memory consumption in fused_moe (#3692)	2025-02-20 02:25:05 +08:00