6 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Trevor Morris	84810da4ae	Add Cutlass MLA attention backend (#5390)	2025-04-27 20:58:53 -07:00
Trevor Morris	4dce1cc608	[PD] Add NIXL transfer backend (#5477)	2025-04-22 01:36:12 +08:00
Trevor Morris	e8f62b20ca	BLackwell cutlass mla: Add check for bad page size/block num combinations (#5431)	2025-04-15 14:07:42 -07:00
Trevor Morris	f65b8d5c89	Blackwell Cutlass MLA kernel (#5142)	2025-04-11 22:16:51 -07:00
Trevor Morris	11d760d56a	FP4 weight loading and inference (2/2) (#3972)	2025-04-08 17:26:21 -07:00
Trevor Morris	e9f8e42318	Support FP4 gemm (1/2) (#3899)	2025-03-24 19:50:23 -07:00