4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Jerry Zhang	9b0926ceeb	Add llama implementation with no tensor parallel linears (#1561)	2024-10-05 11:22:27 -07:00
Jerry Zhang	63e845d0bb	Add float8 dynamic quant to torchao_utils (#1528)	2024-09-28 12:27:54 -07:00
Jerry Zhang	30b404ce72	Add torchao quant for mixtral and qwen_moe (#1418)	2024-09-14 06:46:55 +00:00
Jerry ZhangandLianmin Zheng	a7c47e0f02	Add torchao quant (int4/int8/fp8) to llama models (#1341) ... Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>	2024-09-09 05:32:41 -07:00