4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
yinghuiandLianmin Zheng	56222658ec	move eagle draft post process to cuda graph (#11434) ... Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>	2025-10-14 22:50:53 +08:00
cicirori	a2f7218a2e	support using fa4 on deepseek on blackwell (#9928)	2025-09-16 16:16:06 -07:00
cicirori	8c5930f08a	Add speculator attention backend switch (#9981)	2025-09-07 21:44:36 -07:00
cicirori	b6c14ec0b4	add response_format support for completion API (#9665)	2025-08-26 15:01:29 -07:00