3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Francis	07404d7689	[HiCache] fix condition check when use decode offload (#14489)	2025-12-08 15:52:40 -08:00
FrancisandShangming Cai	a16923efab	[PD] optimize kv cache transfer directly using batch transfer (#9149) ... Co-authored-by: Shangming Cai <csmthu@gmail.com>	2025-08-13 09:54:14 -07:00
Francis	2ed68d7a6c	[PD Disaggregation] replace transfer with batch transfer for better performance (#7236)	2025-06-24 02:12:04 -07:00