3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
3 people	fba785c459	use aync load for encoder_server (#15456) ... Signed-off-by: liuanqi <liuanqi6@xiaomi.com> Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com> Co-authored-by: liuanqi <liuanqi6@xiaomi.com>	2026-01-06 14:31:52 +08:00
3 people	078d96213a	[FEAT] optimize tensor zmq transfer for multimodal inputs (#13592) ... Co-authored-by: Shangming Cai <csmthu@gmail.com> Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>	2026-01-03 12:23:23 +08:00
siyu	abdf65d4f3	Fix OOM by offloading multimodal features to CPU after embedding (#16018)	2025-12-31 23:02:34 +08:00