2 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Shangming Cai	eb429b88a4	[PD] Respect sampling_params.max_new_tokens when PD disaggregation is activated (#7598) ... Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>	2025-06-27 22:22:01 -07:00
shangmingc	89a554181f	[PD] Fix unclosed prefill connection warning of mini_lb (#5155) ... Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>	2025-04-08 09:15:06 -07:00