3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Yusong Gao	4bec99ecd0	Fix: resolve prefill of retracted request out-of-memory issue when ignore_eos is enabled (#7434)	2025-08-02 14:43:45 +08:00
Yusong Gaoandyudian0504	c07f647c9f	perf: add kimi k2 fused_moe tuning config for h30_3e (#8021) ... Co-authored-by: yudian0504 <yudian.zy@antgroup.com>	2025-07-14 02:56:11 -07:00
Yusong Gao	41273fd71f	fix: handle None multimodal_inputs during merging and filtering batches in disaggregation decode mode (#6169)	2025-05-11 00:28:21 -07:00