[Fix] disaggregation: Keep a requeued optimistic prefill request's multimodal inputs (#45440)

Co-authored-by: metamergebot <metamergebot@users.noreply.github.com>
Co-authored-by: libertyeagle <30348494+libertyeagle@users.noreply.github.com>
Co-authored-by: fei-xx <135589532+fei-xx@users.noreply.github.com>
This commit is contained in:
metamergebot
2026-10-20 20:27:34 -07:00
committed by GitHub
co-authored by metamergebot libertyeagle fei-xx
parent 6bd1c76735
commit 1c2f42470c
2 changed files with 66 additions and 2 deletions
+3 -1
View File
@@ -1734,7 +1734,9 @@ class SchedulerDisaggregationPrefillMixin:
req._compute_max_prefix_len(len(req.full_untruncated_fill_ids)),
)
)
self._release_aborted_request(req)
# The request is requeued, not aborted: keep its multimodal inputs (the
# re-prefill embeds its image tokens again) and its streaming session.
self.tree_cache.finish(req.cache_request_handle, CacheRequestOutcome.ABORT)
# The checkpoint above already handed the prefill KV to the tree; the
# request is not finished, so the release only frees the rest.
release_kv_cache(req, self.tree_cache, checkpoint=False)