[Disagg] Finalize routed_experts_output in process_batch_result_disagg_prefill (#23885)

Co-authored-by: Byron Hsu <byron@periodiclabs.ai> Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-27 16:40:05 -07:00
parent 7b9ff79f93
commit cb0429f253
1 changed files with 3 additions and 0 deletions
@@ -490,6 +490,9 @@ class SchedulerDisaggregationPrefillMixin:

        if copy_done is not None:
            copy_done.synchronize()
+        if result.routed_experts_output is not None:
+            result.routed_experts_output.finalize()
+            result.routed_experts_output = None

        logprob_pt = 0
        # Transfer kv for prefill completed requests and add it into disagg_prefill_inflight_queue