minke.yu/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Disagg] Finalize routed_experts_output in process_batch_result_disagg_prefill (#23885)

Browse Source 
Co-authored-by: Byron Hsu <byron@periodiclabs.ai>
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This commit is contained in:
Byron Hsu
2026-04-27 16:40:05 -07:00
committed by GitHub
co-authored by Byron Hsu Claude Opus 4.7
parent 7b9ff79f93
commit cb0429f253
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/disaggregation/prefill.py
+3
View File
@@ -490,6 +490,9 @@ class SchedulerDisaggregationPrefillMixin:
if copy_done is not None: if copy_done is not None:
copy_done.synchronize() copy_done.synchronize()
if result.routed_experts_output is not None:
result.routed_experts_output.finalize()
result.routed_experts_output = None
logprob_pt = 0 logprob_pt = 0
# Transfer kv for prefill completed requests and add it into disagg_prefill_inflight_queue # Transfer kv for prefill completed requests and add it into disagg_prefill_inflight_queue