[Fix] assert error in log_prefill_stats (#15881)
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com> Co-authored-by: Junjie Mao (Alibaba) <banxing.mjj@alibaba-inc.com>
This commit is contained in:
co-authored by
Junjie Mao
parent
3778c2fc6d
commit
cf34d0ab32
@@ -331,6 +331,8 @@ class SchedulerDisaggregationPrefillMixin:
|
|||||||
if batch:
|
if batch:
|
||||||
trace_event_batch("schedule", batch.reqs)
|
trace_event_batch("schedule", batch.reqs)
|
||||||
|
|
||||||
|
self.log_prefill_stats_late(batch)
|
||||||
|
|
||||||
return batch
|
return batch
|
||||||
|
|
||||||
@torch.no_grad()
|
@torch.no_grad()
|
||||||
|
|||||||
Reference in New Issue
Block a user