[Fix] assert error in log_prefill_stats (#15881)
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com> Co-authored-by: Junjie Mao (Alibaba) <banxing.mjj@alibaba-inc.com>
This commit is contained in:
@@ -331,6 +331,8 @@ class SchedulerDisaggregationPrefillMixin:
|
||||
if batch:
|
||||
trace_event_batch("schedule", batch.reqs)
|
||||
|
||||
self.log_prefill_stats_late(batch)
|
||||
|
||||
return batch
|
||||
|
||||
@torch.no_grad()
|
||||
|
||||
Reference in New Issue
Block a user