[Fix] Update text_chunks in bench_serving chat completions (#13041)

This commit is contained in:
Ziming Huang
2025-11-12 03:41:11 +08:00
committed by GitHub
parent 14a339fcc8
commit e8114102fa

View File

@@ -401,6 +401,7 @@ async def async_request_openai_chat_completions(
# Decoding phase
else:
output.text_chunks.append(content)
output.itl.append(
timestamp - most_recent_timestamp
)