chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Fix condition for streaming output_ids in tokenizer manager (#13759)

Browse Source 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Chang Su <chang.s.su\n@oracle.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
This commit is contained in:
Lianmin Zheng
2025-11-29 13:56:15 -08:00
committed by GitHub
parent d7cb08c5be
commit 155a9e7237
6 changed files with 72 additions and 30 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/bench_one_batch_server.py
View File

@@ -578,6 +578,8 @@ def run_benchmark(server_args: ServerArgs, bench_args: BenchArgs):
if is_in_ci() and bench_args.append_to_github_summary:
write_github_step_summary(summary)
else:
print(summary)
# Save results as pydantic models in the JSON format
if bench_args.pydantic_result_filename: