chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

feat: only add input vision tokens in bench_serving result if vision dataset is used (#15492)

Browse Source 
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
This commit is contained in:
Raayan Dhar
2026-01-05 20:14:42 -08:00
committed by GitHub
parent c80c0e0fc0
commit 84d13c54bb
1 changed files with 6 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
python/sglang/bench_serving.py
View File

@@ -2419,9 +2419,12 @@ async def benchmark(
print("{:<40} {:<10.2f}".format("Benchmark duration (s):", benchmark_duration))
print("{:<40} {:<10}".format("Total input tokens:", metrics.total_input))
print("{:<40} {:<10}".format("Total input text tokens:", metrics.total_input_text))
print(
"{:<40} {:<10}".format("Total input vision tokens:", metrics.total_input_vision)
)
if args.dataset_name in ["image", "mmmu"]:
print(
"{:<40} {:<10}".format(
"Total input vision tokens:", metrics.total_input_vision
)
)
print("{:<40} {:<10}".format("Total generated tokens:", metrics.total_output))
print(
"{:<40} {:<10}".format(