chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Auto Sync] Update bench_one_batch_server_internal.py (20260221) (#19097)

Browse Source 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
This commit is contained in:
Lianmin Zheng
2026-02-20 18:19:14 -08:00
committed by GitHub
parent 84c67c8be0
commit 2928dfb8fa
1 changed files with 3 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
python/sglang/test/bench_one_batch_server_internal.py
View File

@@ -827,9 +827,10 @@ def run_benchmark_internal(
# Warmup
if not bench_args.skip_warmup:
batch_size_unique = list(set(bench_args.batch_size))
print("=" * 8 + " Warmup Begin " + "=" * 8)
print(f"Warmup with batch_size={bench_args.batch_size}")
for bs in bench_args.batch_size:
print(f"Warmup with batch_size={batch_size_unique}")
for bs in batch_size_unique:
run_one_case(
base_url,
batch_size=bs,