chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

Update docs (#13391)

Browse Source 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
This commit is contained in:
Lianmin Zheng
2025-11-16 19:36:33 -08:00
committed by GitHub
parent 2a5773440e
commit 7e626d12b7
20 changed files with 115 additions and 190 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
docs/developer_guide/bench_serving.md
View File

@@ -1,4 +1,4 @@
## Bench Serving Guide
# Bench Serving Guide
This guide explains how to benchmark online serving throughput and latency using `python -m sglang.bench_serving`. It supports multiple inference backends via OpenAI-compatible and native endpoints, and produces both console metrics and optional JSONL outputs.