Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0b2 - sglang - Gitea: Git with a cup of tea

chenchenghao/sglang

Auto handle PD disaggregation in bench_serving (#6587)

Co-authored-by: yizhang2077 <1109276519@qq.com>

This commit is contained in:

fzyzcjy

2025-05-25 22:41:27 -07:00

committed by

GitHub

co-authored by

yizhang2077

parent d502dae0f0

commit 25be63d0b2

3 changed files with 8 additions and 10 deletions

									
										scripts/playground/disaggregation/cli-logprob.py
									
		+1
		-1
	
												View File
												
				@@ -1,4 +1,4 @@

				prompt = "The capital of taiwan is "

				prompt = "The capital of france is "

				import json