chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Refactor] Benchmark: Add typed DatasetArgs/Loader registry and CPU dataset unit tests (#19147)

Browse Source 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
This commit is contained in:
Ratish P
2026-02-25 01:52:01 +05:30
committed by GitHub
parent 65de904130
commit ae6f6e1495
19 changed files with 807 additions and 160 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
python/sglang/test/kits/cache_hit_kit.py
View File

@@ -6,7 +6,7 @@ import aiohttp
import requests
from sglang.bench_serving import RequestFuncOutput
from sglang.benchmark.datasets import sample_random_requests
from sglang.benchmark.datasets.random import sample_random_requests
from sglang.benchmark.utils import get_tokenizer, remove_prefix
AIOHTTP_TIMEOUT = aiohttp.ClientTimeout(total=20 * 60 * 60)