[Refactor] Benchmark Phase 1: extract utils and datasets from bench_serving (#19077)
Co-authored-by: Xuchun Shang <107600043+xucsh@users.noreply.github.com>
This commit is contained in:
Co-authored-by: Xuchun Shang <107600043+xucsh@users.noreply.github.com>