Lianmin Zheng aba9eae4c6 Fix the correctness test in bench_latency.py when tp > 1 and test_generation_models.py (#1631)

2024-10-11 05:03:20 -07:00

5.4 KiB

Raw Blame History

View Raw