3 Commits

Include renames

Author	SHA1	Message	Date
Lianmin Zheng	2558d6a675	Fix the default arguments of bench_offline_throughput.py & simplify detokenizer manager (#2042)	2024-11-15 05:02:44 -08:00
Lianmin Zheng	1701b0db31	Enhance the test case for chunked prefill (#1785)	2024-10-24 21:23:09 -07:00
Lianmin Zheng	9116b2896f	Add a new event loop (#1677)	2024-10-16 01:33:20 -07:00