5 Commits

Include renames

Author	SHA1	Message	Date
Ying Sheng	e4780cf839	[API, Feature] Support response prefill for openai API (#1490)	2024-09-22 06:46:17 -07:00
Mingyi	158e8f1e2d	improve the threshold and ports in tests (#1215)	2024-08-25 19:02:08 -07:00
Yineng Zhang	f7fb68d292	ci: add moe test (#1053)	2024-08-13 18:43:23 +10:00
Lianmin Zheng	8207637029	Improve end-to-end throughput test and its coverage (#1039)	2024-08-11 18:27:33 -07:00
Lianmin Zheng	d84c5e70f7	Test the case when max_new_tokens is very large (#1038)	2024-08-11 16:41:03 -07:00