10 Commits

Include renames

Author	SHA1	Message	Date
Lianmin Zheng	9ba1f09760	[Fix] Fix logprob and normalized_logprob (#1428)	2024-09-15 06:36:06 -07:00
Mingyi	158e8f1e2d	improve the threshold and ports in tests (#1215)	2024-08-25 19:02:08 -07:00
Juwan Yoo	d8476818ef	feat: allow streaming for multi-prompt and/or parallel sampling (#1134)	2024-08-20 08:06:55 -07:00
Yineng Zhang	f7fb68d292	ci: add moe test (#1053)	2024-08-13 18:43:23 +10:00
Lianmin Zheng	8207637029	Improve end-to-end throughput test and its coverage (#1039)	2024-08-11 18:27:33 -07:00
Lianmin Zheng	54fb1c80c0	Clean up unit tests (#1020)	2024-08-10 15:09:03 -07:00
Yineng Zhang	c31f084c71	chore: update vllm to 0.5.4 (#966)	2024-08-07 21:15:41 +10:00
Ying Sheng	3bc99e6fe4	Test openai vision api (#925)	2024-08-05 13:51:55 +10:00
Liangsheng Yin	bb66cc4c52	Fix CI && python3.8 compatible (#920)	2024-08-04 16:02:05 -07:00
Ying Sheng	ae7ee01a8e	Add accuracy test to CI: MMLU (#882)	2024-08-01 21:20:17 -07:00