13 Commits

Include renames

Author	SHA1	Message	Date
Ke Bao	68f8b60d22	Fix chunked prefill condition (#1594)	2024-10-07 06:34:14 +00:00
Lianmin Zheng	1acccb364a	Fix oom issues with fp8 for llama (#1454)	2024-09-18 03:45:19 -07:00
Lianmin Zheng	9ba1f09760	[Fix] Fix logprob and normalized_logprob (#1428)	2024-09-15 06:36:06 -07:00
Mingyi	158e8f1e2d	improve the threshold and ports in tests (#1215)	2024-08-25 19:02:08 -07:00
Liangsheng Yin	3694f8f996	Mixed style of chunked prefill (#1013)	2024-08-16 09:13:00 +00:00
Yineng Zhang	f7fb68d292	ci: add moe test (#1053)	2024-08-13 18:43:23 +10:00
Lianmin Zheng	41598e0d8e	Add longer accuracy test on CI (#1049)	2024-08-12 09:21:38 +00:00
Lianmin Zheng	8207637029	Improve end-to-end throughput test and its coverage (#1039)	2024-08-11 18:27:33 -07:00
Lianmin Zheng	54fb1c80c0	Clean up unit tests (#1020)	2024-08-10 15:09:03 -07:00
Yineng Zhang	c31f084c71	chore: update vllm to 0.5.4 (#966)	2024-08-07 21:15:41 +10:00
Ying Sheng	3bc99e6fe4	Test openai vision api (#925)	2024-08-05 13:51:55 +10:00
Liangsheng Yin	bb66cc4c52	Fix CI && python3.8 compatible (#920)	2024-08-04 16:02:05 -07:00
Ying Sheng	995af5a54b	Improve the structure of CI (#911)	2024-08-03 23:09:21 -07:00