Commit Graph
6 Commits
Author SHA1 Message Date
parasol-aserandYing Sheng 23950056f0 support speculative execution for openai API (#48)
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
2024-01-25 01:57:06 -08:00
Lianmin Zheng 9a16fea012 Return logprob for choices (#87) 2024-01-23 05:07:30 -08:00
Ying Sheng 3f5c2f4c4a Add an async example (#37) 2024-01-21 15:17:30 -08:00
Lianmin Zheng b240f75100 Add a parallel sampling case (#34) 2024-01-18 06:29:43 +00:00
Lianmin Zheng c4707f1bb5 Improve docs (#17) 2024-01-16 19:53:55 -08:00
Lianmin Zheng 46b7ea7c85 Improve Readme (#10) 2024-01-16 05:53:06 +00:00