Commit Graph
6 Commits
Author SHA1 Message Date
Liangsheng Yin 3842eba5fa Logprobs Refractor (#331) 2024-03-28 14:34:49 +08:00
Lianmin Zheng 23f05005fd Format code & move functions (#155) 2024-02-06 13:27:46 -08:00
Cody Yu a7334aeea1 Support decode token logprobs (#130) 2024-02-06 12:24:55 -08:00
Lianmin Zheng 6f560c761b Improve the control of streaming and improve the first token latency in streaming (#117) 2024-01-29 17:05:42 -08:00
Cody Yu 61d4c93962 Support stream=True in v1/completions (#49) 2024-01-18 17:00:56 -08:00
22085081bb release initial code
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
2024-01-08 04:37:50 +00:00