parasol-aserandYing Sheng 23950056f0 support speculative execution for openai API (#48) ...

Co-authored-by: Ying Sheng <sqy1415@gmail.com>

2024-01-25 01:57:06 -08:00

..

model

Fix the possible bug of decode out of memory (#36)

2024-01-19 11:01:15 -08:00

test_fast_forward.py

support speculative execution for openai API (#48)

2024-01-25 01:57:06 -08:00

test_flashinfer.py

release initial code

2024-01-08 04:37:50 +00:00

test_httpserver_concurrent.py

release initial code

2024-01-08 04:37:50 +00:00

test_httpserver_decode_stream.py

Support stream=True in v1/completions (#49)

2024-01-18 17:00:56 -08:00

test_httpserver_decode.py

Return logprob for choices (#87)

2024-01-23 05:07:30 -08:00

test_httpserver_llava.py

release initial code

2024-01-08 04:37:50 +00:00

test_httpserver_reuse.py

release initial code

2024-01-08 04:37:50 +00:00

test_openai_server.py

Support v1/chat/completions (#50)

2024-01-18 23:43:09 -08:00

test_robust.py

support speculative execution for openai API (#48)

2024-01-25 01:57:06 -08:00