4 people ac2387279e Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988) ...

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

2025-03-03 00:12:04 -08:00

..

example_image.png

…

run_suite.py

…

test_anthropic_backend.py

…

test_bind_cache.py

…

test_choices.py

…

test_litellm_backend.py

Clean up unit tests (#1020)

2024-08-10 15:09:03 -07:00

test_openai_backend.py

…

test_srt_backend.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

test_tracing.py

…

test_vertexai_backend.py

…