Ying Sheng e4780cf839 [API, Feature] Support response prefill for openai API (#1490)

2024-09-22 06:46:17 -07:00

..

llava_onevision

fix: creat new dict everytime for putting new frame (#1464)

2024-09-19 01:31:48 -07:00

async_io_api.py

Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

lora.py

[Feature] Support LoRA path renaming and add LoRA serving benchmarks (#1433)

2024-09-15 12:46:04 -07:00

openai_batch_chat.py

Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

openai_batch_complete.py

Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

openai_chat_with_response_prefill.py

[API, Feature] Support response prefill for openai API (#1490)

2024-09-22 06:46:17 -07:00