Lianmin Zheng fa7a696d04 Fix max_new_tokens for limited memory

2024-01-24 10:44:32 +00:00

..

router

Fix max_new_tokens for limited memory

2024-01-24 10:44:32 +00:00

detokenizer_manager.py

Fix after QWen support (#82)

2024-01-22 21:17:05 -08:00

io_struct.py

Llava-hd Support (#92)

2024-01-24 01:51:21 -08:00

openai_protocol.py

Support v1/chat/completions (#50)

2024-01-18 23:43:09 -08:00

tokenizer_manager.py

Fix llava & Fix multiprocessing

2024-01-24 10:35:31 +00:00