Ying Sheng 1cb4da5c5f [Fix] the issue of random order when input is a list (#1199)

2024-08-24 21:43:03 -07:00

..

controller_multi.py

[Minor] Improve logging and rename the health check endpoint name (#1180)

2024-08-21 19:24:36 -07:00

controller_single.py

[Minor] Improve logging and rename the health check endpoint name (#1180)

2024-08-21 19:24:36 -07:00

detokenizer_manager.py

[Minor] Improve logging and rename the health check endpoint name (#1180)

2024-08-21 19:24:36 -07:00

io_struct.py

Improve code style of sampler (#1168)

2024-08-21 16:48:24 -07:00

policy_scheduler.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

schedule_batch.py

Cleanup readme, llava examples, usage examples and nccl init (#1194)

2024-08-24 08:02:23 -07:00

tokenizer_manager.py

[Fix] the issue of random order when input is a list (#1199)

2024-08-24 21:43:03 -07:00

tp_worker.py

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)

2024-08-23 14:11:16 -07:00