Lianmin Zheng 159cc741e4 Make the server random by default (#493)

2024-05-31 23:33:34 -07:00

..

constrained

Improve logging & add logit cap (#471)

2024-05-24 03:48:53 -07:00

layers

Support data parallelism (static) (#480)

2024-05-27 21:24:10 -07:00

managers

Revert "Make the server random by default" (#492)

2024-05-31 12:00:21 -07:00

models

Support data parallelism (static) (#480)

2024-05-27 21:24:10 -07:00

conversation.py

Minor fix for the import path (#428)

2024-05-12 05:10:35 -07:00

flush_cache.py

Format code (#441)

2024-05-14 22:40:46 +08:00

hf_transformers_utils.py

Improve benchmark scripts & rename some scripts (#477)

2024-05-26 12:51:45 -07:00

memory_pool.py

Minor: style improvement of radix_cache and memory_pool (#395)

2024-04-26 01:01:36 +08:00

mm_utils.py

Handle grayscale images in expand2square (#97)

2024-01-24 16:23:11 -08:00

model_config.py

Use model loader from vllm (#459)

2024-05-21 09:13:37 -07:00

openai_api_adapter.py

Abort disconnected requests (#457)

2024-05-20 18:41:21 -07:00

openai_protocol.py

Abort disconnected requests (#457)

2024-05-20 18:41:21 -07:00

sampling_params.py

SamplingParams add "spaces_between_special_tokens" argument (#392)

2024-04-30 16:17:12 -07:00

server_args.py

Make the server random by default (#493)

2024-05-31 23:33:34 -07:00

server.py

Support data parallelism (static) (#480)

2024-05-27 21:24:10 -07:00

utils.py

Support data parallelism (static) (#480)

2024-05-27 21:24:10 -07:00