Lianmin Zheng f64eae3a29 [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308)

2024-09-02 21:44:45 -07:00

..

configs

EXAONE 3.0 Model Support (#1258)

2024-08-30 08:08:28 +00:00

constrained

Allow new lines during JSON generation (#1277)

2024-09-01 03:42:29 -07:00

layers

Fix bugs in sampler with CUDA graph / torch.compile (#1306)

2024-09-02 23:18:48 +00:00

managers

[Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308)

2024-09-02 21:44:45 -07:00

mem_cache

[Feature] Support fp8 e5m2 kv cache with flashinfer (#1204)

2024-08-25 17:38:11 -07:00

model_executor

[Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308)

2024-09-02 21:44:45 -07:00

models

[Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308)

2024-09-02 21:44:45 -07:00

openai_api

Allow more flexible assistant and system response (#1256)

2024-08-30 11:51:44 -07:00

sampling

Fix bugs in sampler with CUDA graph / torch.compile (#1306)

2024-09-02 23:18:48 +00:00

conversation.py

Allow more flexible assistant and system response (#1256)

2024-08-30 11:51:44 -07:00

hf_transformers_utils.py

[Chore] Rename model_overide_args to model_override_args (#1284)

2024-09-01 03:14:56 -07:00

mm_utils.py

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)

2024-08-23 14:11:16 -07:00

model_config.py

[Chore] Rename model_overide_args to model_override_args (#1284)

2024-09-01 03:14:56 -07:00

server_args.py

[Feature] Support fp8 e5m2 kv cache with flashinfer (#1204)

2024-08-25 17:38:11 -07:00

server.py

[Chore] Rename model_overide_args to model_override_args (#1284)

2024-09-01 03:14:56 -07:00

utils.py

fix: multimodal_config in monkey_patch_vllm_dummy_weight_loader (#1260)

2024-08-30 16:43:41 +10:00