Lianmin Zheng e12358dc91 Simplify the usage of device (#1734)

2024-10-20 18:17:41 -07:00

..

configs

Support qwen2 vl model (#1721)

2024-10-19 21:44:38 -07:00

constrained

[FIX] Catch syntax error of Regex Guide to avoid crash (#1521)

2024-09-28 12:42:06 -07:00

layers

Support qwen2 vl model (#1721)

2024-10-19 21:44:38 -07:00

lora

Update vllm to 0.6.3 (#1711) (#1720)

2024-10-19 20:45:41 -07:00

managers

Simplify the usage of device (#1734)

2024-10-20 18:17:41 -07:00

mem_cache

Split the overlapped version of TpModelWorkerClient into a separate file (#1726)

2024-10-20 00:29:29 -07:00

model_executor

[Bugfix] qwen2vl forward_extend (#1727)

2024-10-20 02:38:35 -07:00

models

Support qwen2 vl model (#1721)

2024-10-19 21:44:38 -07:00

openai_api

Add matched_stop token or str to distinguish between eos or stop str finish_reason generation (#1684)

2024-10-17 18:06:52 +00:00

sampling

Simplify the usage of device (#1734)

2024-10-20 18:17:41 -07:00

conversation.py

Support qwen2 vl model (#1721)

2024-10-19 21:44:38 -07:00

hf_transformers_utils.py

Support qwen2 vl model (#1721)

2024-10-19 21:44:38 -07:00

mm_utils.py

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)

2024-08-23 14:11:16 -07:00

server_args.py

Simplify the nan detection and greedy check in sampler (#1709)

2024-10-18 20:21:24 -07:00

server.py

Fix the race condition in overlap mode (#1712)

2024-10-19 06:50:56 -07:00

utils.py

Support qwen2 vl model (#1721)

2024-10-19 21:44:38 -07:00