Byron Hsu 438526a814 Refactor tokenizer manager (#1846)

2024-10-30 21:32:18 -07:00

..

configs

check user-specified model_max_len with hf derived max_model_len (#1778)

2024-10-24 12:40:36 -07:00

constrained

[Performance] Support both xgrammar and outlines for constrained decoding (#1752)

2024-10-25 21:47:02 +00:00

layers

[Performance, Triton Kernel Args] _decode_grouped_softmax_reducev_fwd… (#1845)

2024-10-30 17:33:36 -07:00

lora

Update vllm to 0.6.3 (#1711) (#1720)

2024-10-19 20:45:41 -07:00

managers

Refactor tokenizer manager (#1846)

2024-10-30 21:32:18 -07:00

mem_cache

Update docs (#1839)

2024-10-30 02:49:08 -07:00

model_executor

Update docs (#1839)

2024-10-30 02:49:08 -07:00

models

Add new model: Gpt2 (#1833)

2024-10-29 17:52:33 -07:00

openai_api

Add matched_stop token or str to distinguish between eos or stop str finish_reason generation (#1684)

2024-10-17 18:06:52 +00:00

sampling

[Performance] Support both xgrammar and outlines for constrained decoding (#1752)

2024-10-25 21:47:02 +00:00

conversation.py

Llama3.2 vision model support (#1551)

2024-10-21 15:01:21 -07:00

hf_transformers_utils.py

move max_position_embeddings to the last (#1799)

2024-10-25 19:30:50 -07:00

mm_utils.py

[Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)

2024-08-23 14:11:16 -07:00

server_args.py

Make decode log interval configurable (#1847)

2024-10-30 19:59:20 -07:00

server.py

Update docs (#1839)

2024-10-30 02:49:08 -07:00

utils.py

Add a watch dog thread (#1816)

2024-10-27 02:00:50 -07:00