Lianmin Zheng 2369e88209 [minor] Clean up unused imports (#2122) ...

Co-authored-by: rinrin32 <rinrin.int@gmail.com>

2024-11-22 01:50:42 -08:00

..

configs

support internlm2-reward (#1994)

2024-11-11 15:09:58 -08:00

constrained

Enable overlap by default (#2067)

2024-11-19 22:07:58 -08:00

layers

ROCm: Fix MoE padding for none FP8 cases (#2111)

2024-11-21 12:23:21 -08:00

lora

Update vllm to 0.6.3 (#1711) (#1720)

2024-10-19 20:45:41 -07:00

managers

Fix #2037 - Context length check does not take into out pad tokens for visual models (#2106)

2024-11-21 19:05:41 -08:00

mem_cache

Update docs (#1839)

2024-10-30 02:49:08 -07:00

metrics

Simplify prometheus metrics (#1981)

2024-11-10 04:39:32 -08:00

model_executor

Enable overlap scheduler by default for the triton attention backend (#2105)

2024-11-20 02:58:35 -08:00

models

Rename sglang.bench_latency to sglang.bench_one_batch (#2118)

2024-11-21 20:07:48 -08:00

openai_api

Fix: incorrect top_logprobs in chat completion (#2088)

2024-11-19 12:21:36 +00:00

sampling

Enable overlap by default (#2067)

2024-11-19 22:07:58 -08:00

conversation.py

Llama3.2 vision model support (#1551)

2024-10-21 15:01:21 -07:00

hf_transformers_utils.py

Let reward model take text inputs instead of message lists (#1907)

2024-11-03 13:27:12 -08:00

mm_utils.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

model_parallel.py

[minor] Clean up unused imports (#2122)

2024-11-22 01:50:42 -08:00

server_args.py

[router] add base_gpu_id server args & merged radix tree python reference (#2115)

2024-11-21 17:13:33 -08:00

server.py

[router] add base_gpu_id server args & merged radix tree python reference (#2115)

2024-11-21 17:13:33 -08:00

utils.py

feat: update torch 2.5.1 (#2069)

2024-11-18 21:29:13 +08:00