Chang Su a8ccacc8b8 [Frontend] Fix request length check and add option to disallow auto truncation in scheduler (#2876)

2025-01-16 14:51:19 -08:00

..

cache_controller.py

Cache controller for hierarchical caching (#2804)

2025-01-10 20:22:01 -08:00

configure_logging.py

Add a new api configure_logging to allow dumping the requests (#2875)

2025-01-13 14:24:00 -08:00

data_parallel_controller.py

Fix zmq binding (#2930)

2025-01-16 14:36:07 -08:00

detokenizer_manager.py

Fix zmq binding (#2930)

2025-01-16 14:36:07 -08:00

image_processor.py

Simplify tokenizer manager (#2254)

2024-11-29 02:18:51 -08:00

io_struct.py

Improve benchmark scripts and error message printing (#2922)

2025-01-16 06:24:31 -08:00

schedule_batch.py

Improve type annotation and styles (#2926)

2025-01-16 12:51:11 -08:00

schedule_policy.py

Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902)

2025-01-15 04:54:14 -08:00

scheduler.py

[Frontend] Fix request length check and add option to disallow auto truncation in scheduler (#2876)

2025-01-16 14:51:19 -08:00

session_controller.py

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

tokenizer_manager.py

[Frontend] Fix request length check and add option to disallow auto truncation in scheduler (#2876)

2025-01-16 14:51:19 -08:00

tp_worker_overlap_thread.py

Support multi-node DP attention (#2925)

2025-01-16 11:15:00 -08:00

tp_worker.py

Support multi-node DP attention (#2925)

2025-01-16 11:15:00 -08:00

utils.py

[Frontend] Fix request length check and add option to disallow auto truncation in scheduler (#2876)

2025-01-16 14:51:19 -08:00