Lianmin Zheng 7906d1d298 Remove the unused write_with_records (#2972)

2025-01-18 20:20:23 -08:00

..

cache_controller.py

Cache controller for hierarchical caching (#2804)

2025-01-10 20:22:01 -08:00

configure_logging.py

Add a new api configure_logging to allow dumping the requests (#2875)

2025-01-13 14:24:00 -08:00

data_parallel_controller.py

[Feature] Support minicpmv v2.6 (#2785)

2025-01-18 14:14:19 -08:00

detokenizer_manager.py

Fix zmq binding (#2930)

2025-01-16 14:36:07 -08:00

image_processor.py

[Feature] Support minicpmv v2.6 (#2785)

2025-01-18 14:14:19 -08:00

io_struct.py

Improve benchmark scripts and error message printing (#2922)

2025-01-16 06:24:31 -08:00

schedule_batch.py

Remove the unused write_with_records (#2972)

2025-01-18 20:20:23 -08:00

schedule_policy.py

Query remaining memory dynamically for PrefillAdder (#2941)

2025-01-17 20:20:26 -08:00

scheduler.py

Refactor to add TypeBasedDispatcher to simplify dispatching (#2958)

2025-01-18 20:13:27 -08:00

session_controller.py

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

tokenizer_manager.py

Refactor to add TypeBasedDispatcher to simplify dispatching (#2958)

2025-01-18 20:13:27 -08:00

tp_worker_overlap_thread.py

Enable CPU device on SGLang (#2806)

2025-01-16 21:22:53 -08:00

tp_worker.py

Support multi-node DP attention (#2925)

2025-01-16 11:15:00 -08:00

utils.py

Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956)

2025-01-18 19:37:30 -08:00