Lianmin Zheng 69aa937aa5 Fix unit tests and type annotations (#1648)

2024-10-12 14:49:24 -07:00

..

data_parallel_controller.py

Add back data parallelism (#1635)

2024-10-11 07:22:48 -07:00

detokenizer_manager.py

Use ipc instead of tcp in zmq (#1566)

2024-10-04 00:45:52 -07:00

image_processor.py

Process image in parallel (#1539)

2024-09-29 18:52:43 -07:00

io_struct.py

Add the ability to enable and disable the Profiler via HTTP API. (#1626)

2024-10-11 02:34:25 -07:00

schedule_batch.py

Fix unit tests and type annotations (#1648)

2024-10-12 14:49:24 -07:00

schedule_policy.py

Fix chunked prefill condition (#1594)

2024-10-07 06:34:14 +00:00

scheduler.py

Fix unit tests and type annotations (#1648)

2024-10-12 14:49:24 -07:00

tokenizer_manager.py

Add the ability to enable and disable the Profiler via HTTP API. (#1626)

2024-10-11 02:34:25 -07:00

tp_worker.py

Clean up batch data structures: Introducing ModelWorkerBatch (#1544)

2024-09-30 06:41:49 -07:00