Lianmin Zheng 114bbc8651 Use ipc instead of tcp in zmq (#1566)

2024-10-04 00:45:52 -07:00

..

detokenizer_manager.py

Use ipc instead of tcp in zmq (#1566)

2024-10-04 00:45:52 -07:00

image_processor.py

Process image in parallel (#1539)

2024-09-29 18:52:43 -07:00

io_struct.py

[Refactor] Simplify io_struct and tokenizer_manager (#1549)

2024-10-01 10:25:32 -07:00

schedule_batch.py

[Fix] Move ScheduleBatch out of SamplingInfo (#1556)

2024-10-02 17:18:04 -07:00

schedule_policy.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

scheduler.py

Use ipc instead of tcp in zmq (#1566)

2024-10-04 00:45:52 -07:00

tokenizer_manager.py

Use ipc instead of tcp in zmq (#1566)

2024-10-04 00:45:52 -07:00

tp_worker.py

Clean up batch data structures: Introducing ModelWorkerBatch (#1544)

2024-09-30 06:41:49 -07:00