Lianmin Zheng ebbc42d989 Optimize broadcast & Reorg code (#1598)

2024-10-07 13:19:23 -07:00

..

detokenizer_manager.py

Use ipc instead of tcp in zmq (#1566)

2024-10-04 00:45:52 -07:00

image_processor.py

Process image in parallel (#1539)

2024-09-29 18:52:43 -07:00

io_struct.py

Fix runtime.generate when sampling param is not passed (#1582)

2024-10-05 17:59:05 -07:00

schedule_batch.py

Fix modality for image inputs (#1592)

2024-10-06 15:43:32 -07:00

schedule_policy.py

Fix chunked prefill condition (#1594)

2024-10-07 06:34:14 +00:00

scheduler.py

Optimize broadcast & Reorg code (#1598)

2024-10-07 13:19:23 -07:00

tokenizer_manager.py

[Fix] Fix the case where prompt_len = 0 (#1593)

2024-10-06 20:30:02 -07:00

tp_worker.py

Clean up batch data structures: Introducing ModelWorkerBatch (#1544)

2024-09-30 06:41:49 -07:00