Liangsheng Yin b6b4094621 Fix filter_batch function call (#1681)

2024-10-15 22:59:26 -07:00

..

data_parallel_controller.py

Add back data parallelism (#1635)

2024-10-11 07:22:48 -07:00

detokenizer_manager.py

[Minor] Rename no_eos_trim to no_stop_trim (#1661)

2024-10-13 20:30:03 -07:00

image_processor.py

Process image in parallel (#1539)

2024-09-29 18:52:43 -07:00

io_struct.py

[Minor] Rename no_eos_trim to no_stop_trim (#1661)

2024-10-13 20:30:03 -07:00

schedule_batch.py

Fix filter_batch function call (#1681)

2024-10-15 22:59:26 -07:00

schedule_policy.py

[Minor] Improve style (#1666)

2024-10-14 05:25:00 -07:00

scheduler.py

Fix memory leak during abort (#1674)

2024-10-15 08:15:08 -07:00

tokenizer_manager.py

Add the ability to enable and disable the Profiler via HTTP API. (#1626)

2024-10-11 02:34:25 -07:00

tp_worker.py

Simplify the event loop and expose --num-continuous-decode-steps as an argument (#1652)

2024-10-12 21:35:30 -07:00