Liangsheng Yin 05bea6883c Fix some online scheduling delay (#1345)

2024-09-07 20:46:27 -07:00

..

controller_multi.py

[Chore] Rename model_overide_args to model_override_args (#1284)

2024-09-01 03:14:56 -07:00

controller_single.py

[Chore] Rename model_overide_args to model_override_args (#1284)

2024-09-01 03:14:56 -07:00

detokenizer_manager.py

[Minor] Improve the function organization in TokenizerManager & improve loggers (#1208)

2024-08-25 14:46:34 -07:00

io_struct.py

fix data racing due to mutable reference using deepcopy (#1255)

2024-08-28 18:57:54 -07:00

policy_scheduler.py

Fix some online scheduling delay (#1345)

2024-09-07 20:46:27 -07:00

schedule_batch.py

[Fix] Fix select by ensuring each request has at least one token (#1318)

2024-09-03 06:31:45 -07:00

tokenizer_manager.py

[Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308)

2024-09-02 21:44:45 -07:00

tp_worker.py

Fix some online scheduling delay (#1345)

2024-09-07 20:46:27 -07:00