Lianmin ZhengandHaotian Liu f719d9aebc Launch dp ranks in parallel (#2053) ...

Co-authored-by: Haotian Liu <6631389+haotian-liu@users.noreply.github.com>

2024-11-16 17:39:39 -08:00

..

data_parallel_controller.py

Launch dp ranks in parallel (#2053)

2024-11-16 17:39:39 -08:00

detokenizer_manager.py

Fix the default arguments of bench_offline_throughput.py & simplify detokenizer manager (#2042)

2024-11-15 05:02:44 -08:00

image_processor.py

Unify the model type checking (#1905)

2024-11-03 12:25:39 -08:00

io_struct.py

Fix a typo in io_struct.py (#2008)

2024-11-11 16:34:10 -08:00

schedule_batch.py

Fix illegal memory access in overlap mode & Use more fused triton kernels for building meta data (#2051)

2024-11-16 16:14:23 -08:00

schedule_policy.py

Simplify prometheus metrics (#1981)

2024-11-10 04:39:32 -08:00

scheduler.py

Support DP MLA (#1970)

2024-11-16 09:01:43 +00:00

tokenizer_manager.py

Simplify prometheus metrics (#1981)

2024-11-10 04:39:32 -08:00

tp_worker_overlap_thread.py

Fix illegal memory access in overlap mode & Use more fused triton kernels for building meta data (#2051)

2024-11-16 16:14:23 -08:00

tp_worker.py

Support DP MLA (#1970)

2024-11-16 09:01:43 +00:00