Shi Shuai 35bdb48557 [Feature] Get Token IDs with Engine.generate() (#2636) ...

Co-authored-by: Chayenne <zhaochen20@outlook.com>

2024-12-29 12:28:27 -08:00

..

data_parallel_controller.py

Crash the server correctly during error (#2231)

2024-11-28 00:22:39 -08:00

detokenizer_manager.py

[Feature] Get Token IDs with Engine.generate() (#2636)

2024-12-29 12:28:27 -08:00

image_processor.py

Simplify tokenizer manager (#2254)

2024-11-29 02:18:51 -08:00

io_struct.py

[Feature] Get Token IDs with Engine.generate() (#2636)

2024-12-29 12:28:27 -08:00

schedule_batch.py

Clean up wrapper in flashinfer backend (#2638)

2024-12-29 00:45:57 -08:00

schedule_policy.py

Fix cache hit rate when chunked prefill (#2555)

2024-12-26 03:14:28 -08:00

scheduler.py

[Feature] Get Token IDs with Engine.generate() (#2636)

2024-12-29 12:28:27 -08:00

session_controller.py

[Session] Update session control interface (#2635)

2024-12-29 02:10:27 -08:00

tokenizer_manager.py

[Feature] Get Token IDs with Engine.generate() (#2636)

2024-12-29 12:28:27 -08:00

tp_worker_overlap_thread.py

Add update_weights_from_tensor (#2631)

2024-12-28 13:30:27 -08:00

tp_worker.py

Add update_weights_from_tensor (#2631)

2024-12-28 13:30:27 -08:00