Baizhou Zhang fc91d08a8f [Revision] Add fast decode plan for flashinfer mla (#4012)

2025-03-05 11:20:41 -08:00

..

cache_controller.py

[Eagle] Refactor eagle speculative decoding (#3986)

2025-03-05 08:06:07 -08:00

configure_logging.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

data_parallel_controller.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

detokenizer_manager.py

[Minor] more code cleanup (#4077)

2025-03-04 21:23:47 -08:00

image_processor.py

Revert "Rename TokenizerManager to StdOrchestrator" (#3828)

2025-02-24 14:47:59 -08:00

io_struct.py

[Minor] more code cleanup (#4077)

2025-03-04 21:23:47 -08:00

schedule_batch.py

[Revision] Add fast decode plan for flashinfer mla (#4012)

2025-03-05 11:20:41 -08:00

schedule_policy.py

[Eagle] Refactor eagle speculative decoding (#3986)

2025-03-05 08:06:07 -08:00

scheduler.py

[Eagle] Refactor eagle speculative decoding (#3986)

2025-03-05 08:06:07 -08:00

session_controller.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

tokenizer_manager.py

[Eagle] Refactor eagle speculative decoding (#3986)

2025-03-05 08:06:07 -08:00

tp_worker_overlap_thread.py

[Eagle] Refactor eagle speculative decoding (#3986)

2025-03-05 08:06:07 -08:00

tp_worker.py

[Eagle] Refactor eagle speculative decoding (#3986)

2025-03-05 08:06:07 -08:00

utils.py

Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956)

2025-01-18 19:37:30 -08:00