ybyang 03c039c48e [OAI] patch origin request_id logic (#7508)

2025-06-24 20:09:38 -07:00

..

eplb_algorithms

Support picking variants of EPLB algorithms (#6728)

2025-05-29 08:12:01 -07:00

multimodal_processors

Support VILA models (#6106)

2025-06-11 11:47:25 -07:00

cache_controller.py

[minor] simplify the TokenToKVPoolAllocator (#7414)

2025-06-22 12:37:18 +08:00

configure_logging.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

data_parallel_controller.py

feat: add direct routing strategy to DP worker (#6884)

2025-06-09 11:44:05 -07:00

detokenizer_manager.py

Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225)

2025-05-12 14:33:38 -07:00

eplb_manager.py

Support layerwise rebalancing experts (#6851)

2025-06-05 00:05:52 -07:00

expert_distribution.py

Support both approximate and exact expert distribution collection (#6964)

2025-06-09 20:56:17 -07:00

expert_location_dispatch.py

Tiny update error hints (#6846)

2025-06-05 00:05:28 -07:00

expert_location.py

Support layerwise rebalancing experts (#6851)

2025-06-05 00:05:52 -07:00

io_struct.py

[OAI] patch origin request_id logic (#7508)

2025-06-24 20:09:38 -07:00

mm_utils.py

Refactor vlm embedding routine to use precomputed feature (#6543)

2025-05-24 18:39:21 -07:00

multimodal_processor.py

Clean up imports (#5467)

2025-04-16 15:26:49 -07:00

schedule_batch.py

Support weight loading without mmap (#7469)

2025-06-23 15:13:59 -07:00

schedule_policy.py

Fix prefill OOM due to wrong token calculation when page > 1 (#7397)

2025-06-24 02:12:29 +08:00

scheduler_output_processor_mixin.py

Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225)

2025-05-12 14:33:38 -07:00

scheduler.py

Perormance: Enable cuda graph for dp idle batch (#7269)

2025-06-23 17:34:13 -07:00

session_controller.py

Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136)

2025-05-16 12:26:15 -07:00

template_manager.py

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

tokenizer_manager.py

Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457)

2025-06-23 06:20:39 -07:00

tp_worker_overlap_thread.py

Upstreaming hicache bug fixes (#7267)

2025-06-17 17:44:57 -07:00

tp_worker.py

[minor] simplify the TokenToKVPoolAllocator (#7414)

2025-06-22 12:37:18 +08:00

utils.py

Correctly abort the failed grammar requests & Improve the handling of abort (#6803)

2025-06-01 19:00:07 -07:00