Xinyuan Tong 8430bfe3e9 [Refactor] simplify multimodal data processing (#8107) ...

Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>

2025-07-20 21:43:09 -07:00

..

cache_controller.py

Hicache Storage Layer Prototype (#7704)

2025-07-18 15:20:19 +08:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

feat: add direct routing strategy to DP worker (#6884)

2025-06-09 11:44:05 -07:00

detokenizer_manager.py

Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225)

2025-05-12 14:33:38 -07:00

io_struct.py

Revert "[Feature] Simple Improve Health Check Mechanism for Production-Grade Stability" (#8181)

2025-07-19 22:41:30 -07:00

mm_utils.py

[Refactor] simplify multimodal data processing (#8107)

2025-07-20 21:43:09 -07:00

multimodal_processor.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

schedule_batch.py

[Refactor] simplify multimodal data processing (#8107)

2025-07-20 21:43:09 -07:00

schedule_policy.py

SWA Prefix Cache (#7367)

2025-07-13 12:31:07 -07:00

scheduler_output_processor_mixin.py

feat: add tp_rank, pp_rank and dp_rank labels for scheduler metrics (#7597)

2025-07-16 17:55:59 -07:00

scheduler.py

Revert "[Feature] Simple Improve Health Check Mechanism for Production-Grade Stability" (#8181)

2025-07-19 22:41:30 -07:00

session_controller.py

Move mem_fraction_static adjustment for multimodal models to server_args.py & Fix session control & Other cleanups (#7748)

2025-07-04 16:33:33 -07:00

template_manager.py

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

tokenizer_manager.py

Revert "[Feature] Simple Improve Health Check Mechanism for Production-Grade Stability" (#8181)

2025-07-19 22:41:30 -07:00

tp_worker_overlap_thread.py

SWA Prefix Cache (#7367)

2025-07-13 12:31:07 -07:00

tp_worker.py

Revert "Fix different device type adjustment in PP" (#8141)

2025-07-18 01:12:11 -07:00

utils.py

Correctly abort the failed grammar requests & Improve the handling of abort (#6803)

2025-06-01 19:00:07 -07:00