Xuchun Shang c01b2ee094 [PP] Refactor PP to async mode (#11852) ...

Signed-off-by: Shangming Cai <csmthu@gmail.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: bluecoffee8 <jasperli2002@gmail.com>
Co-authored-by: zhangxiaolei123456 <zhangxiaolei.666@bytedance.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>

2025-12-12 12:54:16 +08:00

..

async_dynamic_batch_tokenizer.py

[Performance] Dynamic Batch Tokenizer (#9382)

2025-09-14 01:56:04 +08:00

async_mm_data_processor.py

[VLM] Optimize async mm data process mechanism (#12066)

2025-11-01 01:24:53 +08:00

cache_controller.py

[BugFix] fix prefixcache performance and accuracy on ascend (#13573)

2025-12-08 02:16:20 +08:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

[Auto Sync] Update data_parallel_controller.py, detokenizer... (20251209) (#14759)

2025-12-09 18:38:38 -08:00

detokenizer_manager.py

[Auto Sync] Update data_parallel_controller.py, detokenizer... (20251209) (#14759)

2025-12-09 18:38:38 -08:00

disagg_service.py

[1/2] Refactor multi-tokenizer manager (#10074)

2025-09-07 19:13:34 +08:00

io_struct.py

[refactor] Update reasoning parameter to require_reasoning (#14922)

2025-12-11 16:55:59 -08:00

mm_utils.py

[feat] use cachebuffer to store mm feature to speedup hash (#14386)

2025-12-08 10:35:20 +08:00

multi_tokenizer_mixin.py

refine stdout logging codes (#13015)

2025-11-12 00:16:14 +08:00

multimodal_processor.py

feat: support external custom models (#13429)

2025-11-20 11:16:58 +08:00

overlap_utils.py

[Fix]: Further fix the buffer len of future map (#13916)

2025-11-25 18:09:28 +08:00

request_metrics_exporter.py

Add RequestMetricsExporter utility to export request-level metrics (#10973)

2025-11-12 16:33:37 -08:00

schedule_batch.py

[refactor] Update reasoning parameter to require_reasoning (#14922)

2025-12-11 16:55:59 -08:00

schedule_policy.py

Enable RadixCache for Mamba2 models (#13584)

2025-12-05 18:23:58 +08:00

scheduler_dp_attn_mixin.py

[bugfix] Fix prefill tbo disabled when --deepep-mode=auto (#14333)

2025-12-03 01:20:33 -08:00

scheduler_input_blocker.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

scheduler_metrics_mixin.py

Enable RadixCache for Mamba2 models (#13584)

2025-12-05 18:23:58 +08:00

scheduler_output_processor_mixin.py

feat: Naive support Spec V2 + Constrained Decoding (#13425)

2025-11-27 20:31:46 +08:00

scheduler_pp_mixin.py

[PP] Refactor PP to async mode (#11852)

2025-12-12 12:54:16 +08:00

scheduler_profiler_mixin.py

Tiny call cudaProfilerStart only on first rank in node (#14211)

2025-12-01 18:18:45 +08:00

scheduler_recv_skipper.py

[Feat]Add scheduler recv skipper weights to environment configuration (#13855)

2025-11-27 18:16:11 +08:00

scheduler_runtime_checker_mixin.py

[Bugfix] Fix environ error in scheduler_runtime_checker_mixin.py (#14461)

2025-12-09 20:33:41 +08:00

scheduler_update_weights_mixin.py

Support sanity checking weight consistency especially for RL (#13854)

2025-11-27 20:25:12 +08:00

scheduler.py

[PP] Refactor PP to async mode (#11852)

2025-12-12 12:54:16 +08:00

session_controller.py

[Test] Fix session control test (#12336)

2025-10-29 18:28:04 +08:00

template_manager.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

tokenizer_communicator_mixin.py

[fix] Fix issues for in-flight weight updates (#14064)

2025-12-09 18:12:19 -08:00

tokenizer_manager_multiitem_mixin.py

move multi-item scoring functions in tokenizer manager into a separate file (#14740)

2025-12-09 14:47:06 -08:00

tokenizer_manager.py

[refactor] Update reasoning parameter to require_reasoning (#14922)

2025-12-11 16:55:59 -08:00

tp_worker.py

[PP] Refactor PP to async mode (#11852)

2025-12-12 12:54:16 +08:00

utils.py

Fix overlap scheduler not take effect when outputing logprobs (#14096)

2025-11-28 18:15:56 +08:00