Yuhao Yao 77512ae0d7 [bugfix] Fix prefill tbo disabled when --deepep-mode=auto (#14333) ...

Co-authored-by: Cheng Wan <wan4ch@gmail.com>

2025-12-03 01:20:33 -08:00

..

async_dynamic_batch_tokenizer.py

[Performance] Dynamic Batch Tokenizer (#9382)

2025-09-14 01:56:04 +08:00

async_mm_data_processor.py

[VLM] Optimize async mm data process mechanism (#12066)

2025-11-01 01:24:53 +08:00

cache_controller.py

[HiCache] Critical fix to host memory double free (#13501)

2025-11-18 01:34:23 -08:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

Support numactl bind for CPU and memory before process starts (#14156)

2025-11-30 17:00:33 +08:00

detokenizer_manager.py

[Fix] Register custom ops only if they exist (#13321)

2025-11-15 17:48:17 -08:00

disagg_service.py

[1/2] Refactor multi-tokenizer manager (#10074)

2025-09-07 19:13:34 +08:00

io_struct.py

Support profiling only prefill or decode without the other (#14182)

2025-12-01 14:46:30 +08:00

mm_utils.py

Clean up imports and move files (#14317)

2025-12-02 16:31:54 -08:00

multi_tokenizer_mixin.py

refine stdout logging codes (#13015)

2025-11-12 00:16:14 +08:00

multimodal_processor.py

feat: support external custom models (#13429)

2025-11-20 11:16:58 +08:00

overlap_utils.py

[Fix]: Further fix the buffer len of future map (#13916)

2025-11-25 18:09:28 +08:00

request_metrics_exporter.py

Add RequestMetricsExporter utility to export request-level metrics (#10973)

2025-11-12 16:33:37 -08:00

schedule_batch.py

[Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)

2025-12-01 23:24:24 -08:00

schedule_policy.py

[Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)

2025-12-01 23:24:24 -08:00

scheduler_dp_attn_mixin.py

[bugfix] Fix prefill tbo disabled when --deepep-mode=auto (#14333)

2025-12-03 01:20:33 -08:00

scheduler_input_blocker.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

scheduler_metrics_mixin.py

[Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)

2025-12-01 23:24:24 -08:00

scheduler_output_processor_mixin.py

feat: Naive support Spec V2 + Constrained Decoding (#13425)

2025-11-27 20:31:46 +08:00

scheduler_pp_mixin.py

[PP] put pp assert in model runner (#12934)

2025-11-10 14:58:19 +08:00

scheduler_profiler_mixin.py

Tiny call cudaProfilerStart only on first rank in node (#14211)

2025-12-01 18:18:45 +08:00

scheduler_recv_skipper.py

[Feat]Add scheduler recv skipper weights to environment configuration (#13855)

2025-11-27 18:16:11 +08:00

scheduler_runtime_checker_mixin.py

[Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)

2025-12-01 23:24:24 -08:00

scheduler_update_weights_mixin.py

Support sanity checking weight consistency especially for RL (#13854)

2025-11-27 20:25:12 +08:00

scheduler.py

[Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)

2025-12-01 23:24:24 -08:00

session_controller.py

[Test] Fix session control test (#12336)

2025-10-29 18:28:04 +08:00

template_manager.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

tokenizer_communicator_mixin.py

Support profiling only prefill or decode without the other (#14182)

2025-12-01 14:46:30 +08:00

tokenizer_manager.py

Fix condition for streaming output_ids in tokenizer manager (#13759)

2025-11-29 13:56:15 -08:00

tp_worker.py

[Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)

2025-12-01 23:24:24 -08:00

utils.py

Fix overlap scheduler not take effect when outputing logprobs (#14096)

2025-11-28 18:15:56 +08:00