Cheng Wan 2b461c15b4 Update logprob_start_len handling in scheduler (#16240)

2025-12-31 14:11:24 -08:00

..

async_dynamic_batch_tokenizer.py

[Performance] Dynamic Batch Tokenizer (#9382)

2025-09-14 01:56:04 +08:00

async_mm_data_processor.py

[VLM] Optimize async mm data process mechanism (#12066)

2025-11-01 01:24:53 +08:00

cache_controller.py

[HiCache] Fix deadlock when creating new group (#15805)

2025-12-29 17:13:04 +08:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

dp-attention: add follow_bootstrap_room + auto load-balance; drop decode_round_robin (#16110)

2025-12-30 22:33:06 +08:00

detokenizer_manager.py

Fix metrics (#15998)

2025-12-28 05:03:49 -08:00

disagg_service.py

[1/2] Refactor multi-tokenizer manager (#10074)

2025-09-07 19:13:34 +08:00

io_struct.py

DP: support piggyback server load report (#11469)

2025-12-25 11:35:05 +08:00

mm_utils.py

Fix OOM by offloading multimodal features to CPU after embedding (#16018)

2025-12-31 23:02:34 +08:00

multi_tokenizer_mixin.py

[Feature] Enable return routed experts (#12162)

2025-12-21 15:16:43 +08:00

multimodal_processor.py

feat: support external custom models (#13429)

2025-11-20 11:16:58 +08:00

overlap_utils.py

feat(SpecEagleV2): add standalone_worker_v2 (#12625)

2025-12-30 17:55:04 +08:00

request_metrics_exporter.py

[Auto Sync] Update request_metrics_exporter.py (20251230) (#16183)

2025-12-30 11:09:41 -08:00

schedule_batch.py

feat(SpecEagleV2): add standalone_worker_v2 (#12625)

2025-12-30 17:55:04 +08:00

schedule_policy.py

Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105)

2025-12-30 12:38:33 +08:00

scheduler_dp_attn_mixin.py

Move log_prefill_stats_late to correct location in PP mode (#15946)

2025-12-31 12:00:24 +08:00

scheduler_enhancer.py

[scheduler] enhance scheduler in dp_attention mixed case with spec (#14201)

2025-12-14 02:52:26 +08:00

scheduler_input_blocker.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

scheduler_metrics_mixin.py

Fix metrics (#15998)

2025-12-28 05:03:49 -08:00

scheduler_output_processor_mixin.py

[scheduler] fix: correcting extend_logprob_start_len calculation (#15922)

2025-12-28 14:57:04 -08:00

scheduler_pp_mixin.py

Move log_prefill_stats_late to correct location in PP mode (#15946)

2025-12-31 12:00:24 +08:00

scheduler_profiler_mixin.py

hotfix: add type hints to scheduler mixins (#15916)

2025-12-26 17:08:11 -08:00

scheduler_recv_skipper.py

[Feat]Add scheduler recv skipper weights to environment configuration (#13855)

2025-11-27 18:16:11 +08:00

scheduler_runtime_checker_mixin.py

Tiny refactor request logger (#15740)

2025-12-24 19:51:26 +08:00

scheduler_update_weights_mixin.py

refactor: add type hints to scheduler mixins (#15913)

2025-12-26 16:50:07 -08:00

scheduler.py

Update logprob_start_len handling in scheduler (#16240)

2025-12-31 14:11:24 -08:00

session_controller.py

[Test] Fix session control test (#12336)

2025-10-29 18:28:04 +08:00

template_manager.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

tokenizer_communicator_mixin.py

Tiny refactor request logger (#15740)

2025-12-24 19:51:26 +08:00

tokenizer_manager_multiitem_mixin.py

Add a test case for crash dump (#15905)

2025-12-26 19:39:28 -08:00

tokenizer_manager.py

Fix metrics (#15998)

2025-12-28 05:03:49 -08:00

tp_worker.py

Split tp model worker init (#16165)

2025-12-30 23:36:03 +08:00

utils.py

Support EPLB balancedness prometheus metric without GPU->CPU synchronize (#15401)

2025-12-18 22:24:23 +08:00