ThomasX 3e9152194b test: cover CP HiCache host integration

2026-05-08 02:59:27 +08:00

..

async_dynamic_batch_tokenizer.py

…

async_mm_data_processor.py

…

cache_controller.py

test: cover CP HiCache host integration

2026-05-08 02:59:27 +08:00

configure_logging.py

…

data_parallel_controller.py

fix(dp_ctrl): fix imbalanced DP rank assignment

2026-04-09 01:37:13 +08:00

detokenizer_manager.py

[Utils] Move network/socket utilities from common.py to network.py (#20646)

2026-03-15 20:35:24 -07:00

disagg_service.py

[PD] Cleanup BootstrapServer init and ready check (#19551)

2026-02-28 16:41:42 +08:00

hisparse_coordinator.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

io_struct.py

fix(dp_ctrl): fix imbalanced DP rank assignment

2026-04-09 01:37:13 +08:00

mm_utils.py

[EPD][VLM] support video/audio input (#17824)

2026-03-16 14:18:21 +08:00

multi_tokenizer_mixin.py

[Utils] Move network/socket utilities from common.py to network.py (#20646)

2026-03-15 20:35:24 -07:00

multimodal_processor.py

Skip mm feature pool init to avoid EPD OOM (#16388)

2026-01-23 10:53:45 +08:00

overlap_utils.py

Enable JIT clamp_position and resolve_future_token_ids on ROCm (#21116)

2026-03-22 22:33:54 -07:00

prefill_delayer.py

[bugfix] fix bug when enable prefill delay and DP (#20134)

2026-03-13 08:51:09 +08:00

schedule_batch.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

schedule_policy.py

fix: preserve HiCache load-back allocator headroom

2026-05-08 00:18:33 +08:00

scheduler_dp_attn_mixin.py

feat(scheduler): support scheduler recv skip in dp

2026-04-08 06:10:42 +08:00

scheduler_graceful_shutdown_mixin.py

feat(drain): graceful shutdown and admin drain

2026-04-08 06:13:42 +08:00

scheduler_input_blocker.py

…

scheduler_output_processor_mixin.py

perf(disaggregation): fast-path common decode result processing

2026-04-19 04:23:48 +08:00

scheduler_pp_mixin.py

[PP] Add CP pyobj broadcasting when enable dynamic CPP (#20738)

2026-03-17 12:20:11 +08:00

scheduler_profiler_mixin.py

Add XPU profiler activity support in benchmark code (#12981)

2026-03-04 23:22:56 -08:00

scheduler_recv_skipper.py

feat(scheduler): support scheduler recv skip in dp

2026-04-08 06:10:42 +08:00

scheduler_runtime_checker_mixin.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

scheduler_update_weights_mixin.py

[Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296)

2026-03-10 17:50:23 -07:00

scheduler.py

feat(drain): graceful shutdown and admin drain

2026-04-08 06:13:42 +08:00

session_controller.py

[Session] Extract SessionController and clean up session logic in Scheduler (#19547)

2026-02-28 19:47:44 -08:00

template_manager.py

fix: fix the bug blocking completion template application (#17010)

2026-02-24 18:50:08 +08:00

tokenizer_communicator_mixin.py

feat: TTL-based prefix pinning with refresh-on-hit for HiRadixCache (#18941)

2026-03-01 23:27:22 -08:00

tokenizer_manager_multiitem_mixin.py

[Score API][18132] return token usage in Score API response (#18381)

2026-03-03 13:45:35 -08:00

tokenizer_manager.py

feat(token_limit): limit input token < 131072

2026-04-08 06:34:03 +08:00

tp_worker.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

utils.py

Support return_logprob for spec v2 (overlap safe) (#19801)

2026-03-10 15:38:27 -07:00