Kit Fraser-Taliente 7c773ddb0a [Fix] Slice input_embeds to extend_input_len in prepare_for_extend (#20376)

2026-03-15 00:07:05 -07:00

..

async_dynamic_batch_tokenizer.py

…

async_mm_data_processor.py

…

cache_controller.py

Fix mooncake store write/read bandwidth logs (#18294)

2026-03-09 19:54:37 -07:00

configure_logging.py

…

data_parallel_controller.py

[Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306)

2026-03-11 00:07:37 -07:00

detokenizer_manager.py

[PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268)

2026-02-24 19:58:01 -08:00

disagg_service.py

[PD] Cleanup BootstrapServer init and ready check (#19551)

2026-02-28 16:41:42 +08:00

io_struct.py

[feat] Enhance lora_update_weight_from_tensor for RL training (#19314)

2026-03-04 18:10:42 -08:00

mm_utils.py

Fix EPD OOM by offloading precomputed_embeddings during chunked prefill (#16503)

2026-03-08 20:10:40 -07:00

multi_tokenizer_mixin.py

[PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268)

2026-02-24 19:58:01 -08:00

multimodal_processor.py

…

overlap_utils.py

[spec v2]Fix torch gc of future indices (#18958)

2026-02-19 11:38:25 -08:00

prefill_delayer.py

[bugfix] fix bug when enable prefill delay and DP (#20134)

2026-03-13 08:51:09 +08:00

schedule_batch.py

[Fix] Slice input_embeds to extend_input_len in prepare_for_extend (#20376)

2026-03-15 00:07:05 -07:00

schedule_policy.py

[NPU] bugs fix for Deepseek models (#19544)

2026-02-28 17:26:15 +08:00

scheduler_dp_attn_mixin.py

Optimization: Reduce the number of D2H operations (#19424)

2026-03-04 16:32:42 +08:00

scheduler_input_blocker.py

…

scheduler_output_processor_mixin.py

Support return_logprob for spec v2 (overlap safe) (#19801)

2026-03-10 15:38:27 -07:00

scheduler_pp_mixin.py

[PP] Fix recv tensor dict potential race condition (#20341)

2026-03-14 13:35:01 +08:00

scheduler_profiler_mixin.py

Add XPU profiler activity support in benchmark code (#12981)

2026-03-04 23:22:56 -08:00

scheduler_recv_skipper.py

…

scheduler_runtime_checker_mixin.py

Fix streaming session with paged KV cache (SWA/MLA) (#20070)

2026-03-08 03:00:32 -07:00

scheduler_update_weights_mixin.py

[Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296)

2026-03-10 17:50:23 -07:00

scheduler.py

[Fix] Slice input_embeds to extend_input_len in prepare_for_extend (#20376)

2026-03-15 00:07:05 -07:00

session_controller.py

[Session] Extract SessionController and clean up session logic in Scheduler (#19547)

2026-02-28 19:47:44 -08:00

template_manager.py

fix: fix the bug blocking completion template application (#17010)

2026-02-24 18:50:08 +08:00

tokenizer_communicator_mixin.py

feat: TTL-based prefix pinning with refresh-on-hit for HiRadixCache (#18941)

2026-03-01 23:27:22 -08:00

tokenizer_manager_multiitem_mixin.py

[Score API][18132] return token usage in Score API response (#18381)

2026-03-03 13:45:35 -08:00

tokenizer_manager.py

Rename --stream-output to --incremental-streaming-output (#20614)

2026-03-14 23:22:33 -07:00

tp_worker.py

[Core] Replace server_args mutation hack with explicit MemoryPoolConfig for draft worker init (#20183)

2026-03-09 11:45:54 -07:00

utils.py

Support return_logprob for spec v2 (overlap safe) (#19801)

2026-03-10 15:38:27 -07:00