Byron Hsu edbeaf3b88 [MM][style] rename inputs_embeds to input_embeds for consistency (#14240)

2025-12-01 11:36:51 -08:00

..

async_dynamic_batch_tokenizer.py

…

async_mm_data_processor.py

[VLM] Optimize async mm data process mechanism (#12066)

2025-11-01 01:24:53 +08:00

cache_controller.py

[HiCache] Critical fix to host memory double free (#13501)

2025-11-18 01:34:23 -08:00

configure_logging.py

…

data_parallel_controller.py

Support numactl bind for CPU and memory before process starts (#14156)

2025-11-30 17:00:33 +08:00

detokenizer_manager.py

[Fix] Register custom ops only if they exist (#13321)

2025-11-15 17:48:17 -08:00

disagg_service.py

…

io_struct.py

Support profiling only prefill or decode without the other (#14182)

2025-12-01 14:46:30 +08:00

mm_utils.py

[MM][style] rename inputs_embeds to input_embeds for consistency (#14240)

2025-12-01 11:36:51 -08:00

multi_tokenizer_mixin.py

refine stdout logging codes (#13015)

2025-11-12 00:16:14 +08:00

multimodal_processor.py

feat: support external custom models (#13429)

2025-11-20 11:16:58 +08:00

overlap_utils.py

[Fix]: Further fix the buffer len of future map (#13916)

2025-11-25 18:09:28 +08:00

request_metrics_exporter.py

Add RequestMetricsExporter utility to export request-level metrics (#10973)

2025-11-12 16:33:37 -08:00

schedule_batch.py

Fix speculative decoding error when retracting (#14180)

2025-12-01 15:30:13 +08:00

schedule_policy.py

bugfix[schedule]: Excessive preemption occurs when preempting running requests to schedule new prefill requests. (#12494)

2025-11-30 22:29:26 +08:00

scheduler_dp_attn_mixin.py

Minor code cleanup / improvement for PREBUILT_EXTEND mode (#12948)

2025-11-10 11:59:54 +08:00

scheduler_input_blocker.py

…

scheduler_metrics_mixin.py

Fix get_load API (#13991)

2025-11-26 22:07:51 +08:00

scheduler_output_processor_mixin.py

feat: Naive support Spec V2 + Constrained Decoding (#13425)

2025-11-27 20:31:46 +08:00

scheduler_pp_mixin.py

[PP] put pp assert in model runner (#12934)

2025-11-10 14:58:19 +08:00

scheduler_profiler_mixin.py

Tiny call cudaProfilerStart only on first rank in node (#14211)

2025-12-01 18:18:45 +08:00

scheduler_recv_skipper.py

[Feat]Add scheduler recv skipper weights to environment configuration (#13855)

2025-11-27 18:16:11 +08:00

scheduler_runtime_checker_mixin.py

[Scheduler] Tiny organize code style (#13806)

2025-11-23 23:41:34 +08:00

scheduler_update_weights_mixin.py

Support sanity checking weight consistency especially for RL (#13854)

2025-11-27 20:25:12 +08:00

scheduler.py

[spec-overlap] bugfix for pd disaggregation and npu (#14088)

2025-12-01 22:58:20 +08:00

session_controller.py

[Test] Fix session control test (#12336)

2025-10-29 18:28:04 +08:00

template_manager.py

…

tokenizer_communicator_mixin.py

Support profiling only prefill or decode without the other (#14182)

2025-12-01 14:46:30 +08:00

tokenizer_manager.py

Fix condition for streaming output_ids in tokenizer manager (#13759)

2025-11-29 13:56:15 -08:00

tp_worker.py

[feat] update bucketed weights from distributed (#13824)

2025-11-26 15:30:45 -08:00

utils.py

Fix overlap scheduler not take effect when outputing logprobs (#14096)

2025-11-28 18:15:56 +08:00