ShawnY112358 5155016b56 [feat] update bucketed weights from distributed (#13824) ...

Co-authored-by: Stefan He <hebiaobuaa@gmail.com>

2025-11-26 15:30:45 -08:00

..

async_dynamic_batch_tokenizer.py

[Performance] Dynamic Batch Tokenizer (#9382)

2025-09-14 01:56:04 +08:00

async_mm_data_processor.py

[VLM] Optimize async mm data process mechanism (#12066)

2025-11-01 01:24:53 +08:00

cache_controller.py

[HiCache] Critical fix to host memory double free (#13501)

2025-11-18 01:34:23 -08:00

configure_logging.py

Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632)

2025-06-29 23:16:19 -07:00

data_parallel_controller.py

Fix data parallel controller launch for num nodes > 2 (#12822)

2025-11-07 12:13:21 -08:00

detokenizer_manager.py

[Fix] Register custom ops only if they exist (#13321)

2025-11-15 17:48:17 -08:00

disagg_service.py

[1/2] Refactor multi-tokenizer manager (#10074)

2025-09-07 19:13:34 +08:00

io_struct.py

[feat] update bucketed weights from distributed (#13824)

2025-11-26 15:30:45 -08:00

mm_utils.py

[VLM] Support Piecewise CUDA Graph for InternVL (#13640)

2025-11-21 13:21:51 +08:00

multi_tokenizer_mixin.py

refine stdout logging codes (#13015)

2025-11-12 00:16:14 +08:00

multimodal_processor.py

feat: support external custom models (#13429)

2025-11-20 11:16:58 +08:00

overlap_utils.py

[Fix]: Further fix the buffer len of future map (#13916)

2025-11-25 18:09:28 +08:00

request_metrics_exporter.py

Add RequestMetricsExporter utility to export request-level metrics (#10973)

2025-11-12 16:33:37 -08:00

schedule_batch.py

Fix get_load API (#13991)

2025-11-26 22:07:51 +08:00

schedule_policy.py

[Ascend] Support enable-mixed-chunk in non-MLA scenarios (#12491)

2025-11-27 00:00:21 +08:00

scheduler_dp_attn_mixin.py

Minor code cleanup / improvement for PREBUILT_EXTEND mode (#12948)

2025-11-10 11:59:54 +08:00

scheduler_input_blocker.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

scheduler_metrics_mixin.py

Fix get_load API (#13991)

2025-11-26 22:07:51 +08:00

scheduler_output_processor_mixin.py

[feature] Initial block diffusion language model support (#12588)

2025-11-26 17:57:54 +08:00

scheduler_pp_mixin.py

[PP] put pp assert in model runner (#12934)

2025-11-10 14:58:19 +08:00

scheduler_profiler_mixin.py

[Auto Sync] Improve profilers and simplify bench_one_batch_server.py (#13866)

2025-11-25 12:13:31 -08:00

scheduler_recv_skipper.py

Reduce scheduler recv requests overhead (#8947)

2025-08-08 00:10:05 -07:00

scheduler_runtime_checker_mixin.py

[Scheduler] Tiny organize code style (#13806)

2025-11-23 23:41:34 +08:00

scheduler_update_weights_mixin.py

[feat] support in-flight weight update (#10071)

2025-11-25 22:03:13 -08:00

scheduler.py

Fix get_load API (#13991)

2025-11-26 22:07:51 +08:00

session_controller.py

[Test] Fix session control test (#12336)

2025-10-29 18:28:04 +08:00

template_manager.py

Move parsers under a single folder (#9912)

2025-09-02 18:25:04 -07:00

tokenizer_communicator_mixin.py

[feat] support in-flight weight update (#10071)

2025-11-25 22:03:13 -08:00

tokenizer_manager.py

fix spec dec request level metrics (#13754)

2025-11-27 01:09:21 +08:00

tp_worker.py

[feat] update bucketed weights from distributed (#13824)

2025-11-26 15:30:45 -08:00

utils.py

[Spec v2] Remove allocate_lens and enable over-allocation (#13478)

2025-11-22 22:49:10 +08:00