Zhiqiang Xie 13f4f010d8 HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

..

async_dynamic_batch_tokenizer.py

…

async_mm_data_processor.py

[VLM] Optimize async mm data process mechanism (#12066)

2025-11-01 01:24:53 +08:00

cache_controller.py

[HiCache] refactor: hicache normalization flow and compatibility checks (#19669)

2026-03-20 18:38:44 -07:00

configure_logging.py

…

data_parallel_controller.py

misc: add BatchTokenizerReq hook into dp controller (#20981)

2026-03-19 23:59:53 -07:00

detokenizer_manager.py

[Utils] Move network/socket utilities from common.py to network.py (#20646)

2026-03-15 20:35:24 -07:00

disagg_service.py

[PD] Cleanup BootstrapServer init and ready check (#19551)

2026-02-28 16:41:42 +08:00

hisparse_coordinator.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

io_struct.py

[EPD][VLM] support video/audio input (#17824)

2026-03-16 14:18:21 +08:00

mm_utils.py

[EPD][VLM] support video/audio input (#17824)

2026-03-16 14:18:21 +08:00

multi_tokenizer_mixin.py

[Utils] Move network/socket utilities from common.py to network.py (#20646)

2026-03-15 20:35:24 -07:00

multimodal_processor.py

Skip mm feature pool init to avoid EPD OOM (#16388)

2026-01-23 10:53:45 +08:00

overlap_utils.py

Enable JIT clamp_position and resolve_future_token_ids on ROCm (#21116)

2026-03-22 22:33:54 -07:00

prefill_delayer.py

[bugfix] fix bug when enable prefill delay and DP (#20134)

2026-03-13 08:51:09 +08:00

schedule_batch.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

schedule_policy.py

Support Qwen3 MoE context parallel (#18233)

2026-03-22 01:27:20 -07:00

scheduler_dp_attn_mixin.py

Optimization: Reduce the number of D2H operations (#19424)

2026-03-04 16:32:42 +08:00

scheduler_input_blocker.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

scheduler_output_processor_mixin.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

scheduler_pp_mixin.py

[PP] Add CP pyobj broadcasting when enable dynamic CPP (#20738)

2026-03-17 12:20:11 +08:00

scheduler_profiler_mixin.py

Add XPU profiler activity support in benchmark code (#12981)

2026-03-04 23:22:56 -08:00

scheduler_recv_skipper.py

[Feat]Add scheduler recv skipper weights to environment configuration (#13855)

2025-11-27 18:16:11 +08:00

scheduler_runtime_checker_mixin.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

scheduler_update_weights_mixin.py

[Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296)

2026-03-10 17:50:23 -07:00

scheduler.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

session_controller.py

[Session] Extract SessionController and clean up session logic in Scheduler (#19547)

2026-02-28 19:47:44 -08:00

template_manager.py

fix: fix the bug blocking completion template application (#17010)

2026-02-24 18:50:08 +08:00

tokenizer_communicator_mixin.py

feat: TTL-based prefix pinning with refresh-on-hit for HiRadixCache (#18941)

2026-03-01 23:27:22 -08:00

tokenizer_manager_multiitem_mixin.py

[Score API][18132] return token usage in Score API response (#18381)

2026-03-03 13:45:35 -08:00

tokenizer_manager.py

Fix streaming logprobs corruption caused by shared mutable list reference (#21030)

2026-03-21 00:18:48 -07:00

tp_worker.py

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

utils.py

Support return_logprob for spec v2 (overlap safe) (#19801)

2026-03-10 15:38:27 -07:00