Xuchun Shang c01b2ee094 [PP] Refactor PP to async mode (#11852) ...

Signed-off-by: Shangming Cai <csmthu@gmail.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: bluecoffee8 <jasperli2002@gmail.com>
Co-authored-by: zhangxiaolei123456 <zhangxiaolei.666@bytedance.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>

2025-12-12 12:54:16 +08:00

..

__init__.py

move more files under srt/utils (#11285)

2025-10-09 16:46:15 -07:00

aio_rwlock.py

[RL] re-abort_request when model_update_lock is still locked (#13338)

2025-11-17 12:13:39 +08:00

bench_utils.py

Reland [1/2] Optimizations and refactors about quant kernel (#10312)

2025-10-11 15:59:03 +08:00

common.py

[PP] Refactor PP to async mode (#11852)

2025-12-12 12:54:16 +08:00

cuda_ipc_transport_utils.py

[VLM] Boost Memory Pool based CUDA IPC (#14123)

2025-12-01 17:17:46 +08:00

hf_transformers_utils.py

Revert "fix: checking if tokenizer is in cache before downloading from HF" (#14808)

2025-12-10 01:14:35 -08:00

host_shared_memory.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

mistral_utils.py

Add Mistral Large 3 Eagle Support (#14466)

2025-12-05 23:11:41 +08:00

numa_utils.py

[NPU][1/N] NPU basic functions refactor and new modelslim quant type (#13359)

2025-12-04 16:15:31 +08:00

nvtx_pytorch_hooks.py

[feature] Add layerwise NVTX support (#11870)

2025-11-15 19:20:56 -08:00

offloader.py

move more files under srt/utils (#11285)

2025-10-09 16:46:15 -07:00

patch_torch.py

[Fix] Register custom ops only if they exist (#13321)

2025-11-15 17:48:17 -08:00

poll_based_barrier.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

profile_merger.py

[FEATURE] Add Profile Trace Merger for Distributed Traces (#11413)

2025-10-14 09:20:17 +08:00

profile_utils.py

Tiny call cudaProfilerStart only on first rank in node (#14211)

2025-12-01 18:18:45 +08:00

rpd_utils.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

slow_rank_detector.py

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

torch_memory_saver_adapter.py

Support releasing CUDA graph memory when paused (#7873)

2025-10-28 14:40:50 +08:00

weight_checker.py

Support checking fp8 params in weight_checker (#14147)

2025-11-30 09:08:59 +08:00