fzyzcjy 691c8534cf Support releasing CUDA graph memory when paused (#7873) ...

Co-authored-by: ryang-max <y1cunhui.yang@gmail.com>
Co-authored-by: ryang <38470282+ryang-max@users.noreply.github.com>

2025-10-28 14:40:50 +08:00

..

__init__.py

move more files under srt/utils (#11285)

2025-10-09 16:46:15 -07:00

aio_rwlock.py

move more files under srt/utils (#11285)

2025-10-09 16:46:15 -07:00

bench_utils.py

Reland [1/2] Optimizations and refactors about quant kernel (#10312)

2025-10-11 15:59:03 +08:00

common.py

Add env var to control custom Triton kernel cache and set CSGMV as default backend. (#12176)

2025-10-27 17:49:32 -07:00

hf_transformers_utils.py

fix: the hardcode hf repo name comparison for deepseek-ocr (#12031)

2025-10-23 21:37:56 -07:00

host_shared_memory.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

offloader.py

move more files under srt/utils (#11285)

2025-10-09 16:46:15 -07:00

patch_torch.py

…

poll_based_barrier.py

…

profile_merger.py

[FEATURE] Add Profile Trace Merger for Distributed Traces (#11413)

2025-10-14 09:20:17 +08:00

rpd_utils.py

…

slow_rank_detector.py

…

torch_memory_saver_adapter.py

Support releasing CUDA graph memory when paused (#7873)

2025-10-28 14:40:50 +08:00