fzyzcjy c5f4e20f2f Support GPU execution time breakdown by forward mode metrics (#15396)

2025-12-18 22:18:17 +08:00

..

__init__.py

…

aio_rwlock.py

[RL] re-abort_request when model_update_lock is still locked (#13338)

2025-11-17 12:13:39 +08:00

bench_utils.py

…

common.py

Tiny fix unknown route in prometheus metrics (#15404)

2025-12-18 22:17:46 +08:00

cuda_ipc_transport_utils.py

unified management of environment variables for vlm cuda ipc transport (#14501)

2025-12-18 12:28:06 +08:00

device_timer.py

Support GPU execution time breakdown by forward mode metrics (#15396)

2025-12-18 22:18:17 +08:00

hf_transformers_utils.py

Monkey patch deepseek-ocr's v_head_dim (#15384)

2025-12-18 16:28:07 +08:00

host_shared_memory.py

…

mistral_utils.py

Mistral Large 3 NVFP4 TRTLLM MoE support (#15049)

2025-12-18 11:11:42 +08:00

numa_utils.py

[NPU][1/N] NPU basic functions refactor and new modelslim quant type (#13359)

2025-12-04 16:15:31 +08:00

nvtx_pytorch_hooks.py

[feature] Add layerwise NVTX support (#11870)

2025-11-15 19:20:56 -08:00

offloader.py

…

patch_torch.py

[Fix] Register custom ops only if they exist (#13321)

2025-11-15 17:48:17 -08:00

poll_based_barrier.py

…

profile_merger.py

…

profile_utils.py

Tiny call cudaProfilerStart only on first rank in node (#14211)

2025-12-01 18:18:45 +08:00

rpd_utils.py

…

slow_rank_detector.py

…

torch_memory_saver_adapter.py

Support releasing CUDA graph memory when paused (#7873)

2025-10-28 14:40:50 +08:00

weight_checker.py

Support checking fp8 params in weight_checker (#14147)

2025-11-30 09:08:59 +08:00