fanghao 2b47bd3a34 [Bug Fix] Fix non-streaming request abort failure when --enable-metrics is enabled (#20625)

2026-03-22 19:58:49 -07:00

..

__init__.py

…

aio_rwlock.py

[RL] re-abort_request when model_update_lock is still locked (#13338)

2025-11-17 12:13:39 +08:00

auth.py

fix: preserve disconnect events in api key middleware (#17253)

2026-01-26 22:48:24 -05:00

bench_utils.py

…

common.py

[Bug Fix] Fix non-streaming request abort failure when --enable-metrics is enabled (#20625)

2026-03-22 19:58:49 -07:00

cuda_ipc_transport_utils.py

unified management of environment variables for vlm cuda ipc transport (#14501)

2025-12-18 12:28:06 +08:00

custom_op.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910)

2026-03-22 16:39:40 +08:00

device_timer.py

[Metrics] Add overlap bubble timing, full KV usage gauge, and prefill cuda graph tracking (#19982)

2026-03-06 17:41:27 -08:00

gauge_histogram.py

Tiny add gauge histogram abstraction for engine and router (#16848)

2026-01-10 11:45:25 +08:00

hf_transformers_utils.py

[Fix] Patch is_flash_attn_2_available for flash-attn-4 in VLM input format test (#20946)

2026-03-19 13:00:51 -07:00

host_shared_memory.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

http_middleware_patch.py

[Bug Fix] Fix non-streaming request abort failure when --enable-metrics is enabled (#20625)

2026-03-22 19:58:49 -07:00

json_response.py

Fix /generate JSON serialization for non-finite top_logprobs (#20714)

2026-03-16 20:07:12 -07:00

log_utils.py

Tiny extract file logging utils (#16870)

2026-01-10 20:02:37 +08:00

mistral_utils.py

Add Mistral Small 4 (Pixtral) support (#20708)

2026-03-18 14:15:32 -07:00

model_file_verifier.py

Add file size hints in bitwise model file verifier (#16735)

2026-01-08 22:28:52 +08:00

multi_stream_utils.py

Reworked fast_pos_embed_interpolate() using torch (#10959)

2025-12-30 14:45:34 +08:00

network.py

[Network] Use NetworkAddress for dist_init_method and loopback fallbacks (#20657)

2026-03-16 19:59:49 -07:00

numa_utils.py

Add auto bind numa node (#15678)

2026-03-08 23:46:09 -07:00

nvtx_pytorch_hooks.py

[feature] Add layerwise NVTX support (#11870)

2025-11-15 19:20:56 -08:00

offloader.py

…

patch_tokenizer.py

Tiny speed up kimi detokenizer by 10x (#16427)

2026-01-05 09:12:05 +08:00

patch_torch.py

Fix torch.__version__ for PEP440 (#15682)

2026-01-29 11:55:13 -08:00

poll_based_barrier.py

…

profile_merger.py

[FEATURE] Add Profile Trace Merger for Distributed Traces (#11413)

2025-10-14 09:20:17 +08:00

profile_utils.py

Tiny call cudaProfilerStart only on first rank in node (#14211)

2025-12-01 18:18:45 +08:00

request_logger.py

[OpenAI] Log raw request payload for --log-requests (#20605)

2026-03-15 17:45:00 -07:00

rpd_utils.py

Fix none-comparison (E711) warnings (#19745)

2026-03-06 16:15:21 -08:00

scheduler_status_logger.py

Decouple scheduler log printing from metrics collection (#20107)

2026-03-07 22:09:10 -08:00

slow_rank_detector.py

…

torch_memory_saver_adapter.py

Support releasing CUDA graph memory when paused (#7873)

2025-10-28 14:40:50 +08:00

video_decoder.py

[VLM] Replace decord with torchcodec for video decoding (#20055)

2026-03-09 19:23:49 +08:00

watchdog.py

fix: health check adding test delays (#16381)

2026-01-04 00:28:32 -08:00

weight_checker.py

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00