Yi Zhang b06215daed [BUG] fix stop_profile crash (#6431)

2025-05-19 17:30:33 -07:00

..

configs

refactor: minor refactors regarding multimodal processing (#6187)

2025-05-17 22:53:20 -07:00

connector

feat(remote_model): support variable remote backend for model loader (#3964)

2025-03-14 00:40:44 -07:00

constrained

Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225)

2025-05-12 14:33:38 -07:00

disaggregation

[Metrics] Add KV events publishing (#6098)

2025-05-19 14:19:54 -07:00

distributed

Use monotonic clock for interval measurement (#6211)

2025-05-17 16:49:18 -07:00

entrypoints

chore: upgrade sgl-kernel v0.1.3 (#6377)

2025-05-17 19:47:05 -07:00

layers

Fix nodeepgemm init (#6417)

2025-05-19 00:44:03 -07:00

lora

Fix lora bench (#6302)

2025-05-15 10:09:55 -07:00

managers

[BUG] fix stop_profile crash (#6431)

2025-05-19 17:30:33 -07:00

mem_cache

[Metrics] Add KV events publishing (#6098)

2025-05-19 14:19:54 -07:00

metrics

Use monotonic clock for interval measurement (#6211)

2025-05-17 16:49:18 -07:00

model_executor

[Misc] Implement RankZeroFilter for rank-specific logging in model_runner.py (#6333)

2025-05-18 15:27:13 -07:00

model_loader

Reland tiny refactor DefaultModelLoader.Source (#6041)

2025-05-17 17:11:20 -07:00

models

Refactor DeepSeek MoE layer to unify the two forward branches (#6325)

2025-05-18 15:34:36 -07:00

openai_api

Implement return_hidden_states for the OpenAI API (#6137)

2025-05-18 22:30:25 -07:00

sampling

Skip the flaky test_stateful_custom_logit_processor (#6251)

2025-05-12 18:29:41 -07:00

speculative

Use monotonic clock for interval measurement (#6211)

2025-05-17 16:49:18 -07:00

_custom_ops.py

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

aio_rwlock.py

…

code_completion_parser.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

conversation.py

The Gemma template is missing a newline after the user role. (#6331)

2025-05-18 01:57:27 -07:00

custom_op.py

Clean up imports (#5467)

2025-04-16 15:26:49 -07:00

function_call_parser.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

hf_transformers_utils.py

refactor: minor refactors regarding multimodal processing (#6187)

2025-05-17 22:53:20 -07:00

mm_utils.py

refactor: minor refactors regarding multimodal processing (#6187)

2025-05-17 22:53:20 -07:00

model_parallel.py

…

patch_torch.py

Fix torch.compile cacheing (#5259)

2025-04-10 18:08:45 -07:00

reasoning_parser.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

server_args.py

[Metrics] Add KV events publishing (#6098)

2025-05-19 14:19:54 -07:00

torch_memory_saver_adapter.py

[CI] Fix ci tests (#5769)

2025-04-27 07:18:10 -07:00

utils.py

Do not use FA3 for mistral (#6379)

2025-05-17 19:47:34 -07:00

warmup.py

…