Povilas Kanapickas bd7cfbd2f8 [Fix] Reduce busy polling when scheduler is idle (#6026)

2025-06-12 14:58:22 -07:00

..

__init__.py

…

attention_backend.md

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109)

2025-05-15 00:48:09 -07:00

custom_chat_template.md

…

function_calling.ipynb

update toc for doc and dockerfile code style format (#6450)

2025-05-27 13:05:11 +08:00

hyperparameter_tuning.md

Improve perf tuning docs (#7071)

2025-06-10 16:55:04 -07:00

lora.ipynb

Feat: support cuda graph for LoRA (#4115)

2025-04-28 23:30:44 -07:00

native_api.ipynb

Expert distribution recording without overhead for EPLB (#4957)

2025-05-19 20:07:43 -07:00

offline_engine_api.ipynb

smaller and non gated models for docs (#5378)

2025-04-20 17:38:25 -07:00

openai_api_completions.ipynb

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

openai_api_embeddings.ipynb

Fix some issues with current docs. (#6588)

2025-05-26 01:04:34 +08:00

openai_api_vision.ipynb

Fix some issues with current docs. (#6588)

2025-05-26 01:04:34 +08:00

patch.py

…

pd_disaggregation.md

[PD] Fix potential perf spike caused by tracker gc and optimize doc (#6764)

2025-06-05 10:56:02 -07:00

quantization.md

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

sampling_params.md

Clean up docs for server args and sampling parameters (generated by grok) (#7076)

2025-06-10 19:55:42 -07:00

send_request.ipynb

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

separate_reasoning.ipynb

[Docs] minor Qwen3 and reasoning parser docs fix (#6032)

2025-05-11 08:22:46 -07:00

server_arguments.md

[Fix] Reduce busy polling when scheduler is idle (#6026)

2025-06-12 14:58:22 -07:00

speculative_decoding.ipynb

Support XiaomiMiMo inference with mtp (#6059)

2025-05-22 14:14:49 -07:00

structured_outputs_for_reasoning_models.ipynb

Improve structured outputs: fix race condition, server crash, metrics and style (#6188)

2025-05-11 08:36:16 -07:00

structured_outputs.ipynb

…

vlm_query.ipynb

[Refactor] Multimodal data processing for VLM (#6659)

2025-06-04 11:22:33 -07:00