7 people 2e4babdb0a [Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109) ...

Co-authored-by: Yingyi <yingyihuang2000@outlook.com>
Co-authored-by: neiltian <neiltian@tencent.com>
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
Co-authored-by: kexueyu <kexueyu@tencent.com>
Co-authored-by: vincentmeng <vincentmeng@tencent.com>
Co-authored-by: pengmeng <pengmeng@tencent.com>

2025-05-15 00:48:09 -07:00

..

__init__.py

…

attention_backend.md

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109)

2025-05-15 00:48:09 -07:00

custom_chat_template.md

…

function_calling.ipynb

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

hyperparameter_tuning.md

update torch compile doc (#4874)

2025-03-28 19:49:30 -07:00

lora.ipynb

Feat: support cuda graph for LoRA (#4115)

2025-04-28 23:30:44 -07:00

native_api.ipynb

Remove token in token out in Native API (#5967)

2025-05-01 21:59:43 -07:00

offline_engine_api.ipynb

smaller and non gated models for docs (#5378)

2025-04-20 17:38:25 -07:00

openai_api_completions.ipynb

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

openai_api_embeddings.ipynb

doc: fix the erroneous documents and example codes about Alibaba-NLP/gme-Qwen2-VL-2B-Instruct (#6199)

2025-05-11 08:22:11 -07:00

openai_api_vision.ipynb

docs: fix a bad redirect (#6300)

2025-05-14 10:27:19 -07:00

patch.py

…

quantization.md

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

sampling_params.md

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

send_request.ipynb

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

separate_reasoning.ipynb

[Docs] minor Qwen3 and reasoning parser docs fix (#6032)

2025-05-11 08:22:46 -07:00

server_arguments.md

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

speculative_decoding.ipynb

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

structured_outputs_for_reasoning_models.ipynb

Improve structured outputs: fix race condition, server crash, metrics and style (#6188)

2025-05-11 08:36:16 -07:00

structured_outputs.ipynb

Fix: docs/backend/structured_outputs.ipynb (#4884)

2025-04-12 02:18:55 -07:00