ryang a6ae3af15e Support XiaomiMiMo inference with mtp (#6059)

2025-05-22 14:14:49 -07:00

..

__init__.py

…

attention_backend.md

[Feat] Support FlashMLA backend with MTP and FP8 KV cache (#6109)

2025-05-15 00:48:09 -07:00

custom_chat_template.md

…

function_calling.ipynb

…

hyperparameter_tuning.md

…

lora.ipynb

…

native_api.ipynb

Expert distribution recording without overhead for EPLB (#4957)

2025-05-19 20:07:43 -07:00

offline_engine_api.ipynb

…

openai_api_completions.ipynb

…

openai_api_embeddings.ipynb

…

openai_api_vision.ipynb

docs: fix a bad redirect (#6300)

2025-05-14 10:27:19 -07:00

patch.py

…

pd_disaggregation.md

[PD] Add doc and simplify sender.send (#6019)

2025-05-21 21:22:21 -07:00

quantization.md

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

sampling_params.md

…

send_request.ipynb

…

separate_reasoning.ipynb

[Docs] minor Qwen3 and reasoning parser docs fix (#6032)

2025-05-11 08:22:46 -07:00

server_arguments.md

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

speculative_decoding.ipynb

Support XiaomiMiMo inference with mtp (#6059)

2025-05-22 14:14:49 -07:00

structured_outputs_for_reasoning_models.ipynb

Improve structured outputs: fix race condition, server crash, metrics and style (#6188)

2025-05-11 08:36:16 -07:00

structured_outputs.ipynb

…

vlm_query.ipynb

Support precomputed multimodal features for Qwen-VL and Gemma3 models. (#6136)

2025-05-16 12:26:15 -07:00