Lianmin Zheng 2d72fc47cf Improve profiler and integrate profiler in bench_one_batch_server (#6787)

2025-05-31 15:53:55 -07:00

..

__init__.py

…

attention_backend.md

…

custom_chat_template.md

…

function_calling.ipynb

update toc for doc and dockerfile code style format (#6450)

2025-05-27 13:05:11 +08:00

hyperparameter_tuning.md

Improve profiler and integrate profiler in bench_one_batch_server (#6787)

2025-05-31 15:53:55 -07:00

lora.ipynb

…

native_api.ipynb

…

offline_engine_api.ipynb

…

openai_api_completions.ipynb

…

openai_api_embeddings.ipynb

Fix some issues with current docs. (#6588)

2025-05-26 01:04:34 +08:00

openai_api_vision.ipynb

Fix some issues with current docs. (#6588)

2025-05-26 01:04:34 +08:00

patch.py

…

pd_disaggregation.md

[PD] Optimize time out logic and add env var doc for mooncake (#6761)

2025-05-30 00:45:02 -07:00

quantization.md

…

sampling_params.md

docs: Update documentation to reflect xgrammar as default grammar backend (#6601)

2025-05-27 13:29:13 +08:00

send_request.ipynb

…

separate_reasoning.ipynb

…

server_arguments.md

…

speculative_decoding.ipynb

Support XiaomiMiMo inference with mtp (#6059)

2025-05-22 14:14:49 -07:00

structured_outputs_for_reasoning_models.ipynb

…

structured_outputs.ipynb

…

vlm_query.ipynb

…