Faraz 4b04998d38 TRTLLM Gen MLA Decode Kernel Integration (same as #7938) (#8632) ...

Signed-off-by: Faraz Khoubsirat <58580514+farazkh80@users.noreply.github.com>

2025-07-31 16:03:40 -07:00

..

__init__.py

…

attention_backend.md

TRTLLM Gen MLA Decode Kernel Integration (same as #7938) (#8632)

2025-07-31 16:03:40 -07:00

custom_chat_template.md

…

function_calling.ipynb

…

hyperparameter_tuning.md

Update hyperparameter_tuning.md (#7454)

2025-06-22 22:42:55 -07:00

lora.ipynb

Support start up LoRA server without initial adapters (#8019)

2025-07-19 15:38:09 -07:00

native_api.ipynb

Update native_api doc to match the change in the get_model_info endpoint (#7660)

2025-07-08 21:05:58 -07:00

offline_engine_api.ipynb

…

openai_api_completions.ipynb

[Feat] Add reasoning parser for Qwen/Qwen3-235B-A22B-Thinking-2507 (#8363)

2025-07-25 14:59:42 -07:00

openai_api_embeddings.ipynb

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

openai_api_vision.ipynb

feat(oai refactor): Replace openai_api with entrypoints/openai (#7351)

2025-06-21 13:21:06 -07:00

patch.py

…

pd_disaggregation.md

[feature] kv transfer support of ascend npu (#7795)

2025-07-11 00:07:51 -07:00

quantization.md

…

sampling_params.md

…

send_request.ipynb

…

separate_reasoning.ipynb

[Feat] Add reasoning parser for Qwen/Qwen3-235B-A22B-Thinking-2507 (#8363)

2025-07-25 14:59:42 -07:00

server_arguments.md

model: support Step3V (#8583)

2025-07-31 02:41:00 -07:00

speculative_decoding.ipynb

…

structured_outputs_for_reasoning_models.ipynb

…

structured_outputs.ipynb

…

vlm_query.ipynb

Support precomputed_embeddings for Llama 4 (#8156)

2025-07-27 01:14:49 -07:00