Weiwei caa4819bfc Add support for AutoRound quantized models (#10153)

2025-10-27 18:17:29 +08:00

..

attention_backend.md

…

deterministic_inference.md

…

hicache_best_practices.md

…

hicache_design.md

…

hicache.rst

…

hyperparameter_tuning.md

…

lora.ipynb

…

observability.md

…

pd_disaggregation.md

…

pd_multiplexing.md

…

quantization.md

Add support for AutoRound quantized models (#10153)

2025-10-27 18:17:29 +08:00

router.md

…

separate_reasoning.ipynb

…

server_arguments.md

…

speculative_decoding.ipynb

…

structured_outputs_for_reasoning_models.ipynb

…

structured_outputs.ipynb

…

tool_parser.ipynb

…

vlm_query.ipynb

…