b8zhong f9a7d9b3dc support server arg override KV cache to bf16 to avoid slow cases (#11749)

2025-10-19 02:49:48 +08:00

..

attention_backend.md

[Doc] Update support matrix for attn and hybrid attn (#11293)

2025-10-14 22:43:11 -07:00

hicache_best_practices.md

[HICache]: Support 3FS-Store with page_first_direct layout (#11460)

2025-10-13 15:47:22 +08:00

hicache_design.md

…

hicache.rst

…

hyperparameter_tuning.md

…

lora.ipynb

Implement LRU eviction policy for LoRA adapters (#11041)

2025-10-13 20:18:25 -07:00

observability.md

…

pd_disaggregation.md

bench_serving support PD Disaggregation (#11542)

2025-10-13 19:43:26 -07:00

pd_multiplexing.md

[Documentation][Configuration] Server args and documentation of PD-Multiplexing. (#11427)

2025-10-11 21:36:07 +08:00

quantization.md

…

router.md

[doc] update router document (#11767)

2025-10-17 10:26:54 -07:00

separate_reasoning.ipynb

…

server_arguments.md

support server arg override KV cache to bf16 to avoid slow cases (#11749)

2025-10-19 02:49:48 +08:00

speculative_decoding.ipynb

…

structured_outputs_for_reasoning_models.ipynb

…

structured_outputs.ipynb

…

tool_parser.ipynb

Update tool parser and related documentation (#11223)

2025-10-07 11:03:40 -07:00

vlm_query.ipynb

…