Ho-Ren (Jack) Chuang 171b442ad3 Add KV4-capable backend flashmla and update server args (#14989) ...

Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>

2025-12-12 11:50:27 -08:00

..

attention_backend.md

Add KV4-capable backend flashmla and update server args (#14989)

2025-12-12 11:50:27 -08:00

checkpoint_engine.md

[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)

2025-10-30 10:39:27 +08:00

deterministic_inference.md

[Documentation] add doc for deterministic inference (#11956)

2025-10-22 12:36:15 -05:00

dp_for_multi_modal_encoder.md

[Glm46v] Bug fix for accuracy drop and unable to launch server (#14585)

2025-12-07 23:45:02 -08:00

expert_parallelism.md

sync attention, deepseek doc (#14335)

2025-12-02 21:19:40 -08:00

forward_hooks.md

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

hicache_best_practices.md

Add interface_v1 option for dynamic HiCache backend (#13140)

2025-11-17 17:42:17 -08:00

hicache_design.md

[Minor] update docs (#14212)

2025-12-01 02:33:58 -08:00

hicache.rst

Update docs (#13391)

2025-11-16 19:36:33 -08:00

hyperparameter_tuning.md

Fix mem fraction static for nightly tests (#11076)

2025-09-29 12:57:41 -07:00

lora.ipynb

[FEATURE] Add OpenAI-Compatible LoRA Adapter Selection (#11570)

2025-10-21 15:44:33 +08:00

observability.md

Update docs (#13391)

2025-11-16 19:36:33 -08:00

pd_disaggregation.md

[bug fix] use npu phy id in container env (#14266)

2025-12-03 11:33:43 +08:00

pipeline_parallelism.md

[1/N] Update doc of Pipeline Parallelism (#14985)

2025-12-12 19:32:52 +08:00

quantization.md

Rename TensorRT Model Optimizer to Model Optimizer (#14455)

2025-12-07 13:18:20 -08:00

quantized_kv_cache.md

add doc for quantized kv cache (#14348)

2025-12-04 13:01:05 -08:00

router.md

Tiny fix incorrect worker removal command (#14822)

2025-12-10 22:29:39 +08:00

separate_reasoning.ipynb

[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)

2025-11-18 10:58:00 +08:00

server_arguments.md

Add FP8 Blockwise GEMM Backend Flag --fp8-gemm-backend (#14379)

2025-12-09 12:05:56 -08:00

speculative_decoding.ipynb

[Doc] Fix SGLang tool parser doc (#9886)

2025-09-04 21:52:53 +08:00

structured_outputs_for_reasoning_models.ipynb

[refactor] Update reasoning parameter to require_reasoning (#14922)

2025-12-11 16:55:59 -08:00

structured_outputs.ipynb

[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)

2025-11-18 10:58:00 +08:00

tool_parser.ipynb

[Doc] Update DeepSeek-V3.2 document (#14321)

2025-12-02 18:19:39 -08:00

vlm_query.ipynb

[3/N] CI refactor: move some manually triggered tests. (#13448)

2025-11-19 23:06:53 +08:00