Yi Zhong 08fcda2f63 add the fa4 mm backend and varlen func (#13539) ...

Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>

2026-01-23 23:12:06 +08:00

..

attention_backend.md

add the fa4 mm backend and varlen func (#13539)

2026-01-23 23:12:06 +08:00

checkpoint_engine.md

[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)

2025-10-30 10:39:27 +08:00

cuda_graph_for_multi_modal_encoder.md

[VLM] Add doc for ViT CUDA Graph (#16343)

2026-01-04 10:05:23 +08:00

deterministic_inference.md

[Documentation] add doc for deterministic inference (#11956)

2025-10-22 12:36:15 -05:00

dp_for_multi_modal_encoder.md

[Glm46v] Bug fix for accuracy drop and unable to launch server (#14585)

2025-12-07 23:45:02 -08:00

epd_disaggregation.md

Add EPD disaggregation doc (#15224)

2025-12-16 11:22:05 +08:00

expert_parallelism.md

[Docs] minor update on ep docs (#17242)

2026-01-16 18:20:47 -08:00

forward_hooks.md

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

hicache_best_practices.md

Add interface_v1 option for dynamic HiCache backend (#13140)

2025-11-17 17:42:17 -08:00

hicache_design.md

configuration file support and nixl integration augmentation for hicache-storage-backend-extra-config (#16602)

2026-01-22 14:31:48 -08:00

hicache.rst

Update docs (#13391)

2025-11-16 19:36:33 -08:00

hyperparameter_tuning.md

[Docs] Rename SGLang Router to SGLang Model Gateway (#17436)

2026-01-20 12:31:10 -08:00

lora.ipynb

[Feature] overlap LoRA weight loading with compute (#15512)

2026-01-19 10:43:17 +08:00

observability.md

Update docs (#13391)

2025-11-16 19:36:33 -08:00

pd_disaggregation.md

[Docs] Rename SGLang Router to SGLang Model Gateway (#17436)

2026-01-20 12:31:10 -08:00

pipeline_parallelism.md

[Doc] Update pipeline parallelism documentation (#17414)

2026-01-20 20:10:56 +08:00

quantization.md

[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392)

2026-01-14 01:44:40 -08:00

quantized_kv_cache.md

add doc for quantized kv cache (#14348)

2025-12-04 13:01:05 -08:00

rfork.md

support non disturbing remote instance weight loader v2 (#14997)

2025-12-16 14:39:56 -08:00

separate_reasoning.ipynb

docs only add kimi k2 thinking and kimi linear (#15789)

2026-01-15 12:09:52 -05:00

server_arguments.md

add the fa4 mm backend and varlen func (#13539)

2026-01-23 23:12:06 +08:00

sgl_model_gateway.md

[model-gateway] Add Redis support as a history backend (#16300)

2026-01-11 01:03:00 -08:00

speculative_decoding.ipynb

[Doc] Fix SGLang tool parser doc (#9886)

2025-09-04 21:52:53 +08:00

structured_outputs_for_reasoning_models.ipynb

[refactor] Update reasoning parameter to require_reasoning (#14922)

2025-12-11 16:55:59 -08:00

structured_outputs.ipynb

[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)

2025-11-18 10:58:00 +08:00

tool_parser.ipynb

[Doc] Update DeepSeek-V3.2 document (#14321)

2025-12-02 18:19:39 -08:00

vlm_query.ipynb

vlm: refactor engine vlm params and support processor output as input (#14091)

2025-12-20 18:31:24 +08:00