sglang

attention_backend.md

[Doc] Add DSA/NSA attention backend to support matrix (#20326 )

2026-03-11 13:40:35 -04:00

checkpoint_engine.md

[Ckpt Engine] feat: new sglang entrypoint support for update (#12216 )

2025-10-30 10:39:27 +08:00

cuda_graph_for_multi_modal_encoder.md

[VLM] Add doc for ViT CUDA Graph (#16343 )

2026-01-04 10:05:23 +08:00

deterministic_inference.md

[Documentation] add doc for deterministic inference (#11956 )

2025-10-22 12:36:15 -05:00

dp_dpa_smg_guide.md

Enhance SMG guide with RL rollout systems benefits (#18588 )

2026-02-10 20:20:45 -08:00

dp_for_multi_modal_encoder.md

[docs] fix misspellings & typos (#18276 )

2026-02-05 03:35:29 +00:00

epd_disaggregation.md

[DOC] add documents for encoder global mm cache (#20636 )

2026-03-15 16:44:21 -07:00

expert_parallelism.md

feat(eplb): add eplb warmup-only mode

2026-04-08 06:46:26 +08:00

forward_hooks.md

Rename: --hooks to --forward-hooks (#13994 )

2025-11-26 22:26:28 +08:00

hicache_best_practices.md

[HiCache] Support heterogeneous tp for hicache storage (#18541 )

2026-02-25 00:13:57 -08:00

hicache_design.md

configuration file support and nixl integration augmentation for hicache-storage-backend-extra-config (#16602 )

2026-01-22 14:31:48 -08:00

hicache_storage_runtime_attach_detach.md

[Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296 )

2026-03-10 17:50:23 -07:00

hicache.rst

[HiCache][HA 1/N] Support HiCache storage runtime attach/detach (#15892 )

2026-01-26 19:33:19 -08:00

hyperparameter_tuning.md

[Docs] Rename SGLang Router to SGLang Model Gateway (#17436 )

2026-01-20 12:31:10 -08:00

lora.ipynb

[CI] fix: handle missing repo in lora notebook (#19700 )

2026-03-02 10:27:32 -08:00

nsa_prefill_cp_all_gather.md

docs(cp): add NSA prefill CP dual all-gather explanation and Phase 1 plan

2026-04-22 04:55:15 +08:00

nsa_prefill_cp_phase1_narrow_output_collection.md

docs(cp): add NSA prefill CP dual all-gather explanation and Phase 1 plan

2026-04-22 04:55:15 +08:00

nsa_prefill_cp_phase2_shared_kv_design.md

docs(cp): design NSA prefill CP shared KV phase2

2026-04-24 06:06:31 +08:00

observability.md

Update docs (#13391 )

2025-11-16 19:36:33 -08:00

pd_disaggregation.md

[PD-Disagg] Support query dp rank from bootstrap server. (#19168 )

2026-02-23 10:59:30 -08:00

piecewise_cuda_graph.md

Piecewise Cuda Graph Docs (#19738 )

2026-03-03 11:51:17 +08:00

pipeline_parallelism.md

[Doc] Update pipeline parallelism documentation (#17414 )

2026-01-20 20:10:56 +08:00

quantization.md

fix(docs): correct quantization documentation (#20301 ) (#20619 )

2026-03-15 12:33:12 -04:00

quantized_kv_cache.md

add doc for quantized kv cache (#14348 )

2025-12-04 13:01:05 -08:00

rfork.md

[1/2] Add ModelExpress coordination for remote instance weight loading - matching TP (#19920 )

2026-03-18 13:38:32 -07:00

separate_reasoning.ipynb

[CI] feat: add early exit to wait_for_server when process dies (#18602 )

2026-02-13 16:46:09 -08:00

server_arguments.md

feat(eplb): add eplb warmup-only mode

2026-04-08 06:46:26 +08:00

sgl_model_gateway.md

[model-gateway] Add Redis support as a history backend (#16300 )

2026-01-11 01:03:00 -08:00

sglang_for_rl.md

[Feature] Implement update_weights_from_disk for SGLang-D (Diffusion … (#18306 )

2026-02-18 11:24:07 -08:00

speculative_decoding.md

[Spec][Ngram] 2/N: Rename branch length to max trie depth (#21181 )

2026-03-22 23:35:25 -07:00

structured_outputs_for_reasoning_models.ipynb

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

structured_outputs.ipynb

update pre-commit config (#18860 )

2026-02-16 00:18:31 +08:00

tool_parser.ipynb

[CI] feat: add early exit to wait_for_server when process dies (#18602 )

2026-02-13 16:46:09 -08:00

vlm_query.ipynb

Upgrade transformers==5.3.0 (#17784 )

2026-03-18 13:50:43 -07:00