laoyao0822 101100e25b feat(eplb): add eplb warmup-only mode ...

Freeze expert layout after the initial EPLB warmup rebalances so heavy workloads avoid recurring rebalance memory spikes and OOMs.

2026-04-08 06:46:26 +08:00

..

attention_backend.md

[Doc] Add DSA/NSA attention backend to support matrix (#20326)

2026-03-11 13:40:35 -04:00

checkpoint_engine.md

[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)

2025-10-30 10:39:27 +08:00

cuda_graph_for_multi_modal_encoder.md

[VLM] Add doc for ViT CUDA Graph (#16343)

2026-01-04 10:05:23 +08:00

deterministic_inference.md

[Documentation] add doc for deterministic inference (#11956)

2025-10-22 12:36:15 -05:00

dp_dpa_smg_guide.md

Enhance SMG guide with RL rollout systems benefits (#18588)

2026-02-10 20:20:45 -08:00

dp_for_multi_modal_encoder.md

[docs] fix misspellings & typos (#18276)

2026-02-05 03:35:29 +00:00

epd_disaggregation.md

[DOC] add documents for encoder global mm cache (#20636)

2026-03-15 16:44:21 -07:00

expert_parallelism.md

feat(eplb): add eplb warmup-only mode

2026-04-08 06:46:26 +08:00

forward_hooks.md

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

hicache_best_practices.md

[HiCache] Support heterogeneous tp for hicache storage (#18541)

2026-02-25 00:13:57 -08:00

hicache_design.md

configuration file support and nixl integration augmentation for hicache-storage-backend-extra-config (#16602)

2026-01-22 14:31:48 -08:00

hicache_storage_runtime_attach_detach.md

[Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296)

2026-03-10 17:50:23 -07:00

hicache.rst

[HiCache][HA 1/N] Support HiCache storage runtime attach/detach (#15892)

2026-01-26 19:33:19 -08:00

hyperparameter_tuning.md

[Docs] Rename SGLang Router to SGLang Model Gateway (#17436)

2026-01-20 12:31:10 -08:00

lora.ipynb

[CI] fix: handle missing repo in lora notebook (#19700)

2026-03-02 10:27:32 -08:00

observability.md

Update docs (#13391)

2025-11-16 19:36:33 -08:00

pd_disaggregation.md

[PD-Disagg] Support query dp rank from bootstrap server. (#19168)

2026-02-23 10:59:30 -08:00

piecewise_cuda_graph.md

Piecewise Cuda Graph Docs (#19738)

2026-03-03 11:51:17 +08:00

pipeline_parallelism.md

[Doc] Update pipeline parallelism documentation (#17414)

2026-01-20 20:10:56 +08:00

quantization.md

fix(docs): correct quantization documentation (#20301) (#20619)

2026-03-15 12:33:12 -04:00

quantized_kv_cache.md

add doc for quantized kv cache (#14348)

2025-12-04 13:01:05 -08:00

rfork.md

[1/2] Add ModelExpress coordination for remote instance weight loading - matching TP (#19920)

2026-03-18 13:38:32 -07:00

separate_reasoning.ipynb

[CI] feat: add early exit to wait_for_server when process dies (#18602)

2026-02-13 16:46:09 -08:00

server_arguments.md

feat(eplb): add eplb warmup-only mode

2026-04-08 06:46:26 +08:00

sgl_model_gateway.md

[model-gateway] Add Redis support as a history backend (#16300)

2026-01-11 01:03:00 -08:00

sglang_for_rl.md

[Feature] Implement update_weights_from_disk for SGLang-D (Diffusion … (#18306)

2026-02-18 11:24:07 -08:00

speculative_decoding.md

[Spec][Ngram] 2/N: Rename branch length to max trie depth (#21181)

2026-03-22 23:35:25 -07:00

structured_outputs_for_reasoning_models.ipynb

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00

structured_outputs.ipynb

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00

tool_parser.ipynb

[CI] feat: add early exit to wait_for_server when process dies (#18602)

2026-02-13 16:46:09 -08:00

vlm_query.ipynb

Upgrade transformers==5.3.0 (#17784)

2026-03-18 13:50:43 -07:00