Ho-Ren (Jack) Chuang 349ce2dd19 Support kv8 (FP8) with torch_native attention backend (#12596) ...

Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>

2025-12-28 10:48:30 +08:00

..

attention_backend.md

Support kv8 (FP8) with torch_native attention backend (#12596)

2025-12-28 10:48:30 +08:00

checkpoint_engine.md

[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)

2025-10-30 10:39:27 +08:00

deterministic_inference.md

[Documentation] add doc for deterministic inference (#11956)

2025-10-22 12:36:15 -05:00

dp_for_multi_modal_encoder.md

[Glm46v] Bug fix for accuracy drop and unable to launch server (#14585)

2025-12-07 23:45:02 -08:00

epd_disaggregation.md

Add EPD disaggregation doc (#15224)

2025-12-16 11:22:05 +08:00

expert_parallelism.md

sync attention, deepseek doc (#14335)

2025-12-02 21:19:40 -08:00

forward_hooks.md

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

hicache_best_practices.md

Add interface_v1 option for dynamic HiCache backend (#13140)

2025-11-17 17:42:17 -08:00

hicache_design.md

[Minor] update docs (#14212)

2025-12-01 02:33:58 -08:00

hicache.rst

Update docs (#13391)

2025-11-16 19:36:33 -08:00

hyperparameter_tuning.md

Fix mem fraction static for nightly tests (#11076)

2025-09-29 12:57:41 -07:00

lora.ipynb

Fix lora doc (#15282)

2025-12-16 15:53:38 -08:00

observability.md

Update docs (#13391)

2025-11-16 19:36:33 -08:00

pd_disaggregation.md

[bug fix] use npu phy id in container env (#14266)

2025-12-03 11:33:43 +08:00

pipeline_parallelism.md

Fix pipeline parallelism doc typos (#15688)

2025-12-23 22:19:15 +08:00

quantization.md

Rename TensorRT Model Optimizer to Model Optimizer (#14455)

2025-12-07 13:18:20 -08:00

quantized_kv_cache.md

add doc for quantized kv cache (#14348)

2025-12-04 13:01:05 -08:00

rfork.md

support non disturbing remote instance weight loader v2 (#14997)

2025-12-16 14:39:56 -08:00

separate_reasoning.ipynb

[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)

2025-11-18 10:58:00 +08:00

server_arguments.md

feat: Add limit-mm-data-per-request argument to server arguments (#15418)

2025-12-20 10:44:47 -08:00

sgl_model_gateway.md

[docs] major SGL Model Gateway documentation update (#15715)

2025-12-23 20:26:09 -08:00

speculative_decoding.ipynb

[Doc] Fix SGLang tool parser doc (#9886)

2025-09-04 21:52:53 +08:00

structured_outputs_for_reasoning_models.ipynb

[refactor] Update reasoning parameter to require_reasoning (#14922)

2025-12-11 16:55:59 -08:00

structured_outputs.ipynb

[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)

2025-11-18 10:58:00 +08:00

tool_parser.ipynb

[Doc] Update DeepSeek-V3.2 document (#14321)

2025-12-02 18:19:39 -08:00

vlm_query.ipynb

vlm: refactor engine vlm params and support processor output as input (#14091)

2025-12-20 18:31:24 +08:00