fxmarty-amd 5af84c8af5 [AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392) ...

Co-authored-by: Dehua Tang <dehtang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: YC Tseng <yctseng@amd.com>

2026-01-14 01:44:40 -08:00

..

attention_backend.md

Support kv8 (FP8) with torch_native attention backend (#12596)

2025-12-28 10:48:30 +08:00

checkpoint_engine.md

[Ckpt Engine] feat: new sglang entrypoint support for update (#12216)

2025-10-30 10:39:27 +08:00

cuda_graph_for_multi_modal_encoder.md

[VLM] Add doc for ViT CUDA Graph (#16343)

2026-01-04 10:05:23 +08:00

deterministic_inference.md

[Documentation] add doc for deterministic inference (#11956)

2025-10-22 12:36:15 -05:00

dp_for_multi_modal_encoder.md

[Glm46v] Bug fix for accuracy drop and unable to launch server (#14585)

2025-12-07 23:45:02 -08:00

epd_disaggregation.md

Add EPD disaggregation doc (#15224)

2025-12-16 11:22:05 +08:00

expert_parallelism.md

[Doc]Update MTP moe backends for EP document (#16013)

2025-12-28 19:36:23 +08:00

forward_hooks.md

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

hicache_best_practices.md

Add interface_v1 option for dynamic HiCache backend (#13140)

2025-11-17 17:42:17 -08:00

hicache_design.md

[Minor] update docs (#14212)

2025-12-01 02:33:58 -08:00

hicache.rst

Update docs (#13391)

2025-11-16 19:36:33 -08:00

hyperparameter_tuning.md

Fix mem fraction static for nightly tests (#11076)

2025-09-29 12:57:41 -07:00

lora.ipynb

[Doc] Default lora backend: csgmv (#16444)

2026-01-05 12:45:49 +08:00

observability.md

Update docs (#13391)

2025-11-16 19:36:33 -08:00

pd_disaggregation.md

[NPU] upgrade npu mf_apater plugin (#15853)

2026-01-13 09:02:10 +08:00

pipeline_parallelism.md

[Doc] Optimize pipeline parallelism doc (#16630)

2026-01-07 14:52:42 +08:00

quantization.md

[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392)

2026-01-14 01:44:40 -08:00

quantized_kv_cache.md

add doc for quantized kv cache (#14348)

2025-12-04 13:01:05 -08:00

rfork.md

support non disturbing remote instance weight loader v2 (#14997)

2025-12-16 14:39:56 -08:00

separate_reasoning.ipynb

[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)

2025-11-18 10:58:00 +08:00

server_arguments.md

feat: add --admin-api-key for finer-grained endpoint auth (#15908)

2026-01-13 20:21:55 -08:00

sgl_model_gateway.md

[model-gateway] Add Redis support as a history backend (#16300)

2026-01-11 01:03:00 -08:00

speculative_decoding.ipynb

[Doc] Fix SGLang tool parser doc (#9886)

2025-09-04 21:52:53 +08:00

structured_outputs_for_reasoning_models.ipynb

[refactor] Update reasoning parameter to require_reasoning (#14922)

2025-12-11 16:55:59 -08:00

structured_outputs.ipynb

[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)

2025-11-18 10:58:00 +08:00

tool_parser.ipynb

[Doc] Update DeepSeek-V3.2 document (#14321)

2025-12-02 18:19:39 -08:00

vlm_query.ipynb

vlm: refactor engine vlm params and support processor output as input (#14091)

2025-12-20 18:31:24 +08:00