Commit Graph
16 Commits
Author SHA1 Message Date
Liangsheng YinandChang Huaixin 2274bfebb1 [PD-Disagg] Support query dp rank from bootstrap server. (#19168)
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
2026-02-23 10:59:30 -08:00
Teng MaandShangming Cai c8212b9fac [PD] doc: Document SGLANG_MOONCAKE_CUSTOM_MEM_POOL and supported values (#18259)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-02-05 03:03:33 +00:00
zackyoray d275d47973 [NIXL] Add custom NIXL backend selection for KVManager (#17146)
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
2026-01-26 14:35:38 +08:00
zijiexia 4ecd9afde9 [Docs] Rename SGLang Router to SGLang Model Gateway (#17436) 2026-01-20 12:31:10 -08:00
James ae0baefb94 [NPU] upgrade npu mf_apater plugin (#15853) 2026-01-13 09:02:10 +08:00
Vikramandjinke15 42271376d1 [bug fix] use npu phy id in container env (#14266)
Co-authored-by: jinke15 <jinke15@jd.com>
2025-12-03 11:33:43 +08:00
Lianmin Zheng bc3d2a85af [Minor] update docs (#14212) 2025-12-01 02:33:58 -08:00
Shangming Cai a2ba0bc3df Tiny clean up for PD module and doc (#11747)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-10-20 11:52:42 +08:00
Xiaoyu Zhang 88a6f9dab5 bench_serving support PD Disaggregation (#11542) 2025-10-13 19:43:26 -07:00
Shangming Cai 0a7c4bded7 [Doc] Update mooncake nvlink transport doc for PD disaggregation (#11321)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-10-08 00:59:29 -07:00
Philip Kiely - Baseten 7f028b07c4 Fix formatting in long code blocks (#10528) 2025-09-16 12:02:05 -07:00
Liangsheng Yin 6e95f5e5bd Simplify Router arguments passing and build it in docker image (#9964) 2025-09-05 12:13:55 +08:00
Simo Lin 1ce30dd13e [router] update router documentation (#9121) 2025-08-12 13:16:34 -07:00
Liangsheng Yin f9afa7dceb Fix docs for clip max new tokens (#9082) 2025-08-11 13:15:21 -07:00
Jimmy 0d9e89ec69 [PD]decode: add CLIP_MAX_NEW_TOKEN for pop_preallocated (#8866) 2025-08-11 13:08:11 -07:00
Lianmin Zheng 2449a0afe2 Refactor the docs (#9031) 2025-08-10 19:49:45 -07:00