Commit Graph
11 Commits
Author SHA1 Message Date
laoyao0822 101100e25b feat(eplb): add eplb warmup-only mode
Freeze expert layout after the initial EPLB warmup rebalances so heavy workloads avoid recurring rebalance memory spikes and OOMs.
2026-04-08 06:46:26 +08:00
Yoray ZackandBarak Biber 9991debde3 [Feature] Integrate Elastic NIXL-EP into SGLang (#19248)
Signed-off-by: Barak Biber <bbiber@nvidia.com>
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Barak Biber <bbiber@nvidia.com>
2026-03-11 17:37:43 +08:00
Ziang Li 76ee4bb98c [FlashInfer v0.6.4] [RL] Integrate FlashInfer mxfp8 gemm, MoE, and routed MoE (#19537) 2026-03-10 15:37:57 -07:00
husf c52578c7fd 【docs】【NPU】Update Expert Parallelism docs for Ascend NPU (#17940) 2026-01-30 23:42:11 -05:00
f1384f5293 Integration mori backend for EP a2a data communication (#17012)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
Co-authored-by: billishyahao <bill.he@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
2026-01-28 19:07:34 -08:00
Trevor Morris 2c2c4e446b [NVIDIA] Add flashinfer all-to-all MOE dispatcher (#14668) 2026-01-24 22:59:55 +08:00
zijiexia 166396ca4c [Docs] minor update on ep docs (#17242) 2026-01-16 18:20:47 -08:00
Baizhou Zhang 208e6a9dac [Doc]Update MTP moe backends for EP document (#16013) 2025-12-28 19:36:23 +08:00
b8zhongandBrayden Zhong 65c8568c4a sync attention, deepseek doc (#14335)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
2025-12-02 21:19:40 -08:00
b8zhongandBrayden Zhong e6420100ee sync attention doc and ep doc to doctree (#14257)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
2025-12-01 21:15:22 -08:00
Cheng Wan bf10869203 [Doc] Add an Introduction to Expert Parallelism (#13783) 2025-11-24 14:46:51 -08:00