Commit Graph
23 Commits
Author SHA1 Message Date
Kaixi Hou 85486b6f6f [NVIDIA] Add Flashinfer MoE blockscale fp8 backend (#8036) 2025-07-27 00:34:41 -07:00
b7094a5ef1 model: support intern-s1 (#8350)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zxy <zhou0493@e.ntu.edu.sg>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2025-07-26 13:48:51 -07:00
Cheng Wan c0fb25e949 DP Enhancement (#8280) 2025-07-24 21:36:21 -07:00
Cheng Wan 15ad6c9086 [1/N] MoE Refactor: refactor select_experts (#7966) 2025-07-19 00:51:15 -07:00
Xiaoze Fanandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 570d33437b [Feature] Layer-wise Prefill (#7634)
Signed-off-by: jason-fxz <jason341132@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-07-17 01:57:46 +08:00
Cheng Wan 8fc910db03 DP Attention with Auto DeepEP Dispatch (#7222) 2025-07-05 01:54:24 -07:00
1964c325de [feat] Support EAGLE3 for Qwen (#7745)
Co-authored-by: 纬杭 <ximing.wxm@antgroup.com>
Co-authored-by: zyksir <zyksir@outlook.com>
2025-07-04 19:50:28 -07:00
yilian49 c01a1df588 [Bug] add flashinfer bool check for fusedmoe in Qwen moe models (#7723) 2025-07-03 11:32:11 -07:00
Yi Zhangandispobock 264dc6e744 [optimize] add two stream norm for qwen3 (#7740)
Co-authored-by: ispobock <ispobaoke@gmail.com>
2025-07-03 09:59:17 -07:00
fzyzcjy 0c9c6c75a8 Move files related to EPLB (#7580) 2025-06-29 15:39:38 -07:00
fzyzcjy f6ebba537a Support both approximate and exact expert distribution collection (#6964) 2025-06-09 20:56:17 -07:00
fzyzcjy 5aff1e9392 Fix Qwen3MoE missing token padding optimization (#6820) 2025-06-05 00:04:59 -07:00
fzyzcjy 0ea330ca34 Fix wrong weight reference in dynamic EPLB (#6818) 2025-06-02 23:26:04 -07:00
iLeGend e06b076105 Fix PP for Qwen3 MoE (#6709) 2025-05-28 23:06:18 -07:00
Yi Zhang b18416fbf8 Fix qwen3 tbo/dp-lm-head (#6652) 2025-05-27 00:38:27 -07:00
Yi Zhang f9bab3d591 qwen3moe support two batch overlap (#6598) 2025-05-25 23:08:16 -07:00
Yi Zhang 65f091310c refactor qwen moe code, use communicator to support tp+dp (#6581) 2025-05-25 23:01:10 -07:00
Yi Zhang e6f113569e support eplb for qwen3 (#6533) 2025-05-23 18:31:30 -07:00
lukec fc0e3b9174 Support qwen3 deepep (#6120) 2025-05-22 11:04:45 -07:00
libra 11553c1a37 Add pipeline parallelism for Qwen2 and Qwen3 Model (#6250) 2025-05-18 00:42:55 -07:00
4bd2952a37 feat: add dp attention support for Qwen 2/3 MoE models, fixes #6088 (#6121)
Co-authored-by: King.Zevin <zevin@mail.ustc.edu.cn>
Co-authored-by: Yi Zhang <1109276519@qq.com>
2025-05-16 14:44:10 -07:00
laixinandsleepcoo e330f2b86c [qwen3] support qwen3 ep moe (#5917)
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
2025-04-30 09:15:21 -07:00
yhyang201 4db463b1ad [Model] Adding Qwen3 and Qwen3MoE (#4693) 2025-04-18 09:51:29 -07:00