chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

[NPU] bugfix for model Qwen3-Coder-Next at weight shape transpose for npu. (#18700)

Browse Source 
Co-authored-by: McZyWu <zhuoyun.wu.23@ucl.ac.uk>
This commit is contained in:
Hexq0210
2026-02-25 15:46:20 +08:00
committed by GitHub
parent a1b39c1c26
commit d0bb140034
2 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
python/sglang/srt/hardware_backend/npu/quantization/fused_moe_method_npu.py
View File

@@ -118,7 +118,7 @@ def npu_fused_moe_without_routing_weights_bf16(
# gmm1: gate_up_proj
hidden_states = torch.ops.npu.npu_grouped_matmul(
x=[hidden_states],
weight=[layer.w13_weight.permute(0, 2, 1)],
weight=[layer.w13_weight],
split_item=2,
group_list_type=group_list_type,
group_type=0,
@@ -129,7 +129,7 @@ def npu_fused_moe_without_routing_weights_bf16(
# gmm2: down_proj
hidden_states = torch.ops.npu.npu_grouped_matmul(
x=[hidden_states],
weight=[layer.w2_weight.permute(0, 2, 1)],
weight=[layer.w2_weight],
split_item=2,
group_list_type=group_list_type,
group_type=0,