[Feature] Enable return routed experts (#12162)

Co-authored-by: yizhang2077 <1109276519@qq.com> Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2025-12-21 15:16:43 +08:00
parent 8fe3e37468
commit bed301a5ac
27 changed files with 646 additions and 10 deletions
@@ -245,6 +245,7 @@ class LongcatFlashMoE(nn.Module):
            renormalize=False,
            use_grouped_topk=False,
            correction_bias=self.router.e_score_correction_bias.data,
+            layer_id=layer_id,
        )
        self.topk.forward = self.topk.forward_native