[2/3] fix dsv3 awq issue (#4625)

Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com> Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>
2025-04-03 17:36:39 -07:00
parent e53bf190bc
commit d95269f9b3
8 changed files with 1139 additions and 42 deletions
@@ -496,6 +496,7 @@ class ServerArgs:
                "modelopt",
                "w8a8_int8",
                "w8a8_fp8",
+                "moe_wna16",
            ],
            help="The quantization method.",
        )