Commit Graph

18 Commits

Author SHA1 Message Date
Ke Bao
fb683be6eb Use attn tp group in embedding for more models (#17570) 2026-01-24 13:37:44 +08:00
Shifang Xu
d27f16f38a Fix EPLB + FP4 Quantization Compatibility Issue (#13715)
Co-authored-by: Shu Wang <shuw@nvidia.com>
2026-01-10 13:38:19 +08:00
Junrong Lin
bed301a5ac [Feature] Enable return routed experts (#12162)
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2025-12-21 15:16:43 +08:00
Yuhao Yao
e9e7f15eb5 [bugfix] fix TBO crashes when attn_tp_size > 1 (#13730)
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2025-12-11 18:18:40 -08:00
Tianhao Zhou
67e6ef4b2d feat: longcat flash add aux layers capture for eagle3 (#14161) 2025-11-30 00:50:55 -08:00
Tianhao Zhou
685b9d82bd fix: cuda graph issue while running longcat_flash (#14007) 2025-11-26 14:57:22 -08:00
fzyzcjy
33f08a98b0 Tiny refactor condition to requant scale ue8m0 (#13286) 2025-11-15 16:36:00 +08:00
Yang Kaiyong
61bfd9fa9b optm(checkpoint-engine): disable multi-thread loading when update weights (#12374)
Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
2025-11-07 21:30:04 +08:00
Cheng Wan
83087247d1 [hotfix] missing w13_weight_fp8 and w2_weight_fp8 in UE8M0 requantization (#12259) 2025-10-28 19:10:38 -07:00
Cheng Wan
5b214b50b6 [Refactor] move deep_gemm_wrapper out of quantization (#11784) 2025-10-17 18:57:54 -07:00
Chang Su
627974405d [Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685) 2025-10-17 16:49:46 -07:00
Liangsheng Yin
516738b096 Depreate global_server_args_dict (#11528) 2025-10-13 19:34:43 +08:00
Cheng Wan
1bdd010291 Revert "Deprecate global_server_args_dict" (#11520) 2025-10-12 17:40:40 -07:00
Liangsheng Yin
1083e7e3df Deprecate global_server_args_dict (#11331) 2025-10-13 01:20:47 +08:00
Yineng Zhang
7c876de7f5 fix: remove awq_dequantize deps (#10686) 2025-09-20 01:47:01 -07:00
Cheng Wan
4844fac91d Refactor TopK to ensure readability and extensibility (#9338) 2025-09-14 19:16:25 -07:00
Guoyuan Lin
b7361cc444 [Fix] fix the issue encountered when inference LongCat-Flash/MTP EP MoE on b200 (#9916) 2025-09-02 03:11:14 -07:00
Guoyuan Lin
5e194b2143 [Model] Support Meituan LongCat-Flash && LongCat-Flash-MTP (#9824) 2025-08-30 23:29:21 -07:00