 Atream
|
9cfe78dd30
|
clean redundant code in previous PR (#12957)
|
2025-11-09 21:40:32 -08:00 |
|
|
|
ddd1440d0f
|
Refactor KTransformers heterogeneous compute with unified GPU-quantization backend (#12834)
Co-authored-by: Chen Hongtao <56470055+chenht2022@users.noreply.github.com>
Co-authored-by: chenht2022 <cht22@mails.tsinghua.edu.cn>
Co-authored-by: skqliao <skqliao@gmail.com>
Co-authored-by: ovowei <1913953267@qq.com>
|
2025-11-09 21:06:32 -08:00 |
|
|
Atream
|
2104d20eba
|
Temporarily fix missing routed_scaling_factor for CompressedTensorsWNA16MoEMethod (#12738)
|
2025-11-06 12:01:03 +08:00 |
|
|
|
627bac649c
|
Support Expert Deferral Mechanism in KTransformers (#12586)
Co-authored-by: Chen Hongtao <56470055+chenht2022@users.noreply.github.com>
Co-authored-by: chenht2022 <cht22@mails.tsinghua.edu.cn>
|
2025-11-05 13:41:52 -08:00 |
|
|
Atream
|
14d8064803
|
fix: Fix KTransformers hybrid inference with int8 quantization and format (#12536)
|
2025-11-03 04:59:39 -08:00 |
|
|
AtreamandJianwei Dong
|
7e6191c098
|
init support for KTransformers Heterogeneous Computing (#11487)
Co-authored-by: Jianwei Dong <1913953267@qq.com>
|
2025-10-21 00:17:02 -07:00 |
|
|
Atream
|
a589a07167
|
fix moe gate dtype, fix tbo, fix fake dispatch (#7825)
|
2025-07-19 22:13:46 -07:00 |
|
|
Atream
|
615553079d
|
Support Kimi K2 (#7940)
|
2025-07-11 00:02:21 -07:00 |
|
|
Atream
|
02bf31ef29
|
[fix] PD disaggregation when enable mtp and tp!=dp (#7420)
|
2025-06-21 12:03:11 -07:00 |
|
|
Atream
|
4f838c09cd
|
[PD] Transfer hidden states for mtp when disaggregation (#7242)
|
2025-06-19 11:22:47 -07:00 |
|