Commit Graph

4 Commits

Author SHA1 Message Date
Xuchun Shang
af35023e65 [bug fix] fix ima with get_mla_kv_buffer_kernel overflow (#14224)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
2025-12-04 01:20:11 -08:00
Liangsheng Yin
ac43822634 Refactor eagle bigram key matching (#13714) 2025-11-22 20:40:42 +08:00
Teng Ma
b8ac4fcb51 [PD] feat: refactor custom mem pool and add barex pd support (#12332) 2025-11-09 18:51:34 +08:00
Ho-Ren (Jack) Chuang
76196b3cbf feat: Add FP4 (E2M1) KV Cache Support with Quantization Utilities for MLA (#10078)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
Co-authored-by: Yichen Wang <yichen.wang@bytedance.com>
2025-11-01 22:24:58 -07:00