blzheng cd22aa27a9 [CPU] Add FP8 Bmm support (#9744) ...

Co-authored-by: Fan Yin <1106310035@qq.com>

2026-03-18 22:19:48 -07:00

..

aarch64

[cpu] Implement all gather/reduce for arm64 cpu (#12527)

2025-12-08 19:03:04 +08:00

mamba

[CPU] add mamba fla kernels for Qwen3-next (#12324)

2025-12-06 14:16:23 +08:00

model

[CPU] add fused_qkvzba_split_reshape_cat kernel for Qwen3-next (#12330)

2025-12-03 23:46:08 +08:00

x86_64

[cpu] Implement all gather/reduce for arm64 cpu (#12527)

2025-12-08 19:03:04 +08:00

activation.cpp

[CPU] Add gelu_and_mul kernel in sgl-kernel and add ut (#9300)

2025-09-08 23:23:13 -07:00

bmm.cpp

[CPU] Add FP8 Bmm support (#9744)

2026-03-18 22:19:48 -07:00

CMakeLists.txt

[CPU] Support chunk_gated_delta_rule kernel for Qwen3-Next (#12441)

2025-12-03 17:03:48 +08:00

common.h

[CPU] Optimize image preprocessor performance for Qwen2VLImageProcessorFast (#15168)

2026-03-18 22:18:15 -07:00

conv3d.cpp

optimize conv3d used in patch embedding (#16040)

2026-03-18 22:17:53 -07:00

decode.cpp

[CPU] optimize flash_attn_varlen_func (#15708)

2026-01-29 22:07:05 -08:00

extend.cpp

[CPU] optimize flash_attn_varlen_func (#15708)

2026-01-29 22:07:05 -08:00

flash_attn.cpp

[CPU] fix bug in AVX512 implementation of flash_attn_softmax (#20220)

2026-03-18 22:18:47 -07:00

flash_attn.h

[CPU] fix bug in AVX512 implementation of flash_attn_softmax (#20220)

2026-03-18 22:18:47 -07:00

gemm_fp8.cpp

[CPU] Add FP8 Bmm support (#9744)

2026-03-18 22:19:48 -07:00

gemm_int4.cpp

[CPU][INT4] Add INT4 kernels for CPU (#8226)

2026-01-29 22:30:13 -08:00

gemm_int8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

gemm.cpp

[CPU] Optimize small oc GEMM for Qwen3-next on CPU (#12446)

2025-12-04 00:38:47 -08:00

gemm.h

[CPU] Add FP8 Bmm support (#9744)

2026-03-18 22:19:48 -07:00

interface.cpp

[CPU] remove process_group from inputs of shm_allreduce and shm_allgather (#7486)

2025-06-30 21:54:11 -07:00

moe_fp8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

moe_int4.cpp

[CPU][INT4] Add INT4 kernels for CPU (#8226)

2026-01-29 22:30:13 -08:00

moe_int8.cpp

Optimize prefill performance on cpu backend (#8750)

2025-08-28 17:21:55 -07:00

moe.cpp

[CPU][INT4] Add INT4 kernels for CPU (#8226)

2026-01-29 22:30:13 -08:00

norm.cpp

[CPU] support LayerNorm with 3D shape (#15075)

2026-03-18 22:15:24 -07:00

numa_utils.cpp

[CPU] improve numa memory binding (#19666)

2026-03-18 22:15:50 -07:00

preprocessor.cpp

[CPU] Optimize image preprocessor performance for Qwen2VLImageProcessorFast (#15168)

2026-03-18 22:18:15 -07:00

qkv_proj.cpp

[CPU] Add FP8 Bmm support (#9744)

2026-03-18 22:19:48 -07:00

rope.cpp

[CPU] Add mrope kernel for Qwen3-vl (#12531)

2026-03-18 22:12:48 -07:00

shm.cpp

[cpu] Implement all gather/reduce for arm64 cpu (#12527)

2025-12-08 19:03:04 +08:00

shm.h

[cpu] Implement all gather/reduce for arm64 cpu (#12527)

2025-12-08 19:03:04 +08:00

topk.cpp

[CPU] Optimize Qwen3-next model on CPU (#12525)

2026-01-29 22:03:58 -08:00

torch_extension_cpu.cpp

[CPU] Add FP8 Bmm support (#9744)

2026-03-18 22:19:48 -07:00

vec_pack.h

[CPU] optimize flash_attn_varlen_func (#15708)

2026-01-29 22:07:05 -08:00

vec.h

[CPU] optimize flash_attn_varlen_func (#15708)

2026-01-29 22:07:05 -08:00