Chunyuan WU 7eb47b0f3d [CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641) ...

Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>

2025-06-25 01:43:33 -07:00

..

allreduce

support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277)

2025-06-04 22:11:24 -07:00

attention

[fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184)

2025-06-14 12:45:41 -07:00

cpu

[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)

2025-06-25 01:43:33 -07:00

cutlass_extensions

…

elementwise

…

gemm

Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842)

2025-06-17 13:45:10 -07:00

grammar

[sgl-kernel] fix: fix cu118 compile error (#6123)

2025-05-08 14:26:51 -07:00

kvcacheio

kvcache io kernels and test case (#7382)

2025-06-23 11:58:59 -07:00

moe

Fuse sorted_token_ids padding to moe_align_block_size kernel (#7437)

2025-06-24 17:44:27 -07:00

speculative

Fix sampling for speculative decoding & simplify kernels (#7207)

2025-06-16 03:28:30 -07:00

common_extension.cc

Fuse sorted_token_ids padding to moe_align_block_size kernel (#7437)

2025-06-24 17:44:27 -07:00

flash_extension.cc

…

torch_extension_rocm.cc

Fuse sorted_token_ids padding to moe_align_block_size kernel (#7437)

2025-06-24 17:44:27 -07:00