3 people 2c4feaf308 Add CUTLASS FP8 Blockscale MoE kernel for Hopper architecture (#7278) ...

Co-authored-by: HydraQYH <QYH820@Outlook.com>
Co-authored-by: TianQiLin666666 <1834987979@qq.com>

2025-07-02 23:27:03 -07:00

..

bench_awq_dequant.py

…

bench_cutlass_mla.py

[fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184)

2025-06-14 12:45:41 -07:00

bench_dsv3_fused_a_gemm.py

Add dsv3 fused a gemm to sgl-kernel (#7630)

2025-06-29 02:52:24 -07:00

bench_dsv3_router_gemm.py

Add dsv3 router gemm kernel (#7627)

2025-06-29 23:31:55 -07:00

bench_fp8_blockwise_gemm.py

refactor apply_w8a8_block_fp8_linear in fp (#6545)

2025-05-29 00:15:11 -07:00

bench_fp8_blockwise_group_gemm.py

Add CUTLASS FP8 Blockscale MoE kernel for Hopper architecture (#7278)

2025-07-02 23:27:03 -07:00

bench_fp8_gemm.py

…

bench_int8_gemm.py

…

bench_lightning_attention_decode.py

…

bench_moe_align_block_size.py

Fuse sorted_token_ids padding to moe_align_block_size kernel (#7437)

2025-06-24 17:44:27 -07:00

bench_moe_ep_post_reorder.py

feat: integrate deepgemm into EPMoE (#6821)

2025-06-23 01:38:58 -07:00

bench_moe_ep_pre_reorder.py

fix ep_moe_reorder kernel bugs (#6858)

2025-06-04 19:13:59 +08:00

bench_moe_fused_gate.py

…

bench_moe_silu_and_mul.py

[sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919)

2025-06-11 20:43:08 -07:00

bench_moe_topk_softmax.py

…

bench_per_tensor_quant_fp8.py

update variable naming and comments for rocm (#5299)

2025-04-11 23:15:05 -07:00

bench_per_token_group_quant_8bit.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

bench_per_token_quant_fp8.py

update variable naming and comments for rocm (#5299)

2025-04-11 23:15:05 -07:00

bench_qserve_w4a8_gemm.py

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00