3 people 2c4feaf308 Add CUTLASS FP8 Blockscale MoE kernel for Hopper architecture (#7278) ...

Co-authored-by: HydraQYH <QYH820@Outlook.com>
Co-authored-by: TianQiLin666666 <1834987979@qq.com>

2025-07-02 23:27:03 -07:00

..

speculative

Fix sampling for speculative decoding & simplify kernels (#7207)

2025-06-16 03:28:30 -07:00

test_activation.py

sync flashinfer and update sgl-kernel tests (#3081)

2025-01-23 21:13:55 +08:00

test_apply_token_bitmask_inplace.py

fix sgl-kernel unit tests (#5666)

2025-04-23 01:18:30 -07:00

test_awq_dequant.py

Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842)

2025-06-17 13:45:10 -07:00

test_bmm_fp8.py

feat: integrate bmm_fp8 kernel into sgl-kernel (#3056)

2025-01-23 00:39:38 +08:00

test_custom_allreduce.py

sgl-kernel transfer custom allreduce from trt kernel to vllm kernel (#5079)

2025-04-05 14:23:20 -07:00

test_cutlass_mla.py

[fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184)

2025-06-14 12:45:41 -07:00

test_dsv3_fused_a_gemm.py

Add dsv3 fused a gemm to sgl-kernel (#7630)

2025-06-29 02:52:24 -07:00

test_dsv3_router_gemm.py

Add dsv3 router gemm kernel (#7627)

2025-06-29 23:31:55 -07:00

test_ep_moe_post_reorder_kernel.py

feat: integrate deepgemm into EPMoE (#6821)

2025-06-23 01:38:58 -07:00

test_ep_moe_pre_reorder_kernel.py

fix ep_moe_reorder kernel bugs (#6858)

2025-06-04 19:13:59 +08:00

test_ep_moe_silu_and_mul_kernel.py

[sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919)

2025-06-11 20:43:08 -07:00

test_flash_attention.py

fix: only enable flash_attn test on sm80 sm90 (#7289)

2025-06-17 16:56:41 -07:00

test_fp4_gemm.py

[Misc] Use pytest.mark.skipif in sgl-kernel test (#5137)

2025-04-07 21:35:14 -07:00

test_fp4_quantize.py

[Misc] Use pytest.mark.skipif in sgl-kernel test (#5137)

2025-04-07 21:35:14 -07:00

test_fp8_blockwise_gemm.py

[Misc] Clean sgl-kernel test (#5216)

2025-04-10 11:28:41 -07:00

test_fp8_blockwise_moe.py

Add CUTLASS FP8 Blockscale MoE kernel for Hopper architecture (#7278)

2025-07-02 23:27:03 -07:00

test_fp8_gemm.py

[Feature] use pytest for sgl-kernel (#4896)

2025-03-30 10:36:52 -07:00

test_int8_gemm.py

[Misc] Clean sgl-kernel test (#5216)

2025-04-10 11:28:41 -07:00

test_kvcacheio.py

kvcache io kernels and test case (#7382)

2025-06-23 11:58:59 -07:00

test_lightning_attention_decode.py

[Misc] Clean sgl-kernel test (#5216)

2025-04-10 11:28:41 -07:00

test_marlin_repack.py

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683)

2025-07-01 23:21:25 -07:00

test_merge_state_v2.py

Add main for merge state tests (#6492)

2025-05-21 21:56:25 -07:00

test_merge_state.py

Add main for merge state tests (#6492)

2025-05-21 21:56:25 -07:00

test_moe_align.py

Fuse sorted_token_ids padding to moe_align_block_size kernel (#7437)

2025-06-24 17:44:27 -07:00

test_moe_fused_gate.py

Set num_fused_shared_experts as num_shared_experts when shared_experts fusion is not disabled (#6736)

2025-06-04 15:53:22 -07:00

test_moe_topk_softmax.py

[Misc] Clean sgl-kernel test (#5216)

2025-04-10 11:28:41 -07:00

test_mscclpp.py

support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277)

2025-06-04 22:11:24 -07:00

test_norm.py

cleanup sgl-kernel kernels (#3175)

2025-01-27 19:11:01 +08:00

test_per_tensor_quant_fp8.py

update variable naming and comments for rocm (#5299)

2025-04-11 23:15:05 -07:00

test_per_token_group_quant_8bit.py

Support new DeepGEMM format in per token group quant (#7146)

2025-06-13 02:00:22 -07:00

test_per_token_quant_fp8.py

update variable naming and comments for rocm (#5299)

2025-04-11 23:15:05 -07:00

test_qserve_w4a8_per_chn_gemm.py

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00

test_qserve_w4a8_per_group_gemm.py

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00

test_rotary_embedding.py

[Misc] Clean sgl-kernel test (#5216)

2025-04-10 11:28:41 -07:00

test_sampling.py

[Feat] Update sgl-kernel flashinfer to latest main version (#5500)

2025-04-17 12:43:23 -07:00

test_sparse_flash_attn.py

fix: only enable flash_attn test on sm80 sm90 (#7289)

2025-06-17 16:56:41 -07:00