Shi Shuai 817d43705c feat: support ep size < 32 for sgl kernel (#4348)

2025-03-12 20:50:46 -07:00

..

bench_awq_dequant.py

Add awq dequantize kernel to sgl with 1x to 3x speedup (#4104)

2025-03-12 00:10:02 -07:00

bench_cublas_grouped_gemm.py

…

bench_fp8_blockwise_gemm.py

…

bench_fp8_gemm.py

…

bench_int8_gemm.py

…

bench_lightning_attention_decode.py

…

bench_moe_align_block_size.py

feat: support ep size < 32 for sgl kernel (#4348)

2025-03-12 20:50:46 -07:00

bench_per_tensor_quant_fp8.py

…

bench_per_token_group_quant_fp8.py

…

bench_per_token_quant_fp8.py

…