Chunan Zeng 65c24c28f9 [Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396)

2025-03-23 23:44:17 -07:00

..

bench_awq_dequant.py

…

bench_cublas_grouped_gemm.py

…

bench_fp8_blockwise_gemm.py

…

bench_fp8_gemm.py

…

bench_int8_gemm.py

…

bench_lightning_attention_decode.py

[Fix] use torch.cat instead of torch.concat to prevent entering the Autograd backends. (#4466)

2025-03-16 00:02:47 -07:00

bench_moe_align_block_size.py

…

bench_moe_topk_softmax.py

…

bench_per_tensor_quant_fp8.py

…

bench_per_token_group_quant_8bit.py

[Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396)

2025-03-23 23:44:17 -07:00

bench_per_token_quant_fp8.py

…