fzyzcjyandYineng Zhang 21337b22b9 Reland [1/2] Optimizations and refactors about quant kernel (#10312) ...

Co-authored-by: Yineng Zhang <me@zhyncs.com>

2025-10-11 15:59:03 +08:00

..

gptq

…

marlin

…

awq_kernel.cu

…

bmm_fp8.cu

…

dsv3_fused_a_gemm.cu

…

dsv3_router_gemm_bf16_out.cu

…

dsv3_router_gemm_entry.cu

…

dsv3_router_gemm_float_out.cu

…

fp8_blockwise_gemm_kernel.cu

CUTLASS fp8 blockwise gemm support of sm120 (#9969)

2025-09-06 22:28:54 -07:00

fp8_gemm_kernel.cu

…

int8_gemm_kernel.cu

Optimize cutlass int8 gemm kernel for large M on SM89 Ada GPU (#10714)

2025-09-21 17:04:27 -07:00

math.hpp

[Perf] Tunings for SM100 FP8 CUTLASS kernel (#8818)

2025-08-13 21:59:22 -07:00

nvfp4_expert_quant.cu

…

nvfp4_quant_entry.cu

…

nvfp4_quant_kernels.cu

…

nvfp4_quant.cuh

…

nvfp4_scaled_mm_entry.cu

…

nvfp4_scaled_mm_kernels.cu

Optimize nvfp4 block scaled gemm kernel when M is small. (#10101)

2025-09-06 22:31:00 -07:00

per_tensor_quant_fp8.cu

…

per_token_group_quant_8bit_v2.cu

Reland [1/2] Optimizations and refactors about quant kernel (#10312)

2025-10-11 15:59:03 +08:00

per_token_group_quant_8bit.cu

Reland [1/2] Optimizations and refactors about quant kernel (#10312)

2025-10-11 15:59:03 +08:00

per_token_quant_fp8.cu

…

qserve_w4a8_per_chn_gemm.cu

…

qserve_w4a8_per_group_gemm.cu

…