Xiaoyu Zhang 3de09aadbc Add new moe wna16 marlin gemm (#14122)

2025-12-01 23:07:53 +08:00

..

gptq

[2/n]decouple quantization implementation from vLLM dependency (#8112)

2025-08-14 03:19:03 -07:00

marlin

Add new moe wna16 marlin gemm (#14122)

2025-12-01 23:07:53 +08:00

awq_kernel.cu

Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842)

2025-06-17 13:45:10 -07:00

bmm_fp8.cu

move all get_stream in sgl_kernel to c++ to reduce the launch overhead (#12521)

2025-11-02 13:15:05 -08:00

dsv3_fused_a_gemm.cu

Remove annoying warnings in sgl kernel build (#9905)

2025-09-02 20:18:25 -07:00

dsv3_router_gemm_bf16_out.cu

[Kimi K2] dsv3_router_gemm supports NUM_EXPERTS == 384 (#8013)

2025-08-01 22:01:24 +08:00

dsv3_router_gemm_entry.cu

[Kimi K2] dsv3_router_gemm supports NUM_EXPERTS == 384 (#8013)

2025-08-01 22:01:24 +08:00

dsv3_router_gemm_float_out.cu

[Kimi K2] dsv3_router_gemm supports NUM_EXPERTS == 384 (#8013)

2025-08-01 22:01:24 +08:00

fp8_blockwise_gemm_kernel.cu

CUTLASS fp8 blockwise gemm support of sm120 (#9969)

2025-09-06 22:28:54 -07:00

fp8_gemm_kernel.cu

[sgl-kernel] feat: Support sm120 cutlass fp8 gemm kernel (#9403)

2025-10-26 23:45:45 -07:00

int8_gemm_kernel.cu

Optimize cutlass int8 gemm kernel for large M on SM89 Ada GPU (#10714)

2025-09-21 17:04:27 -07:00

math.hpp

[Perf] Tunings for SM100 FP8 CUTLASS kernel (#8818)

2025-08-13 21:59:22 -07:00

nvfp4_expert_quant.cu

[NVIDIA] Add new SMs support for Spark & Thor (#11287)

2025-10-22 02:02:24 +08:00

nvfp4_quant_entry.cu

support cutlass fp4 kernel in sm120 (#11737)

2025-10-29 12:25:16 -07:00

nvfp4_quant_kernels.cu

support cutlass fp4 kernel in sm120 (#11737)

2025-10-29 12:25:16 -07:00

nvfp4_quant.cuh

support cutlass fp4 kernel in sm120 (#11737)

2025-10-29 12:25:16 -07:00

nvfp4_scaled_mm_entry.cu

support cutlass fp4 kernel in sm120 (#11737)

2025-10-29 12:25:16 -07:00

nvfp4_scaled_mm_kernels.cu

support cutlass fp4 kernel in sm120 (#11737)

2025-10-29 12:25:16 -07:00

per_tensor_quant_fp8.cu

[AMD] Reorganize hip-related header files in sgl-kernel (#9320)

2025-08-18 16:53:44 -07:00

per_token_group_quant_8bit_v2.cu

Reland [1/2] Optimizations and refactors about quant kernel (#10312)

2025-10-11 15:59:03 +08:00

per_token_group_quant_8bit.cu

Reland [1/2] Optimizations and refactors about quant kernel (#10312)

2025-10-11 15:59:03 +08:00

per_token_quant_fp8.cu

Support hidden_dim % 4 == 0 in per_token_quant_fp8 (#12883)

2025-11-10 17:13:14 +08:00

qserve_w4a8_per_chn_gemm.cu

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00

qserve_w4a8_per_group_gemm.cu

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00