3 people 4d643f6c7a [1/2] Support Qserve (#6457) ...

Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>

2025-05-21 19:48:59 -07:00

..

awq_kernel.cu

fix sgl-kernel cu118 build (#4872)

2025-03-28 17:23:51 -07:00

bmm_fp8.cu

…

fp8_blockwise_gemm_kernel.cu

Upgrade CUTLASS 4.0 (#6336)

2025-05-15 17:42:23 -07:00

fp8_gemm_kernel.cu

…

int8_gemm_kernel.cu

Fix shared memory OOM on sm86 GPUs. (#4797)

2025-03-26 10:41:53 -07:00

nvfp4_quant_entry.cu

Support FP4 gemm (1/2) (#3899)

2025-03-24 19:50:23 -07:00

nvfp4_quant_kernels.cu

fix sgl-kernel cu118 build (#4872)

2025-03-28 17:23:51 -07:00

nvfp4_scaled_mm_entry.cu

Support FP4 gemm (1/2) (#3899)

2025-03-24 19:50:23 -07:00

nvfp4_scaled_mm_kernels.cu

[Build] Fix cuda12.8 build error in nvfp4_scaled_mm_kernels.cu (#4953)

2025-03-31 12:00:34 -07:00

per_tensor_quant_fp8.cu

Speed up per token and per tensor quant by 15% (#4639)

2025-03-22 00:37:57 -07:00

per_token_group_quant_8bit.cu

[sgl-kernel] per token group quant support COLUMN MAJOR (#4817)

2025-04-02 18:29:59 -07:00

per_token_quant_fp8.cu

Speed up per token and per tensor quant by 15% (#4639)

2025-03-22 00:37:57 -07:00

qserve_w4a8_per_chn_gemm.cu

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00

qserve_w4a8_per_group_gemm.cu

[1/2] Support Qserve (#6457)

2025-05-21 19:48:59 -07:00