chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Feature] Apply Cublas Grouped Gemm kernel (#3629)

Browse Source
This commit is contained in:
Baizhou Zhang
2025-02-18 15:18:31 +08:00
committed by GitHub
parent 07ab4d4a2d
commit 67fc595bb8
9 changed files with 513 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
sgl-kernel/setup.py
+1
View File
@@ -102,6 +102,7 @@ sources = [
"src/sgl-kernel/csrc/eagle_utils.cu",
"src/sgl-kernel/csrc/speculative_sampling.cu",
"src/sgl-kernel/csrc/per_token_group_quant_fp8.cu",
"src/sgl-kernel/csrc/cublas_grouped_gemm.cu",
"3rdparty/flashinfer/csrc/activation.cu",
"3rdparty/flashinfer/csrc/bmm_fp8.cu",
"3rdparty/flashinfer/csrc/norm.cu",