Commit Graph

722 Commits

Author SHA1 Message Date
Fan Yin
2966367a31 [sgl-kernel] support custom fp8 flashmla kernel (#13087) 2025-11-13 12:45:21 -08:00
Shu Wang
6664083522 Replace [silu_and_mul_]scaled_fp4_group_quant by Flashinfer equivalent (#12376) 2025-11-13 00:26:00 -08:00
haoyangli-amd
ea10a9d165 [bug][rocm]fix qr when variable inp (#11609)
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
2025-11-11 01:43:48 -08:00
Xiaoyu Zhang
547de8c774 [1 / 2] register weak_ref_tensor in sgl-kernel (#12999) 2025-11-10 22:12:59 +08:00
Xiaoyu Zhang
05559a4a90 Support hidden_dim % 4 == 0 in per_token_quant_fp8 (#12883) 2025-11-10 17:13:14 +08:00
huangtingwei
a5e5088dfb Fix errors of page head kernels in sgl-kernel for ROCm (#12604) 2025-11-10 15:15:50 +08:00
sglang-bot
a30f190762 chore: bump sgl-kernel version to 0.3.17 (#12931) 2025-11-10 14:54:02 +08:00
ishandhanani
885cfca273 ci: try to fix gpg error during kernel build (#12928) 2025-11-09 11:45:29 -08:00
sglang-bot
b2b26d4324 chore: bump sgl-kernel version to 0.3.16.post6 (#12889) 2025-11-09 09:16:28 +08:00
Ke Bao
44f594d832 Apply moe_reduce_sum kernel for fused_marlin_moe (#12888) 2025-11-09 01:31:05 +08:00
hlu1
b8ddc296f4 [sgl-kernel][Deepseek V3.2] Add row_starts to topk kernel (#12582)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-11-07 18:33:27 -08:00
jianan-gu
6e6009fb6b [CPU] Fix TP padding case with weight block size (#8243) 2025-11-07 03:24:48 +08:00
Ben Barsdell
fef3a6b63b Restore torch defaults between sgl-kernel tests (#11131) 2025-11-03 23:51:23 -08:00
fzyzcjy
193fbb0bce Super tiny add UT for copy_to_gpu_no_ce (#12270) 2025-11-04 09:40:51 +08:00
Yineng Zhang
0c3543d7d5 chore: upgrade flashinfer 0.5.0 (#12523)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-02 20:54:12 -08:00
Lianmin Zheng
20315697f4 move all get_stream in sgl_kernel to c++ to reduce the launch overhead (#12521) 2025-11-02 13:15:05 -08:00
bingps
15ed27d7d4 [Fix] concat_mla_absorb_q_kernel fails for long inputs (#12453) 2025-11-02 11:52:06 -08:00
sglang-bot
a920b9dace chore: bump sgl-kernel version to 0.3.16.post5 (#12511) 2025-11-02 14:08:11 +08:00
Xiaoyu Zhang
95191ebdca Migrate weak_ref_tensor to sgl-kernel (#12505) 2025-11-02 10:55:39 +08:00
Baizhou Zhang
2b7bf11bd2 [Hotfix] Remove extra comment in sgl-kernel README (#12500) 2025-11-01 12:22:45 -07:00
Baizhou Zhang
566ade0388 [CI] Build aarch64 kernels for sgl-kernel test (#12480) 2025-11-01 11:55:42 -07:00
yinghui
a80bcb5a68 Add env var to disable FA4 warmup (#12430) 2025-10-31 12:25:00 -07:00
Lianmin Zheng
2d5605e89b Fix ci install to allow prerelease (#12449) 2025-10-31 02:22:15 -07:00
Lianmin Zheng
c0652d907b Clean up sgl kernel (#12413)
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2025-10-31 01:13:34 -07:00
Fan Yin
39cee0fed2 [sgl-kernel] upd deepgemm hash to rebased commit (#11960) 2025-10-30 07:19:00 -07:00
AichenF
ed1044ac1b support cutlass fp4 kernel in sm120 (#11737) 2025-10-29 12:25:16 -07:00
zejunchen-zejun
8a6838212a [Fix] fix type issue of env flag value MODELOPT_MAX_TOKENS_PER_EXPERT (#11709)
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>
2025-10-29 09:44:05 -07:00
Baizhou Zhang
685c06451f [ci] Try fixing broken CIs (#12317) 2025-10-29 01:13:51 -07:00
weiliang
88596739a4 Support running FP4 Deepseek on SM120. (#11708) 2025-10-27 17:37:49 -07:00
Qi Yuhang
ce112c07fe [sgl-kernel][4/N]Support Expert Specialization Grouped GEMM (#12080) 2025-10-27 01:20:01 -07:00
Joonchen Liau
f7dc2f334b [sgl-kernel] feat: Support sm120 cutlass fp8 gemm kernel (#9403) 2025-10-26 23:45:45 -07:00
Baizhou Zhang
75c09e1ffe [Fix] Fix cu130 sgl-kernel wheel renaming (#12173) 2025-10-26 22:44:05 -07:00
huangtingwei
3e6281d0aa [HiCache]Page head layout IO kernel (#11615) 2025-10-26 15:53:50 +08:00
Kai-Hsun Chen
6371f7af27 [quantization] AWQ Marlin doesn't work when dtype is bfloat16 (#11494)
Signed-off-by: Kai-Hsun Chen <khchen@x.ai>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2025-10-26 15:49:45 +08:00
DarkSharpness
e8b71445c0 [Misc] Improve the error message of failed import (#12119) 2025-10-25 12:09:05 -07:00
sglang-bot
a04212f128 chore: bump sgl-kernel version to 0.3.16.post4 (#12103)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-10-24 22:04:14 -07:00
Fan Yin
433c622e80 [Docs] update sgl-kernel readme (#11379) 2025-10-24 19:31:14 -07:00
Jinwu
13bf565d60 [2/N]Support DeepSeek-R1 w4a8 low latency deepep (#8464)
Co-authored-by: Hank Han <hanhan7630@outlook.com>
Co-authored-by: Shangchuan Huang <2510421000@qq.com>
2025-10-24 17:41:16 -07:00
blzheng
13fb8b5489 [CPU] Optimize FP16 decode_attention_cpu (#10652) 2025-10-22 21:39:51 -07:00
Zaili Wang
007b849b0e [CPU] misc updates (#11906) 2025-10-22 21:10:05 -07:00
Johnny
e7aa4664b3 [NVIDIA] Build CUDA 13 (#11299)
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-22 20:03:12 -07:00
Johnny
4b65ed42cc [NVIDIA] upstream FA4 and fix cccl path (#11929) 2025-10-21 21:18:25 -07:00
Fan Yin
23afdfd1c2 [sgl-kernel] support flashmla libtorch (#11717) 2025-10-21 21:17:50 -07:00
Serge Panev
2b1da821b5 [NVIDIA] Add new SMs support for Spark & Thor (#11287)
Signed-off-by: Serge Panev <spanev@nvidia.com>
2025-10-22 02:02:24 +08:00
Yuan Luo
271d3d0d50 Support mrope triton kernel and add unit test (#11722)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
2025-10-20 11:51:07 +08:00
sglang-bot
283c8ba031 chore: bump sgl-kernel version to 0.3.16.post3 (#11733) 2025-10-19 21:44:15 -05:00
Kangyan-Zhou
27a223aba4 Improve Kernel Build Time (#11508) 2025-10-19 18:11:48 -07:00
hlu1
3b80232d06 [DeepseekV32] Add fast_topk_transform_ragged_fused kernel (#11815)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-10-19 17:13:39 -07:00
Johnny
252dc4e112 [NVIDIA] FA3/FA4 Fix (#11606)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-19 17:10:10 -07:00
fzyzcjy
a27825ae01 Support not officially supported high sgl-kernel version with low srt version (#11786) 2025-10-19 16:11:59 +08:00