Commit Graph

756 Commits

Author SHA1 Message Date
Ma Mingfei
f90b400431 [CPU] add support for mamba causal conv1d for qwen3-next (#12309) 2025-12-04 13:41:42 +08:00
Ma Mingfei
46f21a5956 use faster covnersion from float8_e4m3fn to bfloat16 (#12316) 2025-12-04 12:34:05 +08:00
Qi Yuhang
16ff892c18 [sgl-kernel][Feat][B200][1/N] Support MXFP8 Grouped GEMM in Blackwell (#13731)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-12-04 10:09:09 +08:00
blzheng
974c562a25 [CPU] add fused_qkvzba_split_reshape_cat kernel for Qwen3-next (#12330) 2025-12-03 23:46:08 +08:00
Xuan Liao
c233e9d7a9 [CPU] Support chunk_gated_delta_rule kernel for Qwen3-Next (#12441) 2025-12-03 17:03:48 +08:00
Antonin Vidon
df1f31241b [sgl-kernel] fix runtime error while preloading CUDA runtime (#13089) 2025-12-02 23:03:51 +08:00
Xiaoyu Zhang
c5947ecd85 Opt moe align block size kernel (#14133) 2025-12-02 19:13:55 +08:00
Sulfur6-L8972
491f4fe8e1 Modify git tag for DeepGemm in sgl-kernel. (#14179) 2025-12-01 09:01:22 -08:00
sglang-bot
34035d8cd9 chore: bump sgl-kernel version to 0.3.18.post2 (#14229) 2025-12-02 00:50:40 +08:00
Xiaoyu Zhang
3de09aadbc Add new moe wna16 marlin gemm (#14122) 2025-12-01 23:07:53 +08:00
Fan Yin
412160f4c1 [sgl-kernel] fix b200 kernel ci (#13907)
Co-authored-by: HydraQYH <qyh820@outlook.com>
2025-11-30 10:15:37 -08:00
Zaili Wang
0b0b2607ca [CPU] Apply uv as package manager (#14106) 2025-11-28 10:36:53 -08:00
Yuan Luo
e12c78aab6 [sgl-kernel][1/2] Fused qk_norm_rope for Qwen3-MoE (#14036)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-28 12:25:15 +08:00
Baizhou Zhang
873382a910 [Tiny]Upgrade README for sgl-kernel (#13945) 2025-11-25 16:46:30 -08:00
sglang-bot
391a863b3f chore: bump sgl-kernel version to 0.3.18.post1 (#13942)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-11-25 15:31:53 -08:00
Fan Yin
36b1bcd242 [chore] update torch version to 2.9 (#12969)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-25 14:47:34 -08:00
Xiaoyu Zhang
ecefc7904f [sgl-kernel Code Clean] Remove useless lightning_attention kernel (#13819) 2025-11-24 18:26:25 +08:00
sglang-bot
a22104a676 chore: bump sgl-kernel version to 0.3.18 (#13816) 2025-11-23 17:24:54 -08:00
YAMY
53fffefd5d Upgrade flashmla kernel for NSA tp support (#13718) 2025-11-23 01:36:49 -08:00
Xiaoyu Zhang
fb04d43428 [kimi k2 thinking] Avoid useless torch.zeros_ (#13596)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-21 13:15:27 +08:00
alisonshao
64480ec712 Add sgl-kernel CI test for Blackwell (B200) (#13301) 2025-11-20 19:02:42 -08:00
YanbingJiang
acde21d8d5 Add fused_rmsnorm_gated_cpu kernel for CPU to support Qwen3-Next (#11577) 2025-11-21 01:33:31 +08:00
Roger Young
e72cf13693 Support moe topk sigmoid kernel (#13049)
Co-authored-by: xuebi <xuebi@minimaxi.com>
2025-11-20 00:24:37 +08:00
sglang-bot
b638abbae6 chore: bump sgl-kernel version to 0.3.17.post2 (#13542) 2025-11-18 22:08:23 -08:00
Baizhou Zhang
10969ae4be [chore] Disable ccache for sgl-kernel release (#13541) 2025-11-18 14:28:58 -08:00
Xiaoyu Zhang
820e13c9c1 [opt kimi k2 3/n] opt kimi_k2 moe_fused_gate kernel (#13374) 2025-11-18 15:36:31 +08:00
iLeGend
20e59f9510 Add FP32 dtype support for RoPE - Part1 (#13181) 2025-11-15 11:37:18 -08:00
sglang-bot
4a56fa5cf2 chore: bump sgl-kernel version to 0.3.17.post1 (#13325) 2025-11-15 23:36:32 +08:00
Xiaoyu Zhang
1d3d42bda0 [opt kimi k2 1 / n] Add kimi k2 moe fused gate (#13287) 2025-11-15 17:14:19 +08:00
Ke Bao
8e9f05ece1 Update marlin moe kernel interface (#13322) 2025-11-15 17:10:39 +08:00
Ke Bao
2a96e302cb Revert moe sum reduce for marlin moe (#13314) 2025-11-15 15:57:41 +08:00
wangyxbh
5027739f2c [CPU] Use covt_e4m3_bf16 to optim BF16 to FP8 convert (#12191) 2025-11-14 17:36:51 +08:00
Fan Yin
e9c0c55833 [sgl-kernel] clean up fa fetch in CMakeLists.txt (#12392) 2025-11-13 15:42:09 -08:00
Binyao Jiang
9db3add319 Update GDN causal conv1d cuda kernel - prepare for new changes (#13188) 2025-11-13 14:09:47 -08:00
Fan Yin
2966367a31 [sgl-kernel] support custom fp8 flashmla kernel (#13087) 2025-11-13 12:45:21 -08:00
Shu Wang
6664083522 Replace [silu_and_mul_]scaled_fp4_group_quant by Flashinfer equivalent (#12376) 2025-11-13 00:26:00 -08:00
haoyangli-amd
ea10a9d165 [bug][rocm]fix qr when variable inp (#11609)
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
2025-11-11 01:43:48 -08:00
Xiaoyu Zhang
547de8c774 [1 / 2] register weak_ref_tensor in sgl-kernel (#12999) 2025-11-10 22:12:59 +08:00
Xiaoyu Zhang
05559a4a90 Support hidden_dim % 4 == 0 in per_token_quant_fp8 (#12883) 2025-11-10 17:13:14 +08:00
huangtingwei
a5e5088dfb Fix errors of page head kernels in sgl-kernel for ROCm (#12604) 2025-11-10 15:15:50 +08:00
sglang-bot
a30f190762 chore: bump sgl-kernel version to 0.3.17 (#12931) 2025-11-10 14:54:02 +08:00
ishandhanani
885cfca273 ci: try to fix gpg error during kernel build (#12928) 2025-11-09 11:45:29 -08:00
sglang-bot
b2b26d4324 chore: bump sgl-kernel version to 0.3.16.post6 (#12889) 2025-11-09 09:16:28 +08:00
Ke Bao
44f594d832 Apply moe_reduce_sum kernel for fused_marlin_moe (#12888) 2025-11-09 01:31:05 +08:00
hlu1
b8ddc296f4 [sgl-kernel][Deepseek V3.2] Add row_starts to topk kernel (#12582)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-11-07 18:33:27 -08:00
jianan-gu
6e6009fb6b [CPU] Fix TP padding case with weight block size (#8243) 2025-11-07 03:24:48 +08:00
Ben Barsdell
fef3a6b63b Restore torch defaults between sgl-kernel tests (#11131) 2025-11-03 23:51:23 -08:00
fzyzcjy
193fbb0bce Super tiny add UT for copy_to_gpu_no_ce (#12270) 2025-11-04 09:40:51 +08:00
Yineng Zhang
0c3543d7d5 chore: upgrade flashinfer 0.5.0 (#12523)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-02 20:54:12 -08:00
Lianmin Zheng
20315697f4 move all get_stream in sgl_kernel to c++ to reduce the launch overhead (#12521) 2025-11-02 13:15:05 -08:00