Commit Graph

665 Commits

Author SHA1 Message Date
Yibo Cai
7871593cc8 [cpu] Implement all gather/reduce for arm64 cpu (#12527) 2025-12-08 19:03:04 +08:00
sglang-bot
4a62a0e3cd chore: bump sgl-kernel version to 0.3.19 (#14632) 2025-12-08 19:02:24 +08:00
Yuhao Yang
f72a77038f modify the sgl-kernel to be compatible with transformers 5.x. (#14625) 2025-12-08 00:39:00 -08:00
Qiaolin Yu
aeff0d386b Fix amd rope definition (#14556) 2025-12-07 23:47:03 -08:00
Xiaoyu Zhang
e5135b73f4 Add CUDA kernel size analysis tool for sgl-kernel optimization (#14544) 2025-12-07 15:29:41 +08:00
blzheng
d257bf87b9 [CPU] add mamba fla kernels for Qwen3-next (#12324) 2025-12-06 14:16:23 +08:00
sglang-bot
e11f795f63 chore: bump sgl-kernel version to 0.3.18.post3 (#14427)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-12-05 14:09:02 -08:00
Qiaolin Yu
cb8df87fc1 [1/2] Add rope kernel in sgl-kernel (#14334) 2025-12-04 16:45:44 +08:00
jianan-gu
70d2587324 [CPU] Optimize small oc GEMM for Qwen3-next on CPU (#12446)
Co-authored-by: Zheng, Beilei <beilei.zheng@intel.com>
2025-12-04 00:38:47 -08:00
Ma Mingfei
f90b400431 [CPU] add support for mamba causal conv1d for qwen3-next (#12309) 2025-12-04 13:41:42 +08:00
Ma Mingfei
46f21a5956 use faster covnersion from float8_e4m3fn to bfloat16 (#12316) 2025-12-04 12:34:05 +08:00
Qi Yuhang
16ff892c18 [sgl-kernel][Feat][B200][1/N] Support MXFP8 Grouped GEMM in Blackwell (#13731)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-12-04 10:09:09 +08:00
blzheng
974c562a25 [CPU] add fused_qkvzba_split_reshape_cat kernel for Qwen3-next (#12330) 2025-12-03 23:46:08 +08:00
Xuan Liao
c233e9d7a9 [CPU] Support chunk_gated_delta_rule kernel for Qwen3-Next (#12441) 2025-12-03 17:03:48 +08:00
Antonin Vidon
df1f31241b [sgl-kernel] fix runtime error while preloading CUDA runtime (#13089) 2025-12-02 23:03:51 +08:00
Xiaoyu Zhang
c5947ecd85 Opt moe align block size kernel (#14133) 2025-12-02 19:13:55 +08:00
Sulfur6-L8972
491f4fe8e1 Modify git tag for DeepGemm in sgl-kernel. (#14179) 2025-12-01 09:01:22 -08:00
sglang-bot
34035d8cd9 chore: bump sgl-kernel version to 0.3.18.post2 (#14229) 2025-12-02 00:50:40 +08:00
Xiaoyu Zhang
3de09aadbc Add new moe wna16 marlin gemm (#14122) 2025-12-01 23:07:53 +08:00
Fan Yin
412160f4c1 [sgl-kernel] fix b200 kernel ci (#13907)
Co-authored-by: HydraQYH <qyh820@outlook.com>
2025-11-30 10:15:37 -08:00
Zaili Wang
0b0b2607ca [CPU] Apply uv as package manager (#14106) 2025-11-28 10:36:53 -08:00
Yuan Luo
e12c78aab6 [sgl-kernel][1/2] Fused qk_norm_rope for Qwen3-MoE (#14036)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-28 12:25:15 +08:00
Baizhou Zhang
873382a910 [Tiny]Upgrade README for sgl-kernel (#13945) 2025-11-25 16:46:30 -08:00
sglang-bot
391a863b3f chore: bump sgl-kernel version to 0.3.18.post1 (#13942)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-11-25 15:31:53 -08:00
Fan Yin
36b1bcd242 [chore] update torch version to 2.9 (#12969)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-25 14:47:34 -08:00
Xiaoyu Zhang
ecefc7904f [sgl-kernel Code Clean] Remove useless lightning_attention kernel (#13819) 2025-11-24 18:26:25 +08:00
sglang-bot
a22104a676 chore: bump sgl-kernel version to 0.3.18 (#13816) 2025-11-23 17:24:54 -08:00
YAMY
53fffefd5d Upgrade flashmla kernel for NSA tp support (#13718) 2025-11-23 01:36:49 -08:00
Xiaoyu Zhang
fb04d43428 [kimi k2 thinking] Avoid useless torch.zeros_ (#13596)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-21 13:15:27 +08:00
alisonshao
64480ec712 Add sgl-kernel CI test for Blackwell (B200) (#13301) 2025-11-20 19:02:42 -08:00
YanbingJiang
acde21d8d5 Add fused_rmsnorm_gated_cpu kernel for CPU to support Qwen3-Next (#11577) 2025-11-21 01:33:31 +08:00
Roger Young
e72cf13693 Support moe topk sigmoid kernel (#13049)
Co-authored-by: xuebi <xuebi@minimaxi.com>
2025-11-20 00:24:37 +08:00
sglang-bot
b638abbae6 chore: bump sgl-kernel version to 0.3.17.post2 (#13542) 2025-11-18 22:08:23 -08:00
Baizhou Zhang
10969ae4be [chore] Disable ccache for sgl-kernel release (#13541) 2025-11-18 14:28:58 -08:00
Xiaoyu Zhang
820e13c9c1 [opt kimi k2 3/n] opt kimi_k2 moe_fused_gate kernel (#13374) 2025-11-18 15:36:31 +08:00
iLeGend
20e59f9510 Add FP32 dtype support for RoPE - Part1 (#13181) 2025-11-15 11:37:18 -08:00
sglang-bot
4a56fa5cf2 chore: bump sgl-kernel version to 0.3.17.post1 (#13325) 2025-11-15 23:36:32 +08:00
Xiaoyu Zhang
1d3d42bda0 [opt kimi k2 1 / n] Add kimi k2 moe fused gate (#13287) 2025-11-15 17:14:19 +08:00
Ke Bao
8e9f05ece1 Update marlin moe kernel interface (#13322) 2025-11-15 17:10:39 +08:00
Ke Bao
2a96e302cb Revert moe sum reduce for marlin moe (#13314) 2025-11-15 15:57:41 +08:00
wangyxbh
5027739f2c [CPU] Use covt_e4m3_bf16 to optim BF16 to FP8 convert (#12191) 2025-11-14 17:36:51 +08:00
Fan Yin
e9c0c55833 [sgl-kernel] clean up fa fetch in CMakeLists.txt (#12392) 2025-11-13 15:42:09 -08:00
Binyao Jiang
9db3add319 Update GDN causal conv1d cuda kernel - prepare for new changes (#13188) 2025-11-13 14:09:47 -08:00
Fan Yin
2966367a31 [sgl-kernel] support custom fp8 flashmla kernel (#13087) 2025-11-13 12:45:21 -08:00
Shu Wang
6664083522 Replace [silu_and_mul_]scaled_fp4_group_quant by Flashinfer equivalent (#12376) 2025-11-13 00:26:00 -08:00
haoyangli-amd
ea10a9d165 [bug][rocm]fix qr when variable inp (#11609)
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
2025-11-11 01:43:48 -08:00
Xiaoyu Zhang
547de8c774 [1 / 2] register weak_ref_tensor in sgl-kernel (#12999) 2025-11-10 22:12:59 +08:00
Xiaoyu Zhang
05559a4a90 Support hidden_dim % 4 == 0 in per_token_quant_fp8 (#12883) 2025-11-10 17:13:14 +08:00
huangtingwei
a5e5088dfb Fix errors of page head kernels in sgl-kernel for ROCm (#12604) 2025-11-10 15:15:50 +08:00
sglang-bot
a30f190762 chore: bump sgl-kernel version to 0.3.17 (#12931) 2025-11-10 14:54:02 +08:00