Commit Graph

686 Commits

Author SHA1 Message Date
Yingchun Lai
828cd8936f Introduce sgl-kernel Dockerfile (#14066) 2026-01-04 11:19:08 -08:00
Yineng Zhang
5595ae142c docs: fix markdown preview (#16236) 2025-12-31 12:43:57 -08:00
shuwenn
c0fc7a89e7 [sgl-kernel] fix: make sgl-kernel build respect MAX_JOBS (#15575) 2025-12-31 10:44:45 +08:00
Xiaoyu Zhang
de2f2880b5 [JIT sgl-kernel] Jit support per tensor quant (#15709) 2025-12-25 16:24:37 +08:00
sglang-bot
a39126672a chore: bump sgl-kernel version to 0.3.20 (#15564) 2025-12-21 13:15:23 -08:00
Xiaoyu Zhang
7fa4906f4f [sgl-kernel] Streamline kernel size report (Top 20 only) and clean up (#15552) 2025-12-21 10:00:47 +08:00
Hubert Lu
51e2eaa458 [AMD] Support fast_topk kernels in sgl-kernel (#15172) 2025-12-19 22:19:09 -08:00
66RING
46be74b4b4 [diffusion] kernel: timestep embedding kernel implementation (#12995)
Co-authored-by: 戚余航 <qiyuhang@bytedance.com>
Co-authored-by: Qi Yuhang <45795032+HydraQYH@users.noreply.github.com>
2025-12-19 20:59:50 +08:00
Fan Yin
65c098592d [sgl-kernel] chore: update deepgemm version (#13402) 2025-12-19 00:20:24 -08:00
sunxxuns
f2d64e6782 [amd] Add deterministic all-reduce kernel for AMD (ROCm) (#15340)
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
2025-12-18 23:36:03 -08:00
Bruce-x-1997
793c96c3d2 [perf]optimize w4afp8 kernel on deepseek-v3-0324 (#12921)
Signed-off-by: bruce.xu <bruce.x@gmicloud.ai>
2025-12-18 18:13:22 +08:00
Kevin_Xiong
4792d1f452 [sgl-kernel][1/2] Fused qk_norm_rope for GLM4.6 (#15141) 2025-12-18 17:07:04 +08:00
Xiaoyu Zhang
56d12b4aea Fix warp illegal instruction in kimi k2 thinking PCG (#15306) 2025-12-18 16:58:23 +08:00
MarcoDWei
ef7c29acd7 Fix issue: ENABLE_BELOW_SM90 cannot be enabled on aarch64 CPU (#12967) 2025-12-18 13:26:42 +08:00
b8zhong
4b8901ac0f Update FP4 GEMM Benchmark (#14449) 2025-12-16 23:04:56 -08:00
hlu1
930705863f [sgl-kernel] Update flashmla to include fp8 sparse_mla optimizations (#15242) 2025-12-16 15:12:19 -08:00
blzheng
e27635a02d [CPU] Add 4D input support for ROPE in sgl-kernel (#9337) 2025-12-16 17:27:39 +08:00
blzheng
d16ff357db [CPU] Add Gemma3RMSNorm kernel in sgl-kernel and add ut (#9324) 2025-12-15 00:24:02 -08:00
Yineng Zhang
36e7c8c59f docs: update usage (#15142) 2025-12-14 18:42:21 -08:00
zyl_keep_moving
a9ce1623cd [kernel][moe] add moe topk fast (#13969)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2025-12-14 22:26:40 +08:00
Zaili Wang
d6bd2d1126 [CPU] layernorm & fused add-layernorm kernels (#14074) 2025-12-11 16:58:23 -08:00
Yibo Cai
7871593cc8 [cpu] Implement all gather/reduce for arm64 cpu (#12527) 2025-12-08 19:03:04 +08:00
sglang-bot
4a62a0e3cd chore: bump sgl-kernel version to 0.3.19 (#14632) 2025-12-08 19:02:24 +08:00
Yuhao Yang
f72a77038f modify the sgl-kernel to be compatible with transformers 5.x. (#14625) 2025-12-08 00:39:00 -08:00
Qiaolin Yu
aeff0d386b Fix amd rope definition (#14556) 2025-12-07 23:47:03 -08:00
Xiaoyu Zhang
e5135b73f4 Add CUDA kernel size analysis tool for sgl-kernel optimization (#14544) 2025-12-07 15:29:41 +08:00
blzheng
d257bf87b9 [CPU] add mamba fla kernels for Qwen3-next (#12324) 2025-12-06 14:16:23 +08:00
sglang-bot
e11f795f63 chore: bump sgl-kernel version to 0.3.18.post3 (#14427)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-12-05 14:09:02 -08:00
Qiaolin Yu
cb8df87fc1 [1/2] Add rope kernel in sgl-kernel (#14334) 2025-12-04 16:45:44 +08:00
jianan-gu
70d2587324 [CPU] Optimize small oc GEMM for Qwen3-next on CPU (#12446)
Co-authored-by: Zheng, Beilei <beilei.zheng@intel.com>
2025-12-04 00:38:47 -08:00
Ma Mingfei
f90b400431 [CPU] add support for mamba causal conv1d for qwen3-next (#12309) 2025-12-04 13:41:42 +08:00
Ma Mingfei
46f21a5956 use faster covnersion from float8_e4m3fn to bfloat16 (#12316) 2025-12-04 12:34:05 +08:00
Qi Yuhang
16ff892c18 [sgl-kernel][Feat][B200][1/N] Support MXFP8 Grouped GEMM in Blackwell (#13731)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-12-04 10:09:09 +08:00
blzheng
974c562a25 [CPU] add fused_qkvzba_split_reshape_cat kernel for Qwen3-next (#12330) 2025-12-03 23:46:08 +08:00
Xuan Liao
c233e9d7a9 [CPU] Support chunk_gated_delta_rule kernel for Qwen3-Next (#12441) 2025-12-03 17:03:48 +08:00
Antonin Vidon
df1f31241b [sgl-kernel] fix runtime error while preloading CUDA runtime (#13089) 2025-12-02 23:03:51 +08:00
Xiaoyu Zhang
c5947ecd85 Opt moe align block size kernel (#14133) 2025-12-02 19:13:55 +08:00
Sulfur6-L8972
491f4fe8e1 Modify git tag for DeepGemm in sgl-kernel. (#14179) 2025-12-01 09:01:22 -08:00
sglang-bot
34035d8cd9 chore: bump sgl-kernel version to 0.3.18.post2 (#14229) 2025-12-02 00:50:40 +08:00
Xiaoyu Zhang
3de09aadbc Add new moe wna16 marlin gemm (#14122) 2025-12-01 23:07:53 +08:00
Fan Yin
412160f4c1 [sgl-kernel] fix b200 kernel ci (#13907)
Co-authored-by: HydraQYH <qyh820@outlook.com>
2025-11-30 10:15:37 -08:00
Zaili Wang
0b0b2607ca [CPU] Apply uv as package manager (#14106) 2025-11-28 10:36:53 -08:00
Yuan Luo
e12c78aab6 [sgl-kernel][1/2] Fused qk_norm_rope for Qwen3-MoE (#14036)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-28 12:25:15 +08:00
Baizhou Zhang
873382a910 [Tiny]Upgrade README for sgl-kernel (#13945) 2025-11-25 16:46:30 -08:00
sglang-bot
391a863b3f chore: bump sgl-kernel version to 0.3.18.post1 (#13942)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-11-25 15:31:53 -08:00
Fan Yin
36b1bcd242 [chore] update torch version to 2.9 (#12969)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-25 14:47:34 -08:00
Xiaoyu Zhang
ecefc7904f [sgl-kernel Code Clean] Remove useless lightning_attention kernel (#13819) 2025-11-24 18:26:25 +08:00
sglang-bot
a22104a676 chore: bump sgl-kernel version to 0.3.18 (#13816) 2025-11-23 17:24:54 -08:00
YAMY
53fffefd5d Upgrade flashmla kernel for NSA tp support (#13718) 2025-11-23 01:36:49 -08:00
Xiaoyu Zhang
fb04d43428 [kimi k2 thinking] Avoid useless torch.zeros_ (#13596)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-21 13:15:27 +08:00