chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
10,090 Commits 1 Branch 0 Tags
1b79934d347ff1799fe651ee08d1d7a8cff3001f
Commit Graph

31 Commits

Author SHA1 Message Date
Yuan Luo
7c9e8e2def [Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
 2026-02-26 09:53:57 +08:00
Linyu Wu
beabaa8d37 [Kernel Slimming] Migrate marlin moe kernel to JIT (#19181) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-26 09:05:13 +08:00
Xiaoyu Zhang
9dff933164 [Kernel Slimming] Remove sgl-kernel AOT marlin kernels (#19241) 2026-02-25 10:08:22 +08:00
Linyu Wu
2cdde5d4ab [Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-23 22:05:27 +08:00
Liangsheng Yin
4653939cda Revert "[jit kernel] Support per_token_group_quant_8bit jit kernel" (#19131) 2026-02-22 07:54:24 +08:00
DarkSharpness
d8d0208c63 [Feature] rewrite rope kernel; remove flashinfer dependencies (#18844) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-21 21:32:40 +08:00
Yuan Luo
7d953440ec [jit kernel] Support per_token_group_quant_8bit jit kernel (#18905) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-02-20 21:01:05 +08:00
Yi Zhong
ed22720c07 [JIT kernel] hd=512,1024 in JIT QK norm (cta based) (#17515) 
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
 2026-02-16 16:07:24 +08:00
Johnsonms
34132d6da5 Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554) 2026-02-14 16:40:15 +08:00
Linyu Wu
0012d6a4eb [Kernel Slimming] Migrate GPTQ-Marlin repack kernel to JIT (#18543) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-13 22:29:22 +08:00
Xiaoyu Zhang
013a199bc6 [CI] Skip cutedsl gdn performance test in jit_kernel ci (#18783) 2026-02-13 15:49:30 +08:00
pansicheng
7d4ae057ec [Kernel] Add JIT rotary_embedding_kernel (#17934) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: root <root@zhikuan-A10x2.ea134>
 2026-02-13 12:41:25 +08:00
陈一涵
f798ab9775 [diffusion] fix: fix torch.compile graph break caused by torch._dynamo.disable (#18336) 2026-02-06 14:48:09 +08:00
Linyu Wu
aa390d2762 [Kernel] Migrate GPTQ-Marlin GEMM kernel to JIT (#18067) 2026-02-06 08:31:42 +08:00
pansicheng
2eb4359ada [Kernel] Add JIT apply_rope_with_cos_sin_cache_inplace (#18155) 2026-02-05 21:49:37 +08:00
陈一涵
4aa03d91fd [diffusion] fix: fix accuracy bug caused by #14717 (#18296) 2026-02-05 20:36:18 +08:00
Jianying
4739f2e8d5 [diffusion] kernel: gated residual layernorm scale shift and layernorm scale shift kernel fusion for Qwen-Image, WAN and HunyuanVideo (#14717) 
Co-authored-by: AichenF <aichenf@nvidia.com>
Co-authored-by: jianyingzhu <joeyzhu@nvidia.com>
Co-authored-by: root <root@a4u8g-0120.ipp2a2.colossus.nvidia.com>
Co-authored-by: Yihan Chen <yingluosanqian@example.com>
Co-authored-by: 陈一涵 <yingluosanqian@gmail.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-04 13:46:20 +08:00
Linyu Wu
9b1619c148 [Move sgl-kernel Kernel to JIT] Add JIT concat MLA kernels (#17889) 2026-02-03 10:49:17 +08:00
Xiaoyu Zhang
a1bbc892af [Diffsuion & JIT_kernel] QKNorm cross heads kernel (#18073) 2026-02-03 10:03:17 +08:00
Qi Yuhang
0368ddf9ea [JIT Kernel]Support fused_add_rmsnorm in JIT Kernel (#17677) 2026-01-29 09:29:59 +08:00
Xiaoyu Zhang
3992a023e6 Move fa4 from sgl-kernel to jit kernel (#17353) 2026-01-24 15:25:03 +08:00
Xiaoyu Zhang
7a4bb0d516 [Diffusion] Add diffusion time embedding to jit kernel (#17658) 2026-01-24 14:27:08 +08:00
Jinyan Chen
e00b43442d [jit-kernel] Add CuTe DSL GDN Decode Kernel (#15631) 
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
 2026-01-18 12:54:36 -08:00
Michael
53609e5e5b Revert "[Diffusion] Move diffusion time embedding to jit kernel" (#17257) 2026-01-17 21:29:22 +08:00
Xiaoyu Zhang
2cdd4370bc [Diffusion] Move diffusion time embedding to jit kernel (#16879) 2026-01-17 12:21:22 +08:00
DarkSharpness
ba9f6d8f26 [Refactor] Clean up JIT kernel utilites (#16884) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-13 17:54:16 +08:00
DarkSharpness
d112f6a25b [Feature] Support JIT set kv cache (#16273) 2026-01-10 17:34:09 -08:00
Xiaoyu Zhang
0fee6bc632 [JIT kernel] Apply jit per_tensor_quant_fp8 kernel (#15836) 2026-01-05 10:15:00 +08:00
Xiaoyu Zhang
7d02c8e59f [JIT kernel] CI support jit kernel tests (#15939) 2025-12-28 23:11:02 +08:00
DarkSharpness
8e43980ebb [Feature] JIT Fused QK norm + qk norm clean up (#15835) 2025-12-28 11:53:50 +08:00
Xiaoyu Zhang
de2f2880b5 [JIT sgl-kernel] Jit support per tensor quant (#15709) 2025-12-25 16:24:37 +08:00