chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
10,693 Commits 1 Branch 0 Tags
b6055e59cd266492c3f4e64d1d9ca70c6ff4bb06
Commit Graph

44 Commits

Author SHA1 Message Date
Ethan (Yusheng) Su
af2807e146 [LoRA][I] Add MOE LoRA JIT alignment kernel and tests (#19710) 
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Jonah Bernard <96398205+Jonahcb@users.noreply.github.com>
 2026-03-12 12:23:46 -07:00
sjqgogogogo
eb4ba1bde2 Feature/support longcat flash lite (#17838) 
Co-authored-by: sunjiaqi11 <sunjiaqi11@meituan.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
 2026-03-09 23:00:11 +08:00
David Wang
19c51fe2fa fix(rope): restore K writeback in fused rope + kv store kernel (#19636) 2026-03-07 20:41:35 +08:00
Mohammad Miadh Angkad
f88acf8780 [JIT Kernel] Reland NVFP4 kernels to JIT (#20012) 2026-03-07 10:31:08 +08:00
Baizhou Zhang
51e5dc845a Revert "[Kernel Slimming] Migrate NVFP4 kernels to JIT" (#20005) 2026-03-05 19:40:00 -08:00
Mohammad Miadh Angkad
2bdd89a6cd [Kernel Slimming] Migrate NVFP4 kernels to JIT (#19437) 2026-03-05 15:22:28 +08:00
Xiaoyu Zhang
74c8e7b215 refactor(jit_kernel): reduce duplication and separate test code (#19323) 2026-02-26 18:30:49 +08:00
Yuan Luo
4e843f1216 [DeepSeek-V3.2][JIT-kernel] Support nsa fuse store indexer k cache (#19148) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
 2026-02-26 10:23:10 +08:00
Yuan Luo
7c9e8e2def [Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
 2026-02-26 09:53:57 +08:00
Linyu Wu
beabaa8d37 [Kernel Slimming] Migrate marlin moe kernel to JIT (#19181) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-26 09:05:13 +08:00
Hubert Lu
8bd644765f [AMD] Enable ROCm kvcache JIT path and add AMD CI coverage. (#18992) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-25 14:15:05 +08:00
Linyu Wu
2cdde5d4ab [Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-23 22:05:27 +08:00
Liangsheng Yin
4653939cda Revert "[jit kernel] Support per_token_group_quant_8bit jit kernel" (#19131) 2026-02-22 07:54:24 +08:00
DarkSharpness
d8d0208c63 [Feature] rewrite rope kernel; remove flashinfer dependencies (#18844) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-21 21:32:40 +08:00
Yuan Luo
7d953440ec [jit kernel] Support per_token_group_quant_8bit jit kernel (#18905) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-02-20 21:01:05 +08:00
Xiaoyu Zhang
513c12d23f Remove unused fast-hadamard-transform PyTorch extension sources (#18927) 2026-02-18 15:51:07 +08:00
DarkSharpness
9d138685c1 [Refactor] Fix test and clean up hicache code (#18555) 2026-02-18 14:37:46 +08:00
Yi Zhong
ed22720c07 [JIT kernel] hd=512,1024 in JIT QK norm (cta based) (#17515) 
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
 2026-02-16 16:07:24 +08:00
Xiaoyu Zhang
c29394e3c8 [kernel slimming] Move fast_hadamard_transform to jit_kernel (#18475) 2026-02-14 23:06:21 +08:00
Johnsonms
34132d6da5 Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554) 2026-02-14 16:40:15 +08:00
Linyu Wu
0012d6a4eb [Kernel Slimming] Migrate GPTQ-Marlin repack kernel to JIT (#18543) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-13 22:29:22 +08:00
pansicheng
7d4ae057ec [Kernel] Add JIT rotary_embedding_kernel (#17934) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: root <root@zhikuan-A10x2.ea134>
 2026-02-13 12:41:25 +08:00
Linyu Wu
aa390d2762 [Kernel] Migrate GPTQ-Marlin GEMM kernel to JIT (#18067) 2026-02-06 08:31:42 +08:00
pansicheng
2eb4359ada [Kernel] Add JIT apply_rope_with_cos_sin_cache_inplace (#18155) 2026-02-05 21:49:37 +08:00
Linyu Wu
9b1619c148 [Move sgl-kernel Kernel to JIT] Add JIT concat MLA kernels (#17889) 2026-02-03 10:49:17 +08:00
Xiaoyu Zhang
a1bbc892af [Diffsuion & JIT_kernel] QKNorm cross heads kernel (#18073) 2026-02-03 10:03:17 +08:00
Qi Yuhang
0368ddf9ea [JIT Kernel]Support fused_add_rmsnorm in JIT Kernel (#17677) 2026-01-29 09:29:59 +08:00
Xiaoyu Zhang
7a4bb0d516 [Diffusion] Add diffusion time embedding to jit kernel (#17658) 2026-01-24 14:27:08 +08:00
Michael
53609e5e5b Revert "[Diffusion] Move diffusion time embedding to jit kernel" (#17257) 2026-01-17 21:29:22 +08:00
Xiaoyu Zhang
2cdd4370bc [Diffusion] Move diffusion time embedding to jit kernel (#16879) 2026-01-17 12:21:22 +08:00
cctry
dda35ccbd8 Fix gid calculation in per_tensor_absmax_kernel (#17126) 2026-01-15 23:21:41 +08:00
DarkSharpness
ba9f6d8f26 [Refactor] Clean up JIT kernel utilites (#16884) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-13 17:54:16 +08:00
Liangsheng Yin
2b3791ed37 Fix wrong kernel selection for int32/int64 indices (#16912) 
Co-authored-by: DarkSharpness <2040703891@qq.com>
 2026-01-12 17:26:57 +08:00
DarkSharpness
d112f6a25b [Feature] Support JIT set kv cache (#16273) 2026-01-10 17:34:09 -08:00
陈一涵
48b8dcd42e [jit kernel] support dtype as a cpp template parameter (#16452) 2026-01-08 13:54:33 +08:00
Xiaoyu Zhang
0fee6bc632 [JIT kernel] Apply jit per_tensor_quant_fp8 kernel (#15836) 2026-01-05 10:15:00 +08:00
DarkSharpness
a3b1e8ef3d [Feature] add aligned_vector type for JIT kernel (#16162) 2026-01-01 21:40:05 +08:00
DarkSharpness
8e43980ebb [Feature] JIT Fused QK norm + qk norm clean up (#15835) 2025-12-28 11:53:50 +08:00
Xiaoyu Zhang
de2f2880b5 [JIT sgl-kernel] Jit support per tensor quant (#15709) 2025-12-25 16:24:37 +08:00
DarkSharpness
291f11ae39 [Minor] Enhance JIT kernel and add dev docs (#14570) 2025-12-23 22:34:59 +08:00
Liangsheng Yin
a2423052f6 Add cuda event based on waiting value (#14214) 2025-12-01 18:51:44 +08:00
DarkSharpness
ac5505b04c [Feature] HiCache JIT kernel (once again) (#13764) 2025-11-22 22:19:16 -08:00
Lianmin Zheng
7af9b88c6c Revert "[Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel)" (#13644) 2025-11-20 02:11:12 -08:00
DarkSharpness
b51f9bbee7 [Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel) (#13453) 2025-11-20 00:03:32 -08:00