Commit Graph

13 Commits

Author SHA1 Message Date
Xiaoyu Zhang
0fee6bc632 [JIT kernel] Apply jit per_tensor_quant_fp8 kernel (#15836) 2026-01-05 10:15:00 +08:00
DarkSharpness
f6f7af4068 [Refactor] Clean up custom op (#15995) 2026-01-01 21:41:56 +08:00
DarkSharpness
a3b1e8ef3d [Feature] add aligned_vector type for JIT kernel (#16162) 2026-01-01 21:40:05 +08:00
Yuan Luo
3a42c5e341 [VLM] Adopt jit qk_norm kernel in VLM (#16171)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-01-01 10:10:36 +08:00
Xiaoyu Zhang
7d02c8e59f [JIT kernel] CI support jit kernel tests (#15939) 2025-12-28 23:11:02 +08:00
DarkSharpness
8e43980ebb [Feature] JIT Fused QK norm + qk norm clean up (#15835) 2025-12-28 11:53:50 +08:00
Xiaoyu Zhang
de2f2880b5 [JIT sgl-kernel] Jit support per tensor quant (#15709) 2025-12-25 16:24:37 +08:00
Xuchun Shang
fe712aa3df [bug fix] fix hicache jit kernel (#15177)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
2025-12-24 10:31:21 +08:00
DarkSharpness
291f11ae39 [Minor] Enhance JIT kernel and add dev docs (#14570) 2025-12-23 22:34:59 +08:00
Liangsheng Yin
a2423052f6 Add cuda event based on waiting value (#14214) 2025-12-01 18:51:44 +08:00
DarkSharpness
ac5505b04c [Feature] HiCache JIT kernel (once again) (#13764) 2025-11-22 22:19:16 -08:00
Lianmin Zheng
7af9b88c6c Revert "[Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel)" (#13644) 2025-11-20 02:11:12 -08:00
DarkSharpness
b51f9bbee7 [Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel) (#13453) 2025-11-20 00:03:32 -08:00