Yuan Luo 7c9e8e2def [Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140) ...

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>

2026-02-26 09:53:57 +08:00

..

benchmark

[Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140)

2026-02-26 09:53:57 +08:00

csrc

[Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140)

2026-02-26 09:53:57 +08:00

diffusion

[diffusion] improve: improve fuse_scale_shift_kernel with non-blocking op (#18710)

2026-02-25 21:04:20 +08:00

flash_attention/cute

[Diffusion] Fix Ring Parallel bug with FA4 (#18062)

2026-02-02 17:06:51 +08:00

include/sgl_kernel

[AMD] Enable ROCm kvcache JIT path and add AMD CI coverage. (#18992)

2026-02-25 14:15:05 +08:00

tests

[Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140)

2026-02-26 09:53:57 +08:00

__init__.py

Move fa4 from sgl-kernel to jit kernel (#17353)

2026-01-24 15:25:03 +08:00

__main__.py

[Minor] Enhance JIT kernel and add dev docs (#14570)

2025-12-23 22:34:59 +08:00

.clang-format

[Refactor] Clean up JIT kernel utilites (#16884)

2026-01-13 17:54:16 +08:00

add_constant.py

[JIT kernel] Update jit_kernel cache and develop doc (#17842)

2026-01-28 15:09:47 +08:00

awq_dequantize.py

[Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949)

2026-02-23 22:05:27 +08:00

awq_marlin_repack.py

[Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949)

2026-02-23 22:05:27 +08:00

concat_mla.py

[Move sgl-kernel Kernel to JIT] Add JIT concat MLA kernels (#17889)

2026-02-03 10:49:17 +08:00

cuda_wait_value.py

[JIT kernel] Update jit_kernel cache and develop doc (#17842)

2026-01-28 15:09:47 +08:00

cutedsl_gdn.py

[jit-kernel] Add CuTe DSL GDN Decode Kernel (#15631)

2026-01-18 12:54:36 -08:00

flash_attention_v4.py

Move fa4 from sgl-kernel to jit kernel (#17353)

2026-01-24 15:25:03 +08:00

fused_metadata_copy.py

Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554)

2026-02-14 16:40:15 +08:00

gptq_marlin_repack.py

[Kernel Slimming] Migrate GPTQ-Marlin repack kernel to JIT (#18543)

2026-02-13 22:29:22 +08:00

gptq_marlin.py

[Kernel] Migrate GPTQ-Marlin GEMM kernel to JIT (#18067)

2026-02-06 08:31:42 +08:00

hadamard.py

[kernel slimming] Move fast_hadamard_transform to jit_kernel (#18475)

2026-02-14 23:06:21 +08:00

hicache.py

[Refactor] Fix test and clean up hicache code (#18555)

2026-02-18 14:37:46 +08:00

kvcache.py

[Feature] Support JIT set kv cache (#16273)

2026-01-10 17:34:09 -08:00

moe_wna16_marlin.py

[Kernel Slimming] Migrate marlin moe kernel to JIT (#19181)

2026-02-26 09:05:13 +08:00

norm.py

[Diffsuion & JIT_kernel] QKNorm cross heads kernel (#18073)

2026-02-03 10:03:17 +08:00

per_tensor_quant_fp8.py

[Refactor] Clean up JIT kernel utilites (#16884)

2026-01-13 17:54:16 +08:00

per_token_group_quant_8bit.py

[Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140)

2026-02-26 09:53:57 +08:00

pos_enc.py

[Kernel] Add JIT rotary_embedding_kernel (#17934)

2026-02-13 12:41:25 +08:00

rope.py

[Feature] rewrite rope kernel; remove flashinfer dependencies (#18844)

2026-02-21 21:32:40 +08:00

timestep_embedding.py

[JIT kernel] Update jit_kernel cache and develop doc (#17842)

2026-01-28 15:09:47 +08:00

utils.py

[Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140)

2026-02-26 09:53:57 +08:00