sglang

benchmark

[Diffusion] Clean up diffusion Triton kernels and modernize custom op registration (#21122 )

2026-03-22 22:38:57 +08:00

csrc

HiSparse for Sparse Attention (#20343 )

2026-03-22 23:09:31 -07:00

diffusion

[Diffusion] Clean up diffusion Triton kernels and modernize custom op registration (#21122 )

2026-03-22 22:38:57 +08:00

include/sgl_kernel

Add compile-time 256-bit vector guard for pre-Blackwell (#19794 )

2026-03-20 18:25:12 +08:00

tests

[Diffusion] Clean up diffusion Triton kernels and modernize custom op registration (#21122 )

2026-03-22 22:38:57 +08:00

__init__.py

Move fa4 from sgl-kernel to jit kernel (#17353 )

2026-01-24 15:25:03 +08:00

__main__.py

[Minor] Enhance JIT kernel and add dev docs (#14570 )

2025-12-23 22:34:59 +08:00

.clang-format

[JIT Kernel][Feature] Support JIT custom all reduce (rewrite as v2) (#19880 )

2026-03-20 18:24:07 +08:00

add_constant.py

[1/n jit_kernel restruct] unify cache usage and clean up naming in ngram_embedding (#20244 )

2026-03-10 15:53:43 +08:00

all_reduce.py

[JIT Kernel][Feature] Support JIT custom all reduce (rewrite as v2) (#19880 )

2026-03-20 18:24:07 +08:00

awq_dequantize.py

[Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949 )

2026-02-23 22:05:27 +08:00

awq_marlin_repack.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

clamp_position.py

Replace clamp_position with JIT kernel + platform dispatch (#20999 )

2026-03-21 21:26:26 -07:00

concat_mla.py

[Move sgl-kernel Kernel to JIT] Add JIT concat MLA kernels (#17889 )

2026-02-03 10:49:17 +08:00

cutedsl_gdn.py

[jit-kernel] Add CuTe DSL GDN Decode Kernel (#15631 )

2026-01-18 12:54:36 -08:00

debug_utils.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

flash_attention_v4.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

fused_metadata_copy.py

Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554 )

2026-02-14 16:40:15 +08:00

fused_store_index_cache.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

gptq_marlin_repack.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

gptq_marlin.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

hadamard.py

refactor(jit_kernel): reduce duplication and separate test code (#19323 )

2026-02-26 18:30:49 +08:00

hicache.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

hisparse.py

HiSparse for Sparse Attention (#20343 )

2026-03-22 23:09:31 -07:00

kvcache.py

[Feature] Support JIT set kv cache (#16273 )

2026-01-10 17:34:09 -08:00

moe_lora_align.py

[LoRA][I] Add MOE LoRA JIT alignment kernel and tests (#19710 )

2026-03-12 12:23:46 -07:00

moe_wna16_marlin.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

ngram_embedding.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

norm.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

nvfp4.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

per_tensor_quant_fp8.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

per_token_group_quant_8bit.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

resolve_future_token_ids.py

Replace _resolve_future_token_ids with JIT kernel + platform dispatch (#20976 )

2026-03-20 01:47:03 -07:00

rope.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

timestep_embedding.py

Add SGLang CUDA crash API logging inspired by FlashInfer (#20910 )

2026-03-22 16:39:40 +08:00

utils.py

refactor: consolidate is_in_ci (jit_kernel, sgl-kernel benchmarks, tests) (#21009 )

2026-03-20 05:55:36 -07:00