chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,097 Commits 1 Branch 0 Tags
afdd1d0992900ea09074e2afed47c18831bdbdde
Commit Graph

105 Commits

Author SHA1 Message Date
Lianmin Zheng
814202704b ci: unify PR test suite naming (#21187) 2026-03-23 00:18:45 -07:00
Zhiqiang Xie
13f4f010d8 HiSparse for Sparse Attention (#20343) 2026-03-22 23:09:31 -07:00
Lianmin Zheng
7050011dee Enable JIT clamp_position and resolve_future_token_ids on ROCm (#21116) 2026-03-22 22:33:54 -07:00
Xiaoyu Zhang
c1fe5de69c [Diffusion] Clean up diffusion Triton kernels and modernize custom op registration (#21122) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-22 22:38:57 +08:00
Xiaoyu Zhang
766d225fcc Add SGLang CUDA crash API logging inspired by FlashInfer (#20910) 2026-03-22 16:39:40 +08:00
Xiaoyu Zhang
1b65c0d259 [Diffusion] Fix torch.compile RMSNorm fallback for Z-Image (#20962) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-22 15:38:22 +08:00
Lianmin Zheng
76e4a8662c Replace clamp_position with JIT kernel + platform dispatch (#20999) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-21 21:26:26 -07:00
Xiaoyu Zhang
c076968c52 [CI] Remove obsolete AOT-only jit-kernel benchmarks after sgl-kernel 4.0 (#21075) 2026-03-21 13:40:42 +08:00
Lianmin Zheng
104b10f70a refactor: consolidate is_in_ci (jit_kernel, sgl-kernel benchmarks, tests) (#21009) 2026-03-20 05:55:36 -07:00
xingsy97
f41832795e Add compile-time 256-bit vector guard for pre-Blackwell (#19794) 2026-03-20 18:25:12 +08:00
DarkSharpness
2dd9196079 [JIT Kernel][Feature] Support JIT custom all reduce (rewrite as v2) (#19880) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-03-20 18:24:07 +08:00
Jia Guo
ec01ef9092 Fix torch.compile/dynamo crash with Qwen3 QK-norm in piecewise CUDA g… (#19818) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-20 18:05:09 +08:00
Lianmin Zheng
112b628227 Replace _resolve_future_token_ids with JIT kernel + platform dispatch (#20976) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-20 01:47:03 -07:00
Mohammad Miadh Angkad
3d749c49ca [JIT Kernel] Fix NVFP4 multi-arch compilation failure (#20874) 2026-03-20 10:30:04 +08:00
xingsy97
d20e9a20fa [JIT] Inject target architecture flag into JIT compilation (#20103) 2026-03-17 23:16:49 -07:00
xingsy97
f78d5c3b3c [JIT Kernel] Add hadamard kernel test and benchmark (#20030) 2026-03-17 23:16:35 -07:00
Rain Jiang
cb1e63aba4 bump fa4 to official released fa4 pkg (#20303) 2026-03-17 17:22:56 -07:00
Xiaoyu Zhang
15097c5c3b Release sglang kernel 0.4.0 (#20440) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-16 20:34:58 +08:00
Xiaoyu Zhang
e1eb25880f [Diffusion] Add a benchmark for rmsnorm/fuse_add_rmsnorm (#20632) 2026-03-16 09:50:33 +08:00
Xiaoyu Zhang
25e38216b6 [kernel slimming] Clean many useless sgl-kernel deprecated kernels (#20277) 2026-03-14 16:45:54 +08:00
Xiaoyu Zhang
e00328d1e5 [Diffusion] Opt qwen-image-edit with fuse_residual_layernorm_scale_shift_gate_select01_kernel (#20395) 
Co-authored-by: Yihan Chen <yingluosanqian@gmail.com>
 2026-03-13 13:15:22 +08:00
Xiaoyu Zhang
7ecf07b8f4 [jit_kernel] Temporarily Skip Flaky JIT Kernel GDN Test and Add PR Label (#20436) 2026-03-13 09:34:22 +08:00
Ethan (Yusheng) Su
af2807e146 [LoRA][I] Add MOE LoRA JIT alignment kernel and tests (#19710) 
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Jonah Bernard <96398205+Jonahcb@users.noreply.github.com>
 2026-03-12 12:23:46 -07:00
R0CKSTAR
db97f193b7 [diffusion][llm] macOS support (#19549) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-10 13:11:07 -07:00
Xiaoyu Zhang
60cc06297e [4/n jit_kernel restruct] speed up CI tests and add benchmark workflow (#20268) 2026-03-10 21:37:41 +08:00
Xiaoyu Zhang
51d9d34977 [2/n jit_kernel restruct] unify rotary embedding entrypoints under rope.py (#20247) 2026-03-10 17:49:57 +08:00
Xiaoyu Zhang
8517da5d08 [3/n jit_kernel restruct] Clean up benchmark naming and benchmarking helpers (#20250) 2026-03-10 16:39:03 +08:00
Xiaoyu Zhang
c812504b92 [1/n jit_kernel restruct] unify cache usage and clean up naming in ngram_embedding (#20244) 2026-03-10 15:53:43 +08:00
Johnsonms
7cf0551014 Migrate norm kernels to FlashInfer JIT implementation (#18871) 2026-03-10 14:56:07 +08:00
sjqgogogogo
eb4ba1bde2 Feature/support longcat flash lite (#17838) 
Co-authored-by: sunjiaqi11 <sunjiaqi11@meituan.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
 2026-03-09 23:00:11 +08:00
Fan Lin
7fb282a96f [diffusion] fix: fix bug of copy_if (#20094) 
Co-authored-by: Yihan Chen <yingluosanqian@gmail.com>
 2026-03-08 14:27:58 +08:00
xingsy97
f8d4eb7022 [Docs] Add docstrings to JIT kernel include headers (#19770) 2026-03-07 20:48:00 +08:00
David Wang
19c51fe2fa fix(rope): restore K writeback in fused rope + kv store kernel (#19636) 2026-03-07 20:41:35 +08:00
Mohammad Miadh Angkad
f88acf8780 [JIT Kernel] Reland NVFP4 kernels to JIT (#20012) 2026-03-07 10:31:08 +08:00
xingsy97
54634b9a40 [Kernel] Dispatch exp/sin/cos through dtype_trait (#19798) 2026-03-06 22:57:52 +08:00
Johnsonms
2d266c73ea Migrate renorm kernels from sgl-kernel to FlashInfer JIT (#18854) 2026-03-06 22:53:28 +08:00
Yuan Luo
f7de9375ac [GDN][Qwen3-Next][Qwen3.5] Fuse fused_gdn_gating and fused_recurrent_gated_delta_rule_update in verify_target (#19775) 2026-03-06 21:42:44 +08:00
Baizhou Zhang
51e5dc845a Revert "[Kernel Slimming] Migrate NVFP4 kernels to JIT" (#20005) 2026-03-05 19:40:00 -08:00
Rain Jiang
472eef4071 fa4 cleanup (#19727) 2026-03-05 17:54:25 +08:00
xingsy97
dbc896f204 [Test] Enhance JIT kvcache store kernel test coverage (#19630) 2026-03-05 16:17:15 +08:00
Mohammad Miadh Angkad
2bdd89a6cd [Kernel Slimming] Migrate NVFP4 kernels to JIT (#19437) 2026-03-05 15:22:28 +08:00
赵晨阳
62480ebb1b [SGLang-Diffusion] Fix custom op fake impl missing eps default for torch.compile (#19725) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-03-03 15:24:36 +08:00
Xiaoyu Zhang
53de53fb53 [jit_kernel] Tiny unify jit_kernel tests style (#19694) 2026-03-02 21:33:59 +08:00
Yuan Luo
f6ee6dc8c3 [JIT-kernel] Add unit test for nsa indexer fused_store_k_cache (#19389) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-02 12:18:11 +08:00
zwang86
f51ddba131 feat: add FA4 SM90 paged KV decode support & update attention docs (#18442) 
Co-authored-by: Zeyu Wang <zeyu.wang@yahooinc.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2026-03-02 09:12:19 +08:00
R0CKSTAR
fe4bc8ebd5 [diffusion] fix: MulAdd 4D path (shift indexing) (#18673) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-02-28 01:52:57 +08:00
Xiaoyu Zhang
74c8e7b215 refactor(jit_kernel): reduce duplication and separate test code (#19323) 2026-02-26 18:30:49 +08:00
Yuan Luo
4e843f1216 [DeepSeek-V3.2][JIT-kernel] Support nsa fuse store indexer k cache (#19148) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
 2026-02-26 10:23:10 +08:00
Yuan Luo
7c9e8e2def [Re-land][jit kernel] Support per_token_group_quant_8bit jit kernel (#19140) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Mohammad Miadh Angkad <mangkad.bsdsba2027@aim.edu>
 2026-02-26 09:53:57 +08:00
Linyu Wu
beabaa8d37 [Kernel Slimming] Migrate marlin moe kernel to JIT (#19181) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-26 09:05:13 +08:00