sglang

spatial

[Feature] CUDA Green Context Support (#7649 )

2025-07-15 02:49:16 +08:00

speculative

[speculative decoding] rename lookahead to ngram (#11010 )

2025-09-28 21:06:59 -07:00

conftest.py

Add sgl-kernel CI test for Blackwell (B200) (#13301 )

2025-11-20 19:02:42 -08:00

test_activation.py

sync flashinfer and update sgl-kernel tests (#3081 )

2025-01-23 21:13:55 +08:00

test_apply_token_bitmask_inplace.py

fix sgl-kernel unit tests (#5666 )

2025-04-23 01:18:30 -07:00

test_awq_dequant.py

Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842 )

2025-06-17 13:45:10 -07:00

test_bmm_fp8.py

feat: integrate bmm_fp8 kernel into sgl-kernel (#3056 )

2025-01-23 00:39:38 +08:00

test_causal_conv1d.py

Add mamba kernel (#10234 )

2025-09-09 12:58:43 -07:00

test_copy.py

Super tiny add UT for copy_to_gpu_no_ce (#12270 )

2025-11-04 09:40:51 +08:00

test_custom_allreduce.py

sgl-kernel transfer custom allreduce from trt kernel to vllm kernel (#5079 )

2025-04-05 14:23:20 -07:00

test_cutlass_mla.py

Disable kernel cutlass_mla_decode on SM103 (#10058 )

2025-09-06 01:35:18 -07:00

test_cutlass_w4a8_moe_mm.py

[Bug] Fix Issue#10215 (#10572 )

2025-09-25 09:51:50 +08:00

test_dsv3_fused_a_gemm.py

Add dsv3 fused a gemm to sgl-kernel (#7630 )

2025-06-29 02:52:24 -07:00

test_dsv3_router_gemm.py

[Kimi K2] dsv3_router_gemm supports NUM_EXPERTS == 384 (#8013 )

2025-08-01 22:01:24 +08:00

test_es_fp8_blockwise_moe.py

[sgl-kernel] fix b200 kernel ci (#13907 )

2025-11-30 10:15:37 -08:00

test_flash_attention_4.py

[NVIDIA] FA3/FA4 Fix (#11606 )

2025-10-19 17:10:10 -07:00

test_flash_attention.py

Reduce overhead for fa by not calling heavy CUDA property check (#7375 )

2025-08-20 16:26:28 +08:00

test_flashmla.py

[sgl-kernel] fix b200 kernel ci (#13907 )

2025-11-30 10:15:37 -08:00

test_fp4_gemm.py

[Misc] Use pytest.mark.skipif in sgl-kernel test (#5137 )

2025-04-07 21:35:14 -07:00

test_fp4_quantize.py

Replace [silu_and_mul_]scaled_fp4_group_quant by Flashinfer equivalent (#12376 )

2025-11-13 00:26:00 -08:00

test_fp8_blockwise_gemm.py

[Misc] Clean sgl-kernel test (#5216 )

2025-04-10 11:28:41 -07:00

test_fp8_blockwise_moe.py

Support running FP4 Deepseek on SM120. (#11708 )

2025-10-27 17:37:49 -07:00

test_fp8_gemm.py

[Feature] use pytest for sgl-kernel (#4896 )

2025-03-30 10:36:52 -07:00

test_fused_qk_norm_rope.py

[sgl-kernel][1/2] Fused qk_norm_rope for Qwen3-MoE (#14036 )

2025-11-28 12:25:15 +08:00

test_gguf.py

[sgl-kernel] Optimize gguf test (#11667 )

2025-10-15 15:45:53 -07:00

test_gptq_kernel.py

[2/n]decouple quantization implementation from vLLM dependency (#8112 )

2025-08-14 03:19:03 -07:00

test_hadamard.py

[sgl-kernel] support hadamard (#11663 )

2025-10-15 19:00:44 -07:00

test_int8_gemm.py

Skip some tests on Blackwell (#9777 )

2025-08-28 20:00:32 -07:00

test_kimi_k2_moe_fused_gate.py

[opt kimi k2 1 / n] Add kimi k2 moe fused gate (#13287 )

2025-11-15 17:14:19 +08:00

test_kvcacheio.py

[ci] Try fixing broken CIs (#12317 )

2025-10-29 01:13:51 -07:00

test_marlin_gemm.py

[2/n]decouple quantization implementation from vLLM dependency (#8112 )

2025-08-14 03:19:03 -07:00

test_marlin_repack.py

[2/n]decouple quantization implementation from vLLM dependency (#8112 )

2025-08-14 03:19:03 -07:00

test_merge_state_v2.py

Add main for merge state tests (#6492 )

2025-05-21 21:56:25 -07:00

test_merge_state.py

Add main for merge state tests (#6492 )

2025-05-21 21:56:25 -07:00

test_moe_align.py

Opt moe align block size kernel (#14133 )

2025-12-02 19:13:55 +08:00

test_moe_fused_gate.py

[2/2] Fuse routed scaling factor into select_experts (#8690 )

2025-08-20 15:10:16 -07:00

test_moe_topk_sigmoid.py

Support moe topk sigmoid kernel (#13049 )

2025-11-20 00:24:37 +08:00

test_moe_topk_softmax.py

[optimize] fuse renormalize into moe_topk_softmax (#7744 )

2025-07-03 12:42:44 -07:00

test_mscclpp.py

support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277 )

2025-06-04 22:11:24 -07:00

test_norm.py

Restruct sgl-kernel benchmark (#10861 )

2025-09-25 07:45:25 +08:00

test_per_tensor_quant_fp8.py

update variable naming and comments for rocm (#5299 )

2025-04-11 23:15:05 -07:00

test_per_token_group_quant_8bit.py

Reland [1/2] Optimizations and refactors about quant kernel (#10312 )

2025-10-11 15:59:03 +08:00

test_per_token_quant_fp8.py

Support hidden_dim % 4 == 0 in per_token_quant_fp8 (#12883 )

2025-11-10 17:13:14 +08:00

test_qserve_w4a8_per_chn_gemm.py

[1/2] Support Qserve (#6457 )

2025-05-21 19:48:59 -07:00

test_qserve_w4a8_per_group_gemm.py

[1/2] Support Qserve (#6457 )

2025-05-21 19:48:59 -07:00

test_rotary_embedding.py

Add FP32 dtype support for RoPE - Part1 (#13181 )

2025-11-15 11:37:18 -08:00

test_sampling.py

[sgl-kernel] Support FlashInfer top_k_top_p_sampling_from_logits (#9060 )

2025-08-14 10:56:36 -07:00

test_sparse_flash_attn.py

fix: only enable flash_attn test on sm80 sm90 (#7289 )

2025-06-17 16:56:41 -07:00

test_topk.py

[sgl-kernel][Deepseek V3.2] Add row_starts to topk kernel (#12582 )

2025-11-07 18:33:27 -08:00

test_torch_defaults_reset.py

Restore torch defaults between sgl-kernel tests (#11131 )

2025-11-03 23:51:23 -08:00

utils.py

Skip some tests on Blackwell (#9777 )

2025-08-28 20:00:32 -07:00