3 people e7bc600304 [Feature] Speculative decoding support lookahead (#9873) ...

Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>

2025-09-18 16:42:41 -07:00

..

spatial

[Feature] CUDA Green Context Support (#7649)

2025-07-15 02:49:16 +08:00

speculative

[Feature] Speculative decoding support lookahead (#9873)

2025-09-18 16:42:41 -07:00

test_activation.py

…

test_apply_token_bitmask_inplace.py

…

test_awq_dequant.py

Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842)

2025-06-17 13:45:10 -07:00

test_bmm_fp8.py

…

test_causal_conv1d.py

Add mamba kernel (#10234)

2025-09-09 12:58:43 -07:00

test_custom_allreduce.py

…

test_cutlass_mla.py

Disable kernel cutlass_mla_decode on SM103 (#10058)

2025-09-06 01:35:18 -07:00

test_cutlass_w4a8_moe_mm.py

pass a_scale from fp8 quant result instead of hard code to 1.0f (#10241)

2025-09-10 12:56:05 -07:00

test_dsv3_fused_a_gemm.py

Add dsv3 fused a gemm to sgl-kernel (#7630)

2025-06-29 02:52:24 -07:00

test_dsv3_router_gemm.py

[Kimi K2] dsv3_router_gemm supports NUM_EXPERTS == 384 (#8013)

2025-08-01 22:01:24 +08:00

test_flash_attention_4.py

feat: support fa cute in sgl-kernel (#10205)

2025-09-09 00:14:39 -07:00

test_flash_attention.py

Reduce overhead for fa by not calling heavy CUDA property check (#7375)

2025-08-20 16:26:28 +08:00

test_fp4_gemm.py

…

test_fp4_quantize.py

[NVIDIA] [2/N] Optimize silu_and_mul_scaled_fp4_grouped_quant perf (#9556)

2025-08-29 17:17:03 -07:00

test_fp8_blockwise_gemm.py

…

test_fp8_blockwise_moe.py

Update CUTLASS 4.2 & Enable K-Major Scale Factor for SM90 FP8 Blockwise Group GEMM (#9559)

2025-08-24 23:24:43 -07:00

test_fp8_gemm.py

…

test_gptq_kernel.py

[2/n]decouple quantization implementation from vLLM dependency (#8112)

2025-08-14 03:19:03 -07:00

test_int8_gemm.py

Skip some tests on Blackwell (#9777)

2025-08-28 20:00:32 -07:00

test_kvcacheio.py

Page first direct IO kernel (#10060)

2025-09-10 13:35:34 +08:00

test_lightning_attention_decode.py

…

test_marlin_gemm.py

[2/n]decouple quantization implementation from vLLM dependency (#8112)

2025-08-14 03:19:03 -07:00

test_marlin_repack.py

[2/n]decouple quantization implementation from vLLM dependency (#8112)

2025-08-14 03:19:03 -07:00

test_merge_state_v2.py

…

test_merge_state.py

…

test_moe_align.py

update sgl-kernel for EP: kernel part (#8514)

2025-07-30 22:19:55 -07:00

test_moe_fused_gate.py

[2/2] Fuse routed scaling factor into select_experts (#8690)

2025-08-20 15:10:16 -07:00

test_moe_topk_softmax.py

[optimize] fuse renormalize into moe_topk_softmax (#7744)

2025-07-03 12:42:44 -07:00

test_mscclpp.py

support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277)

2025-06-04 22:11:24 -07:00

test_norm.py

…

test_per_tensor_quant_fp8.py

…

test_per_token_group_quant_8bit.py

Revert "[1/2] Optimizations and refactors about quant kernel (#9534)" (#10292)

2025-09-10 18:24:23 -07:00

test_per_token_quant_fp8.py

fix per token cuda kernel hidden dim cannot divide by 16 (#8543)

2025-08-01 09:27:18 -07:00

test_qserve_w4a8_per_chn_gemm.py

…

test_qserve_w4a8_per_group_gemm.py

…

test_rotary_embedding.py

Fuse writing KV buffer into rope kernel (part 1: sgl-kernel) (#9077)

2025-08-12 01:46:40 -07:00

test_sampling.py

[sgl-kernel] Support FlashInfer top_k_top_p_sampling_from_logits (#9060)

2025-08-14 10:56:36 -07:00

test_sparse_flash_attn.py

fix: only enable flash_attn test on sm80 sm90 (#7289)

2025-06-17 16:56:41 -07:00

utils.py

Skip some tests on Blackwell (#9777)

2025-08-28 20:00:32 -07:00