pansicheng 2ad475b4ed use flashinfer.sampling (#18696)

2026-02-26 10:02:38 +08:00

..

bench_activation.py

…

bench_amd_deterministic_allreduce.py

[amd] Add deterministic all-reduce kernel for AMD (ROCm) (#15340)

2025-12-18 23:36:03 -08:00

bench_awq_dequant.py

…

bench_cutlass_mla.py

…

bench_dsv3_fused_a_gemm.py

…

bench_dsv3_router_gemm.py

…

bench_es_fp8_blockwise_grouped_gemm.py

…

bench_fp4_gemm.py

Update FP4 GEMM Benchmark (#14449)

2025-12-16 23:04:56 -08:00

bench_fp8_blockwise_gemm.py

…

bench_fp8_blockwise_group_gemm.py

…

bench_fp8_gemm.py

…

bench_int8_gemm.py

…

bench_kimi_k2_moe_fused_gate.py

[opt kimi k2 1 / n] Add kimi k2 moe fused gate (#13287)

2025-11-15 17:14:19 +08:00

bench_moe_align_block_size.py

Opt moe align block size kernel (#14133)

2025-12-02 19:13:55 +08:00

bench_moe_ep_post_reorder.py

…

bench_moe_fused_gate.py

…

bench_moe_topk_sigmoid.py

Support moe topk sigmoid kernel (#13049)

2025-11-20 00:24:37 +08:00

bench_moe_topk_softmax.py

…

bench_mrope.py

…

bench_nvfp4_scaled_gemm.py

…

bench_per_tensor_quant_fp8.py

[JIT sgl-kernel] Jit support per tensor quant (#15709)

2025-12-25 16:24:37 +08:00

bench_per_token_group_quant_8bit.py

update pre-commit config (#18860)

2026-02-16 00:18:31 +08:00

bench_per_token_quant_fp8.py

…

bench_qserve_w4a8_gemm.py

…

bench_rmsnorm.py

…

bench_rotary_embedding.py

…

bench_sum_scale.py

…

bench_top_k_top_p_sampling.py

use flashinfer.sampling (#18696)

2026-02-26 10:02:38 +08:00