Qiaolin Yu 8cda5a622c Standalone speculative decoding (#10090)

2025-09-07 20:55:09 -07:00

..

attention

Integrate trtllm ragged attention for prefill self-attention (#9801)

2025-09-05 17:18:00 +08:00

__init__.py

…

doc_patch.py

Refactor the docs (#9031)

2025-08-10 19:49:45 -07:00

few_shot_gsm8k_engine.py

Simplify frontend language (#9029)

2025-08-10 10:59:30 -07:00

few_shot_gsm8k.py

[Auto Sync] Update parallel_state.py, few_shot_gsm8k.py (20250903) (#9986)

2025-09-03 16:55:43 -07:00

long_prompt.txt

…

run_eval.py

Add CI for gpt-oss model on hopper (#8851)

2025-08-09 00:34:23 -07:00

runners.py

[Fix] Add speculative_draft_model_revision to server_args (#5255)

2025-09-05 19:45:46 +08:00

send_one.py

Correctly abort the failed grammar requests & Improve the handling of abort (#6803)

2025-06-01 19:00:07 -07:00

simple_eval_common.py

Add CI for gpt-oss model on hopper (#8851)

2025-08-09 00:34:23 -07:00

simple_eval_gpqa.py

Add CI for gpt-oss model on hopper (#8851)

2025-08-09 00:34:23 -07:00

simple_eval_humaneval.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

simple_eval_math.py

…

simple_eval_mgsm.py

…

simple_eval_mmlu.py

…

test_activation.py

[AMD] Add silu_and_mul, gelu_and_mul, gelu_tanh_and_mul, and gelu_quick kernels for AMD GPUs (#7135)

2025-07-24 23:44:28 -07:00

test_block_fp8_deep_gemm_blackwell.py

[fix] fix DeepGEMM blackwell input quant & ut & fix style and log (#7247)

2025-06-16 11:45:54 -07:00

test_block_fp8_ep.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

test_block_fp8.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

test_custom_ops.py

[AMD] Remove vllm's scaled_fp8_quant and moe_sum when SGLANG_USE_AITER=1 (#7484)

2025-07-21 17:33:19 -07:00

test_cutlass_moe.py

[7/N] MoE Refactor: the implementation of new framework (#9269)

2025-09-05 21:09:09 -07:00

test_cutlass_w4a8_moe.py

[feat] Support tp mode for DeepSeek-R1-W4AFP8 (#8118)

2025-09-01 22:17:26 -07:00

test_deepep_utils.py

Add DeepEP to CI PR Test (#5655)

2025-05-06 17:36:03 -07:00

test_disaggregation_utils.py

[CI] Refactor disaggregation tests (#10068)

2025-09-06 22:14:46 +08:00

test_dynamic_grad_mode.py

…

test_fp4_moe.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

test_layernorm.py

…

test_marlin_moe.py

Replace sglang.srt.layers.quantization.scalar_types with sgl_kernel.scalar_type (#8951)

2025-08-13 19:41:41 -07:00

test_marlin_utils.py

Replace sglang.srt.layers.quantization.scalar_types with sgl_kernel.scalar_type (#8951)

2025-08-13 19:41:41 -07:00

test_programs.py

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

test_utils.py

Standalone speculative decoding (#10090)

2025-09-07 20:55:09 -07:00