Baizhou Zhang a42736bbb8 Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113)

2025-04-15 22:01:22 -07:00

..

attention

Support MHA with chunked prefix cache for DeepSeek chunked prefill (#5113)

2025-04-15 22:01:22 -07:00

__init__.py

Fix circular imports in gptq.py and unblock test explorer (#4736)

2025-03-24 18:07:08 -07:00

few_shot_gsm8k_engine.py

[engine] support async and streaming (#1614)

2024-10-11 15:26:25 -07:00

few_shot_gsm8k.py

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

long_prompt.txt

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

run_eval.py

Fuse more ops & Simplify token mapping (#1758)

2024-10-22 23:20:43 -07:00

runners.py

support clip embedding model (#4506)

2025-03-27 00:18:15 -07:00

send_one.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00

simple_eval_common.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_gpqa.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_humaneval.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_block_fp8_ep.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_block_fp8.py

[perf] experimental enhance fp8 per-tensor quant (#5370)

2025-04-14 12:35:43 -07:00

test_custom_ops.py

sgl scaled_fp8_quant support output padding (#4861)

2025-04-02 23:53:57 +08:00

test_dynamic_grad_mode.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_layernorm.py

Add retry for flaky tests in CI (#4755)

2025-03-25 16:53:12 -07:00

test_programs.py

[Feature] SPMD for SGLang + Verl (#3852)

2025-02-28 09:53:10 -08:00

test_utils.py

Support server based rollout in Verlengine (#4848)

2025-04-12 10:07:52 -07:00