Ying Sheng 04b262cd91 [Fix] Fix major performance bug in certain cases (#1563) ...

Co-authored-by: hnyls2002 <hnyls2002@gmail.com>

2024-10-04 08:51:11 +00:00

..

srt/sampling/penaltylib

feat: frequency, min_new_tokens, presence, and repetition penalties (#973)

2024-08-08 04:21:08 -07:00

few_shot_gsm8k.py

Add bench_server_latency.py (#1452)

2024-09-18 00:56:06 -07:00

long_prompt.txt

[Fix] Compatibility of window attention and cuda graph (#1090)

2024-08-14 10:37:01 -07:00

run_eval.py

Fix accuracy test (#1051)

2024-08-12 19:48:40 +10:00

runners.py

Let ModelRunner take InputMetadata as input, instead of ScheduleBatch (#1541)

2024-09-29 20:28:45 -07:00

simple_eval_common.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_gpqa.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_humaneval.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_math.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

simple_eval_mgsm.py

Add longer accuracy test on CI (#1049)

2024-08-12 09:21:38 +00:00

simple_eval_mmlu.py

Mixed style of chunked prefill (#1013)

2024-08-16 09:13:00 +00:00

test_activation.py

feat: use gelu_tanh_and_mul (#1193)

2024-08-24 01:58:16 -07:00

test_layernorm.py

feat: update GemmaRMSNorm (#1232)

2024-08-28 22:47:34 +10:00

test_programs.py

[Minor] Many cleanup (#1357)

2024-09-09 04:14:11 -07:00

test_utils.py

[Fix] Fix major performance bug in certain cases (#1563)

2024-10-04 08:51:11 +00:00