bjmsongandroot e21026690d benchmark decoding attention kernel with cudnn (#2467) ...

Co-authored-by: root <bjmsong@126.com>

2024-12-17 03:31:57 -08:00

..

bench_in_batch_prefix

Add a benchmark script for in-batch prefix caching (#2494)

2024-12-16 18:49:02 -08:00

benchmark_vllm_060

[Fix] Fix all the Huggingface paths (#1553)

2024-10-02 10:12:07 -07:00

blog_v0_2

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

dspy

…

generative_agents

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

gsm8k

[Minor] Many cleanup (#1357)

2024-09-09 04:14:11 -07:00

hellaswag

[Minor] Many cleanup (#1357)

2024-09-09 04:14:11 -07:00

json_decode_regex

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

json_jump_forward

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

json_schema

Merged three native APIs into one: get_server_info (#2152)

2024-11-24 01:37:58 -08:00

kernels

benchmark decoding attention kernel with cudnn (#2467)

2024-12-17 03:31:57 -08:00

line_retrieval

…

llava_bench

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

llm_judge

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

long_json_decode

…

lora

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

mmlu

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

mtbench

…

multi_chain_reasoning

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

multi_document_qa

…

multi_turn_chat

[router] cache-aware load-balancing router v1 (#2114)

2024-11-23 08:34:48 -08:00

react

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

tip_suggestion

minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926)

2024-11-06 13:46:04 +00:00

tree_of_thought_deep

…

tree_of_thought_v0

…