Yueyang PanandZhiqiang Xie 25482edb5c Online serving benchmarks of real datasets for hierarchical KV caching (#3211) ...

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

2025-03-05 16:16:43 -08:00

..

bench_in_batch_prefix

Add a benchmark script for in-batch prefix caching (#2494)

2024-12-16 18:49:02 -08:00

benchmark_vllm_060

…

blog_v0_2

Add a new api configure_logging to allow dumping the requests (#2875)

2025-01-13 14:24:00 -08:00

deepseek_v3

revert "Docs: Reorngaize dpsk links #3900" (#3933)

2025-02-27 08:57:13 -08:00

dspy

…

generative_agents

…

gsm8k

minor: support specifying local dataset path for gsm8k and hellaswag (#2816)

2025-01-09 22:24:42 +08:00

hellaswag

minor: support specifying local dataset path for gsm8k and hellaswag (#2816)

2025-01-09 22:24:42 +08:00

hicache

Online serving benchmarks of real datasets for hierarchical KV caching (#3211)

2025-03-05 16:16:43 -08:00

json_decode_regex

[BugFix] Fix crash when receive a req with structed output in DP attention mode. (#3841)

2025-02-25 09:32:05 -08:00

json_jump_forward

…

json_schema

…

kernels

Improve code styles (#4021)

2025-03-03 03:20:23 -08:00

line_retrieval

misc: add pre-commit config (#637)

2024-07-17 11:55:39 -07:00

llava_bench

…

llm_judge

…

long_json_decode

…

lora

[Feature] Define backends and add Triton backend for Lora (#3161)

2025-02-03 22:09:13 -08:00

mmlu

…

mmmu

bench: Add MMMU benchmark for vLM (#3562)

2025-02-22 08:10:59 -08:00

mtbench

…

multi_chain_reasoning

…

multi_document_qa

Organize Benchmark (#381)

2024-05-05 16:14:17 +08:00

multi_turn_chat

…

react

…

reasoning_benchmark

Variance measure for reasoning benchmark (#3677)

2025-02-20 03:49:49 +08:00

tip_suggestion

…

tree_of_thought_deep

Improve type annotation and styles (#2926)

2025-01-16 12:51:11 -08:00

tree_of_thought_v0

…