Uranus 982db4ebac Feat: GLM-4.6 supports shared experts fusion (#13873) ...

Signed-off-by: UranusSeven <109661872+UranusSeven@users.noreply.github.com>
Co-authored-by: Kevin-XiongC <kevin_xiong1997@outlook.com>
Co-authored-by: Mingyi Jin <jinmingyi1998@sina.cn>

2025-12-01 11:33:18 +08:00

..

bench_attention_sink

bench: add attention sink op benchmark, triton and trtllm-gen [B200] (#8932)

2025-08-08 00:16:23 -07:00

bench_in_batch_prefix

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

benchmark_batch

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

benchmark_vllm_060

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

blog_v0_2

Add a new api configure_logging to allow dumping the requests (#2875)

2025-01-13 14:24:00 -08:00

boolq

[benchmark] Add benchmark scripts for ceval and boolq (#8946)

2025-08-23 15:40:15 +08:00

ceval

fix ceval (#10504)

2025-09-24 02:35:25 +08:00

deepseek_v3

chore: bump SGLang version to 0.5.5.post3 (#13366)

2025-11-16 17:55:38 -08:00

dspy

Organize Benchmark (#381)

2024-05-05 16:14:17 +08:00

generative_agents

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

gpt_oss

[Fix] Add speculative_draft_model_revision to server_args (#5255)

2025-09-05 19:45:46 +08:00

gsm8k

Simplify frontend language (#9029)

2025-08-10 10:59:30 -07:00

hellaswag

Simplify frontend language (#9029)

2025-08-10 10:59:30 -07:00

hf3fs

[HotFix]: Hot fix import path in 3fs_bench_client.py (#10463)

2025-09-14 23:45:46 -07:00

hicache

[Feature] HiCache JIT kernel (once again) (#13764)

2025-11-22 22:19:16 -08:00

json_decode_regex

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

json_jump_forward

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

json_schema

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

kernels

Feat: GLM-4.6 supports shared experts fusion (#13873)

2025-12-01 11:33:18 +08:00

line_retrieval

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

llava_bench

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

llm_judge

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

long_json_decode

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

lora

Fix lora test (#13479)

2025-11-18 12:21:57 +08:00

mmlu

Minor tool for comparison of benchmark results (#7974)

2025-07-27 00:27:50 -07:00

mmmu

Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277)

2025-11-26 16:28:52 -07:00

mtbench

Support FlashAttention3 page_size > 1 and topk > 1 case with paged attn and spec decode (#7725)

2025-11-26 11:44:41 +08:00

multi_chain_reasoning

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

multi_document_qa

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

multi_turn_chat

Tiny move files to utils folder (#11166)

2025-10-03 22:40:06 +08:00

prefill_only

[Fix] Fix uvloop get_event_loop() is not suitable for 0.22.x (#13612)

2025-11-25 01:20:00 +08:00

react

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

reasoning_benchmark

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

tip_suggestion

Replace time.time() to time.perf_counter() for benchmarking. (#6178)

2025-05-11 14:32:49 -07:00

tree_of_thought_deep

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

tree_of_thought_v0

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00