Scott Lee c59b9223e6 Add spec_accept_histogram request statistic (#18332)

2026-02-12 21:09:21 +08:00

..

cpp_ngram

fix missing output_token_logprobs when using ngram speculative decoding (#10702)

2025-11-10 02:04:42 -08:00

base_spec_worker.py

…

draft_utils.py

Support using different attention backend for draft decoding. (#14843)

2025-12-19 08:49:11 +08:00

eagle_draft_cuda_graph_runner.py

feat(SpecEagleV2): add standalone_worker_v2 (#12625)

2025-12-30 17:55:04 +08:00

eagle_draft_extend_cuda_graph_runner.py

[SPEC_V2] Enable cudagraph draft_extend for trtllm_mla_backend and Acclen Fix for DP under cudagraph mode (#16974)

2026-01-18 15:56:21 +08:00

eagle_info_v2.py

Fix idle batch predict dtype in spec v2 (#18379)

2026-02-10 10:29:13 +08:00

eagle_info.py

Add spec_accept_histogram request statistic (#18332)

2026-02-12 21:09:21 +08:00

eagle_utils.py

[Feature] Spec-Overlap supporting DP-ATTN; PD-Disaggregation; npugraph mode (#12443)

2025-11-15 21:51:07 +08:00

eagle_worker_v2.py

Tiny rename for spec related fileds. (#18468)

2026-02-09 00:10:39 -08:00

eagle_worker.py

model: support Qwen3.5 (#18489)

2026-02-10 00:27:59 +08:00

multi_layer_eagle_draft_extend_cuda_graph_runner.py

Tiny rename for spec related fileds. (#18468)

2026-02-09 00:10:39 -08:00

multi_layer_eagle_utils.py

Adjust wrong mtp meaning introduce by mimo (#15632)

2025-12-23 02:06:46 +08:00

multi_layer_eagle_worker_v2.py

Tiny rename for spec related fileds. (#18468)

2026-02-09 00:10:39 -08:00

multi_layer_eagle_worker.py

Tiny rename for spec related fileds. (#18468)

2026-02-09 00:10:39 -08:00

ngram_info.py

Add spec_accept_histogram request statistic (#18332)

2026-02-12 21:09:21 +08:00

ngram_worker.py

[BugFix] Fix server crashes when req.grammar and ngram spec are enabled (#17585)

2026-01-30 11:57:42 -08:00

spec_info.py

Tiny simplify draft worker init. (#16446)

2026-01-09 11:20:29 +08:00

spec_utils.py

[BugFix] Fix server crashes when req.grammar and ngram spec are enabled (#17585)

2026-01-30 11:57:42 -08:00

standalone_worker_v2.py

feat(SpecEagleV2): add standalone_worker_v2 (#12625)

2025-12-30 17:55:04 +08:00

standalone_worker.py

support mtp with deepseek r1 nvfp4 model (#13115)

2025-12-06 00:45:54 -08:00