Ke Bao ce8a6ac690 Evict swa kv cache during decoding (#17220)

2026-01-19 22:36:52 +08:00

..

cpp_ngram

fix missing output_token_logprobs when using ngram speculative decoding (#10702)

2025-11-10 02:04:42 -08:00

base_spec_worker.py

Fix flush cache API for spec v2 (#11918)

2025-10-21 23:01:16 +08:00

draft_utils.py

Support using different attention backend for draft decoding. (#14843)

2025-12-19 08:49:11 +08:00

eagle_draft_cuda_graph_runner.py

feat(SpecEagleV2): add standalone_worker_v2 (#12625)

2025-12-30 17:55:04 +08:00

eagle_draft_extend_cuda_graph_runner.py

[SPEC_V2] Enable cudagraph draft_extend for trtllm_mla_backend and Acclen Fix for DP under cudagraph mode (#16974)

2026-01-18 15:56:21 +08:00

eagle_info_v2.py

Evict swa kv cache during decoding (#17220)

2026-01-19 22:36:52 +08:00

eagle_info.py

[Auto Sync] Update schedule_batch.py, common.py, eagle_info... (20260105) (#16519)

2026-01-08 02:35:46 -08:00

eagle_utils.py

[Feature] Spec-Overlap supporting DP-ATTN; PD-Disaggregation; npugraph mode (#12443)

2025-11-15 21:51:07 +08:00

eagle_worker_v2.py

[SPEC_V2] Enable cudagraph draft_extend for trtllm_mla_backend and Acclen Fix for DP under cudagraph mode (#16974)

2026-01-18 15:56:21 +08:00

eagle_worker.py

Evict swa kv cache during decoding (#17220)

2026-01-19 22:36:52 +08:00

multi_layer_eagle_draft_extend_cuda_graph_runner.py

Adjust wrong mtp meaning introduce by mimo (#15632)

2025-12-23 02:06:46 +08:00

multi_layer_eagle_utils.py

Adjust wrong mtp meaning introduce by mimo (#15632)

2025-12-23 02:06:46 +08:00

multi_layer_eagle_worker_v2.py

Tiny cleanup duplicate code for multi-layer eagle worker. (#16004)

2025-12-28 18:08:20 +08:00

multi_layer_eagle_worker.py

Tiny cleanup duplicate code for multi-layer eagle worker. (#16004)

2025-12-28 18:08:20 +08:00

ngram_info.py

[2/N] clean duplicate code of logprob processing in spec. (#15593)

2025-12-24 15:21:13 +08:00

ngram_worker.py

[2/N] clean duplicate code of logprob processing in spec. (#15593)

2025-12-24 15:21:13 +08:00

spec_info.py

Tiny simplify draft worker init. (#16446)

2026-01-09 11:20:29 +08:00

spec_utils.py

Adjust wrong mtp meaning introduce by mimo (#15632)

2025-12-23 02:06:46 +08:00

standalone_worker_v2.py

feat(SpecEagleV2): add standalone_worker_v2 (#12625)

2025-12-30 17:55:04 +08:00

standalone_worker.py

support mtp with deepseek r1 nvfp4 model (#13115)

2025-12-06 00:45:54 -08:00