Zhihao Zhang 6f08488042 fix missing output_token_logprobs when using ngram speculative decoding (#10702) ...

Co-authored-by: a4zhangfei <a4zhangfei@qq.com>

2025-11-10 02:04:42 -08:00

..

cpp_ngram

fix missing output_token_logprobs when using ngram speculative decoding (#10702)

2025-11-10 02:04:42 -08:00

base_spec_worker.py

Fix flush cache API for spec v2 (#11918)

2025-10-21 23:01:16 +08:00

draft_utils.py

[Feature] Support DeepSeek MTP on NPU (#11897)

2025-10-30 21:56:56 +08:00

eagle_draft_cuda_graph_runner.py

Register allgather/reducescatter buffers with symm memory (#12572)

2025-11-04 17:11:36 -08:00

eagle_draft_extend_cuda_graph_runner.py

Register allgather/reducescatter buffers with symm memory (#12572)

2025-11-04 17:11:36 -08:00

eagle_info_v2.py

[spec v2] Fix output repetition by speculative sampling error (#12561)

2025-11-03 23:00:17 +08:00

eagle_info.py

[Feature] Support DeepSeek MTP on NPU (#11897)

2025-10-30 21:56:56 +08:00

eagle_utils.py

[Feature] Support DeepSeek MTP on NPU (#11897)

2025-10-30 21:56:56 +08:00

eagle_worker_v2.py

Add --speculative-moe-runner-backend server arg (#10183)

2025-11-04 00:20:56 -08:00

eagle_worker.py

Add --speculative-moe-runner-backend server arg (#10183)

2025-11-04 00:20:56 -08:00

ngram_info.py

Depreate global_server_args_dict (#11528)

2025-10-13 19:34:43 +08:00

ngram_worker.py

fix missing output_token_logprobs when using ngram speculative decoding (#10702)

2025-11-10 02:04:42 -08:00

spec_info.py

Fix Duplicate Classmethod in spec_info.py (#12354)

2025-10-29 13:57:10 -07:00

spec_utils.py

[Feature] Support DeepSeek MTP on NPU (#11897)

2025-10-30 21:56:56 +08:00

standalone_worker.py

Add --speculative-moe-runner-backend server arg (#10183)

2025-11-04 00:20:56 -08:00