Yi-Chia Chen 2bfab1bb67 Fix radix cache key to include generated tokens in multi-turn (regression) (#16521) ...

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>

2026-02-10 14:08:34 -08:00

..

cpp_radix_tree

Fix syntax errors in cpp_radix_tree (#13315)

2025-11-15 11:35:43 +08:00

sparsity

[3/N][Sparse With Hicache]: Init sparse coordinator (#16086)

2026-01-05 17:51:04 -08:00

storage

Refactoring Mooncake TE as a shared distributed component (#17810)

2026-02-09 10:53:11 +08:00

allocator.py

Moving _alloc_extend_naive out of npu allocator (#18200)

2026-02-04 02:09:55 -08:00

base_prefix_cache.py

[metric] Optional extra metric labels (#18049)

2026-02-01 14:25:59 +08:00

cache_init_params.py

[Auto Sync] Update cache_init_params.py (20260209) (#18502)

2026-02-09 14:49:41 -08:00

chunk_cache.py

[Fix] data race in req_to_token pool (#17850)

2026-02-02 14:38:15 -08:00

common.py

[Fix] data race in req_to_token pool (#17850)

2026-02-02 14:38:15 -08:00

evict_policy.py

[Auto Sync] Update evict_policy.py, radix_cache.py (20251120) (#13669)

2025-11-21 22:07:36 -08:00

flush_cache.py

Update docs (#1839)

2024-10-30 02:49:08 -07:00

hicache_storage.py

[HiCache] Add PP Support with suffix pp rank (#15175)

2026-01-03 13:49:21 +08:00

hiradix_cache.py

[HiCache] fix: StorageMetricsCollector was initialized twice (#18354)

2026-02-10 00:53:00 -08:00

mamba_radix_cache.py

[RadixTree][5/N Refactor]: Introduce pre and post-processing methods for key matching (#18147)

2026-02-04 17:10:46 +08:00

memory_pool_host.py

[HiCache]: Support DeepSeek v32 cpu offloading (#17415)

2026-02-02 18:07:37 -08:00

memory_pool.py

Revert "optimize get_topk_ragged by fusing get k and k_scale triton kernel" (#18471)

2026-02-09 16:37:19 +08:00

multimodal_cache.py

EVS Framework: Support NemotronH_Nano_VL_V2 (#14051)

2026-01-05 16:18:07 +08:00

radix_cache_cpp.py

[Fix] data race in req_to_token pool (#17850)

2026-02-02 14:38:15 -08:00

radix_cache.py

Fix radix cache key to include generated tokens in multi-turn (regression) (#16521)

2026-02-10 14:08:34 -08:00

swa_memory_pool.py

Introduce global alloc_len_per_decode & clean check decode memory (#15115)

2026-01-26 10:26:20 -08:00

swa_radix_cache.py

[RadixTree][5/N Refactor]: Introduce pre and post-processing methods for key matching (#18147)

2026-02-04 17:10:46 +08:00

utils.py

Optimize FP8 MLA KV cache writes with Triton kernel (#15522)

2025-12-25 12:35:39 -08:00