Liangsheng Yin 5c75907e62 Introduce native kv cache move (#15108)

2025-12-14 17:23:28 +08:00

..

cpp_radix_tree

Fix syntax errors in cpp_radix_tree (#13315)

2025-11-15 11:35:43 +08:00

storage

[Minor] update docs (#14212)

2025-12-01 02:33:58 -08:00

allocator.py

EAGLE cache fix for SWARadixCache (#11231)

2025-10-07 18:21:37 +08:00

base_prefix_cache.py

[Auto Sync] Update schedule_batch.py, schedule_policy.py, b... (20251122) (#13763)

2025-11-24 14:33:31 -08:00

cache_init_params.py

Refactor cache init logic (#13800)

2025-11-24 11:41:46 +08:00

chunk_cache.py

Refactor cache init logic (#13800)

2025-11-24 11:41:46 +08:00

common.py

Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224)

2025-11-11 02:56:22 +08:00

evict_policy.py

[Auto Sync] Update evict_policy.py, radix_cache.py (20251120) (#13669)

2025-11-21 22:07:36 -08:00

flush_cache.py

Update docs (#1839)

2024-10-30 02:49:08 -07:00

hicache_storage.py

fix: malformed KV events for NVIDIA Dynamo (#13488)

2025-11-28 14:55:20 -08:00

hiradix_cache.py

[RadixTree] Optimize the Time Complexity of Node Retrieval Operation from O(n*m) to O(n) (#13334)

2025-12-08 15:55:09 -08:00

mamba_radix_cache.py

[RadixTree] Optimize the Time Complexity of Node Retrieval Operation from O(n*m) to O(n) (#13334)

2025-12-08 15:55:09 -08:00

memory_pool_host.py

[BugFix] fix prefixcache performance and accuracy on ascend (#13573)

2025-12-08 02:16:20 +08:00

memory_pool.py

Introduce native kv cache move (#15108)

2025-12-14 17:23:28 +08:00

multimodal_cache.py

feat: basic support for server-level multimodal cache (#10775)

2025-11-10 00:27:50 +08:00

radix_cache_cpp.py

Fix nightly test failure: CPP radix cache init (#14018)

2025-11-26 14:58:26 -08:00

radix_cache.py

[RadixTree] Optimize the Time Complexity of Node Retrieval Operation from O(n*m) to O(n) (#13334)

2025-12-08 15:55:09 -08:00

swa_radix_cache.py

[RadixTree] Optimize the Time Complexity of Node Retrieval Operation from O(n*m) to O(n) (#13334)

2025-12-08 15:55:09 -08:00

utils.py

[bug fix] fix ima with get_mla_kv_buffer_kernel overflow (#14224)

2025-12-04 01:20:11 -08:00