huangtingwei b4c2c421e9 support memory_pool_host page first direct layout (#10031) ...

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

2025-09-11 23:19:44 -07:00

..

cpp_radix_tree

[Feature] Radix Tree in C++ (#7369)

2025-08-02 19:50:14 -07:00

storage

[HiCache] feat: add mooncake backend extra config (#10213)

2025-09-09 12:50:00 -07:00

allocator_ascend.py

Tiny fix CI (#9306)

2025-08-18 16:54:36 -07:00

allocator.py

fix swa clear(): rename is_in_free_group to is_not_in_free_group (#9914)

2025-09-03 11:42:12 -07:00

base_prefix_cache.py

SWA Prefix Cache (#7367)

2025-07-13 12:31:07 -07:00

chunk_cache.py

[HiCache] resolve conflict between chunked-prefill and hicache hit count (#9776)

2025-08-30 01:30:54 +08:00

flush_cache.py

Update docs (#1839)

2024-10-30 02:49:08 -07:00

hicache_storage.py

[HiStorage] Remove delete and clear as necessary methods (#10039)

2025-09-06 10:27:26 +08:00

hiradix_cache.py

[Refactor] Remove Hicache Load & Write threads (#10127)

2025-09-08 22:18:50 -07:00

lora_radix_cache.py

[HiCache] resolve conflict between chunked-prefill and hicache hit count (#9776)

2025-08-30 01:30:54 +08:00

memory_pool_host.py

support memory_pool_host page first direct layout (#10031)

2025-09-11 23:19:44 -07:00

memory_pool.py

[Qwen3-Next] switch to triton and cache conv states to accelerate MTP from 300 tok/s to 341 tok/s (#10335)

2025-09-11 11:59:48 -07:00

multimodal_cache.py

[Feature][Multimodal] Implement LRU cache for multimodal embeddings (#8292)

2025-08-06 23:21:40 -07:00

radix_cache_cpp.py

[HiCache] resolve conflict between chunked-prefill and hicache hit count (#9776)

2025-08-30 01:30:54 +08:00

radix_cache.py

[Refactor] Remove Hicache Load & Write threads (#10127)

2025-09-08 22:18:50 -07:00

swa_radix_cache.py

[Refactor] Remove Hicache Load & Write threads (#10127)

2025-09-08 22:18:50 -07:00