Simon (Jiyou) Li b29a026e14 KV‑Cache (MHA, MLA): add missing start_layer / end_layer fields to MHATokenToKVPoolHost and MLATokenToKVPoolHost (#6016) ...

Co-authored-by: 继优 <jiyou.ljy@alibaba-inc.com>
Co-authored-by: chus-chus <chus-chus@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

2025-05-09 15:50:06 -07:00

..

base_prefix_cache.py

Support page size > 1 (#4356)

2025-03-12 22:22:39 -07:00

chunk_cache.py

Fix prefill OOM error in the case of large page size (#5081)

2025-05-05 16:02:55 -07:00

flush_cache.py

Update docs (#1839)

2024-10-30 02:49:08 -07:00

hiradix_cache.py

upstream hicache fixes (#5570)

2025-04-20 23:08:30 -07:00

memory_pool.py

KV‑Cache (MHA, MLA): add missing start_layer / end_layer fields to MHATokenToKVPoolHost and MLATokenToKVPoolHost (#6016)

2025-05-09 15:50:06 -07:00

paged_allocator.py

Large page size aligned hierarchical caching (#4581)

2025-04-01 22:38:15 -07:00

radix_cache.py

Fix: Complete int32 to int64 conversion (#4465)

2025-03-16 18:14:27 -07:00