Ho-Ren (Jack) Chuang 76196b3cbf feat: Add FP4 (E2M1) KV Cache Support with Quantization Utilities for MLA (#10078) ...

Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
Co-authored-by: Yichen Wang <yichen.wang@bytedance.com>

2025-11-01 22:24:58 -07:00

..

cpp_radix_tree

…

storage

fix default env var for mooncake store (#12429)

2025-11-01 01:25:33 +08:00

allocator_ascend.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

allocator.py

EAGLE cache fix for SWARadixCache (#11231)

2025-10-07 18:21:37 +08:00

base_prefix_cache.py

Add trait for BasePrefixCache (#12436)

2025-10-31 14:03:27 +08:00

chunk_cache.py

[Fix] memory leak by overlap + retract (#11981)

2025-10-23 22:59:23 +08:00

common.py

Use explicit uint64 dtype for Tensor data_ptr() to avoid overflow (#11994)

2025-10-27 19:05:57 -07:00

evict_policy.py

[HiCache] feat: add more eviction policy (#11506)

2025-10-18 15:49:45 +00:00

flush_cache.py

…

hicache_storage.py

[Fix]: HiCache hasher failed when EAGLE mode enabled (#12025)

2025-10-24 23:53:13 +08:00

hiradix_cache.py

feat(hicache): Support passing prefix keys for l3 store. (#9045)

2025-10-10 00:22:05 -07:00

mamba_radix_cache.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

memory_pool_host.py

[Bug fix] Fix severe memory waste issue with torch.empty pin_memory (#12266)

2025-10-31 21:30:37 +08:00

memory_pool.py

feat: Add FP4 (E2M1) KV Cache Support with Quantization Utilities for MLA (#10078)

2025-11-01 22:24:58 -07:00

multimodal_cache.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

radix_cache_cpp.py

Refactor kv cache free (#11351)

2025-10-14 17:45:19 -07:00

radix_cache.py

Fix crash after flush cache (#12107)

2025-10-27 23:52:27 +08:00

swa_radix_cache.py

Refactor kv cache free (#11351)

2025-10-14 17:45:19 -07:00

utils.py

feat: Add FP4 (E2M1) KV Cache Support with Quantization Utilities for MLA (#10078)

2025-11-01 22:24:58 -07:00