 yuyu5333andzhangheng
|
230fb55899
|
[Performance] Decode Offload improves the long texts performance 100% through dynamic block offload. (#17216)
Co-authored-by: zhangheng <hzh0425@apache.org>
|
2026-03-08 17:16:53 +08:00 |
|
|
Kangyan-ZhouandClaude Opus 4.6
|
dc02e5bea7
|
[HiCache] Re-land spec v2 + decode KV cache offloading compatibility (#19615)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-03-01 13:58:31 -08:00 |
|
|
Kangyan-Zhou
|
dcf462cfba
|
Revert "[HiCache] Enable spec v2 + decode KV cache offloading compatibility" (#19613)
|
2026-02-28 21:54:32 -08:00 |
|
|
Kangyan-ZhouandClaude Opus 4.6
|
8167346609
|
[HiCache] Enable spec v2 + decode KV cache offloading compatibility (#19518)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-28 21:53:52 -08:00 |
|