 PiteXChenandZhiqiang Xie
|
8b22deef5b
|
fix【hicache】fix the KV cache resource occupation and invalid loading from prefetch when pending requests are aborted. (#16369)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-01-15 15:14:38 -08:00 |
|
|
PiteXChenandZhiqiang Xie
|
eac5b66485
|
[RadixTree] Optimize the Time Complexity of Node Retrieval Operation from O(n*m) to O(n) (#13334)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-12-08 15:55:09 -08:00 |
|
|
PiteXChen
|
dc7bdc7329
|
bugfix[schedule]: Excessive preemption occurs when preempting running requests to schedule new prefill requests. (#12494)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
|
2025-11-30 22:29:26 +08:00 |
|
|
PiteXChen
|
527b7d3f59
|
[RadixTree] Reduce Stack Push/Pop Overhead for Leaf Nodes, Improve radix_tree Leaf Collection Performance (#12199)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
|
2025-11-11 23:35:39 +08:00 |
|
|
PiteXChen
|
e2a784ecda
|
[RadixTree] Reduce Syscalls, Optimize Collection Filtering and Align with cpp (#12239)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
|
2025-11-10 17:47:59 +08:00 |
|