 pansicheng
|
48642d5384
|
[RadixTree][4/N Refactor]: Move available_and_evictable_str to individual radix cache classes (#17852)
|
2026-02-19 17:03:15 +08:00 |
|
|
pansicheng
|
b21390f8f3
|
Adapt the Qwen2Model._update_causal_mask for transformers==4.57.1 (#18774)
|
2026-02-17 10:20:41 +08:00 |
|
|
|
7d4ae057ec
|
[Kernel] Add JIT rotary_embedding_kernel (#17934)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: root <root@zhikuan-A10x2.ea134>
|
2026-02-13 12:41:25 +08:00 |
|
|
pansicheng
|
2eb4359ada
|
[Kernel] Add JIT apply_rope_with_cos_sin_cache_inplace (#18155)
|
2026-02-05 21:49:37 +08:00 |
|
|
pansichengandZhiqiang Xie
|
d879e37f1b
|
Add interface_v1 option for dynamic HiCache backend (#13140)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-11-17 17:42:17 -08:00 |
|
|
pansicheng
|
0cae873fcd
|
check_offload_progress more frequently (#11656)
|
2025-10-28 00:37:38 +08:00 |
|
|
pansicheng
|
08af8ffb5c
|
fix 3fs indices (#10855)
|
2025-10-04 00:06:38 +08:00 |
|
|
|
d4041a5eeb
|
refactor zero copy (#10300)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-09-22 15:17:31 -07:00 |
|
|
pansichengandZhiqiang Xie
|
f84db115b1
|
Add storage read/write bandwidth logs to monitor kvcache performance (#9965)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-05 16:52:55 -07:00 |
|
|
pansichengandZhiqiang Xie
|
d07304870b
|
fix 3fs zerocopy (#9938)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-04 13:24:12 -07:00 |
|
|
pansicheng
|
c67569491c
|
Ensure chunked request extension length respects both rem_chunk_tokens and rem_total_tokens limits (#10003)
|
2025-09-04 04:15:26 -07:00 |
|
|
pansicheng
|
09a1df2231
|
add bench_mix.py (#9788)
|
2025-08-28 23:44:26 -07:00 |
|
|
pansichengandZhiqiang Xie
|
70cf4abccc
|
3fs zerocopy (#9109)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-22 17:56:38 +08:00 |
|
|
pansichengandZhiqiang Xie
|
733446dd36
|
fix io group (#9154)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-14 12:46:42 +08:00 |
|
|
pansicheng
|
e2fd2b9c7e
|
Simple prefetch policy (#8692)
|
2025-08-08 02:09:28 -07:00 |
|
|
pansicheng
|
20b5563eda
|
Add hf3fs_utils.cpp to package-data (#8653)
|
2025-08-01 12:41:09 +08:00 |
|
|
pansichengandZhiqiang Xie
|
3dde86194a
|
Conditionally import HiCacheHF3FS (#8598)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-31 14:59:29 -07:00 |
|
|
pansichengandZhiqiang Xie
|
299803343d
|
Add hf3fs support for hicache storage (based on #7704) (#7280)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-30 17:42:41 -07:00 |
|
|
pansichengandZhiqiang Xie
|
7f3ee861ae
|
fix overlap pagecount (#6984)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-06-21 15:34:45 +08:00 |
|
|
pansicheng
|
2f4ec752bc
|
filter by num_hidden_layers (#7056)
|
2025-06-13 00:53:09 -07:00 |
|
|
pansicheng
|
27e327b415
|
fix new_page_count_next_decode (#6671)
|
2025-06-02 22:48:52 -07:00 |
|