 zhangheng
|
079fc8f3c5
|
[piecewise graph]: support MiniMax-M2 (#18217)
|
2026-02-04 23:24:38 -08:00 |
|
|
zhangheng
|
be557cbc5f
|
[RadixTree][5/N Refactor]: Introduce pre and post-processing methods for key matching (#18147)
|
2026-02-04 17:10:46 +08:00 |
|
|
zhanghengand晟海
|
180594358b
|
[HiCache]: Support DeepSeek v32 cpu offloading (#17415)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-02-02 18:07:37 -08:00 |
|
|
zhangheng
|
f33022d039
|
[RadixTree][3/N Refactor]：Support unified insert/evict params (#17401)
|
2026-01-22 17:36:31 +08:00 |
|
|
|
20b0523eca
|
[RadixTree][1/N Refactor]: Support unified match_prefix params (#17142)
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
|
2026-01-19 22:39:40 +08:00 |
|
|
|
2d02c150dc
|
[3/N][Sparse With Hicache]: Init sparse coordinator (#16086)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-01-05 17:51:04 -08:00 |
|
|
|
a89e85e739
|
[1/N][Sparse With Hicache]: Add Sparse Interface (#14741)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: MagicYang1573 <1328657938@qq.com>
|
2025-12-25 00:12:47 -08:00 |
|
|
zhanghengandZhiqiang Xie
|
ea7c69ce28
|
[hotfix]: Add missing args for 3FS bench_client.py (#14791)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-12-14 11:13:19 -10:00 |
|
|
hzh0425
|
ed5e905c89
|
[HotFix]: Add missing SGLANG_EPLB_HEATMAP_COLLECTION_INTERVAL env var (#12776)
|
2025-11-06 18:58:44 -08:00 |
|
|
hzh0425
|
d9c812d881
|
[hotfix]: Resolve ModuleNotFoundError in PD deployment for is_in_ci() (#12772)
|
2025-11-06 18:48:03 -08:00 |
|
|
hzh0425
|
6b634493c3
|
[HICache / PD]: Support offloading incremental KV cache in decode side. (#11966)
|
2025-11-01 14:59:37 -07:00 |
|
|
hzh0425
|
318424e2c8
|
[HICache]: Support 3FS-Store with page_first_direct layout (#11460)
|
2025-10-13 15:47:22 +08:00 |
|
|
hzh0425andyizhang2077
|
f5b34a510c
|
Bugfix: Fix Type consistency for KV indices in SWARadixCache (#11452)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-10-12 23:19:44 +08:00 |
|
|
|
ee3bd8a1c8
|
feat(hicache): Support passing prefix keys for l3 store. (#9045)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-10-10 00:22:05 -07:00 |
|
|
|
df08bf9b9f
|
[Doc]: Best Practice for HICache (#11001)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-10-08 00:59:21 +08:00 |
|
|
|
c70e58e837
|
[HICache]: Refactor HiCache CI (#11011)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-10-03 20:51:56 -04:00 |
|
|
hzh0425andTeng Ma
|
c8a5d12abe
|
[HiCache]: Support dynamic loading backends for hicache (#10551)
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2025-09-26 18:34:11 -07:00 |
|
|
hzh0425andShangming Cai
|
7ec5b4e89c
|
[PD-HiCache]: Support Async Offloading KVCache In Decode Side (#10192)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-25 23:20:49 -07:00 |
|
|
hzh0425
|
2a37b24d23
|
[HotFix]: Hot fix import path in 3fs_bench_client.py (#10463)
|
2025-09-14 23:45:46 -07:00 |
|
|
hzh0425
|
ec99668ab7
|
[Hicache]: Add E2E CI For 3FS-KVStore (#10131)
|
2025-09-08 01:54:50 -07:00 |
|
|
hzh0425
|
1a3d6f31da
|
Modify ci workflow for auto-partitioning in 2-GPU backend tests (#10029)
|
2025-09-06 10:28:42 +08:00 |
|
|
hzh0425andZhiqiang Xie
|
106c2b31fb
|
feat(hicache): Add generic hicache ci e2e test and benchmark test (#9846)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-04 20:43:46 +08:00 |
|
|
hzh0425
|
4d89389c4f
|
Fix the key passing issue in page first layout. (#9929)
|
2025-09-02 11:30:11 -07:00 |
|
|
hzh0425
|
58d06fdc95
|
[HiCacheStorage]: Improve 3fs kvstore‘s performance and resolve mla issues (#9876)
|
2025-09-01 19:01:48 -07:00 |
|
|
hzh0425andZhiqiang Xie
|
8c2ffaaf0f
|
fix(hicahce-long-bench): adjust context workload generator to use full query set (#9847)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-31 14:51:18 -07:00 |
|
|
hzh0425andyizhang2077
|
c2a26e725c
|
feature(eplb): add min-rebalancing-utilization-threshold for eplb (#8345)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-08-30 11:24:29 +08:00 |
|
|
hzh0425
|
161e9dc51e
|
feat(hicache-3fs): 3FS-Store Backup Optimizations For MLA Model. (#9692)
|
2025-08-29 10:48:51 -07:00 |
|
|
hzh0425
|
38cd5fb1e0
|
bugfix(hicache): Move exists check before key suffixing (#9749)
|
2025-08-28 18:29:47 -07:00 |
|
|
hzh0425andTeng Ma
|
c04c17edfa
|
refactor(hicache): Introduce generic HiCacheStorageConfig for improved configuration management (#9555)
Co-authored-by: Teng Ma <805522925@qq.com>
|
2025-08-26 17:55:20 -07:00 |
|
|
hzh0425andZhiqiang Xie
|
79ce3688bb
|
BugFix(hicache): Fix host indices out of bound error (#9637)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-26 10:42:23 -07:00 |
|
|
hzh0425
|
83871aa12d
|
feat(hicache): Supports 3fs-hicache compatibility with dp-attention (#9372)
|
2025-08-23 02:08:32 -07:00 |
|
|
hzh0425
|
f7dd651dbd
|
feat(hicache-3fs): 3FS-SGLang Hierarchical Cache Deployment Guide (#9213)
|
2025-08-14 23:54:31 -07:00 |
|
|
hzh0425andZhiqiang Xie
|
1b7afad0dd
|
feature(hicache): Support hf3fs-hicache reusing kvcache across different instances (#8673)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-09 01:03:00 -07:00 |
|
|
hzh0425
|
d1c4d51c08
|
bugfix(hicache): Fix 'MooncakeStore' not defined error. (#8668)
|
2025-08-01 15:58:17 -07:00 |
|
|
|
2fbb754e1d
|
feature(pd-hicache): Prefill instances support reusing the RemoteStorage Cache via HiCache. (#8516)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-29 21:19:25 -07:00 |
|
|
hzh0425
|
a85ebf50b8
|
feat(hicache): support file backend reading directory config form env. (#8498)
|
2025-07-29 21:18:46 -07:00 |
|
|
hzh0425
|
5c08a36cbf
|
[Fix] ensure DeepGEMM is only enabled for FP8_W8A8 models (#8110)
|
2025-07-16 21:33:29 -07:00 |
|