 hzh0425
|
6b634493c3
|
[HICache / PD]: Support offloading incremental KV cache in decode side. (#11966)
|
2025-11-01 14:59:37 -07:00 |
|
|
hzh0425
|
318424e2c8
|
[HICache]: Support 3FS-Store with page_first_direct layout (#11460)
|
2025-10-13 15:47:22 +08:00 |
|
|
hzh0425andyizhang2077
|
f5b34a510c
|
Bugfix: Fix Type consistency for KV indices in SWARadixCache (#11452)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-10-12 23:19:44 +08:00 |
|
|
|
ee3bd8a1c8
|
feat(hicache): Support passing prefix keys for l3 store. (#9045)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-10-10 00:22:05 -07:00 |
|
|
|
df08bf9b9f
|
[Doc]: Best Practice for HICache (#11001)
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-10-08 00:59:21 +08:00 |
|
|
|
c70e58e837
|
[HICache]: Refactor HiCache CI (#11011)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-10-03 20:51:56 -04:00 |
|
|
hzh0425andTeng Ma
|
c8a5d12abe
|
[HiCache]: Support dynamic loading backends for hicache (#10551)
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2025-09-26 18:34:11 -07:00 |
|
|
hzh0425andShangming Cai
|
7ec5b4e89c
|
[PD-HiCache]: Support Async Offloading KVCache In Decode Side (#10192)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-25 23:20:49 -07:00 |
|
|
hzh0425
|
2a37b24d23
|
[HotFix]: Hot fix import path in 3fs_bench_client.py (#10463)
|
2025-09-14 23:45:46 -07:00 |
|
|
hzh0425
|
ec99668ab7
|
[Hicache]: Add E2E CI For 3FS-KVStore (#10131)
|
2025-09-08 01:54:50 -07:00 |
|
|
hzh0425
|
1a3d6f31da
|
Modify ci workflow for auto-partitioning in 2-GPU backend tests (#10029)
|
2025-09-06 10:28:42 +08:00 |
|
|
hzh0425andZhiqiang Xie
|
106c2b31fb
|
feat(hicache): Add generic hicache ci e2e test and benchmark test (#9846)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-04 20:43:46 +08:00 |
|
|
hzh0425
|
4d89389c4f
|
Fix the key passing issue in page first layout. (#9929)
|
2025-09-02 11:30:11 -07:00 |
|
|
hzh0425
|
58d06fdc95
|
[HiCacheStorage]: Improve 3fs kvstore‘s performance and resolve mla issues (#9876)
|
2025-09-01 19:01:48 -07:00 |
|
|
hzh0425andZhiqiang Xie
|
8c2ffaaf0f
|
fix(hicahce-long-bench): adjust context workload generator to use full query set (#9847)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-31 14:51:18 -07:00 |
|
|
hzh0425andyizhang2077
|
c2a26e725c
|
feature(eplb): add min-rebalancing-utilization-threshold for eplb (#8345)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-08-30 11:24:29 +08:00 |
|
|
hzh0425
|
161e9dc51e
|
feat(hicache-3fs): 3FS-Store Backup Optimizations For MLA Model. (#9692)
|
2025-08-29 10:48:51 -07:00 |
|
|
hzh0425
|
38cd5fb1e0
|
bugfix(hicache): Move exists check before key suffixing (#9749)
|
2025-08-28 18:29:47 -07:00 |
|
|
hzh0425andTeng Ma
|
c04c17edfa
|
refactor(hicache): Introduce generic HiCacheStorageConfig for improved configuration management (#9555)
Co-authored-by: Teng Ma <805522925@qq.com>
|
2025-08-26 17:55:20 -07:00 |
|
|
hzh0425andZhiqiang Xie
|
79ce3688bb
|
BugFix(hicache): Fix host indices out of bound error (#9637)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-26 10:42:23 -07:00 |
|
|
hzh0425
|
83871aa12d
|
feat(hicache): Supports 3fs-hicache compatibility with dp-attention (#9372)
|
2025-08-23 02:08:32 -07:00 |
|
|
hzh0425
|
f7dd651dbd
|
feat(hicache-3fs): 3FS-SGLang Hierarchical Cache Deployment Guide (#9213)
|
2025-08-14 23:54:31 -07:00 |
|
|
hzh0425andZhiqiang Xie
|
1b7afad0dd
|
feature(hicache): Support hf3fs-hicache reusing kvcache across different instances (#8673)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-09 01:03:00 -07:00 |
|
|
hzh0425
|
d1c4d51c08
|
bugfix(hicache): Fix 'MooncakeStore' not defined error. (#8668)
|
2025-08-01 15:58:17 -07:00 |
|
|
|
2fbb754e1d
|
feature(pd-hicache): Prefill instances support reusing the RemoteStorage Cache via HiCache. (#8516)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-29 21:19:25 -07:00 |
|
|
hzh0425
|
a85ebf50b8
|
feat(hicache): support file backend reading directory config form env. (#8498)
|
2025-07-29 21:18:46 -07:00 |
|
|
hzh0425
|
5c08a36cbf
|
[Fix] ensure DeepGEMM is only enabled for FP8_W8A8 models (#8110)
|
2025-07-16 21:33:29 -07:00 |
|