Commit Graph
18 Commits
Author SHA1 Message Date
hzh0425 ec99668ab7 [Hicache]: Add E2E CI For 3FS-KVStore (#10131) 2025-09-08 01:54:50 -07:00
hzh0425 1a3d6f31da Modify ci workflow for auto-partitioning in 2-GPU backend tests (#10029) 2025-09-06 10:28:42 +08:00
hzh0425andZhiqiang Xie 106c2b31fb feat(hicache): Add generic hicache ci e2e test and benchmark test (#9846)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-09-04 20:43:46 +08:00
hzh0425 4d89389c4f Fix the key passing issue in page first layout. (#9929) 2025-09-02 11:30:11 -07:00
hzh0425 58d06fdc95 [HiCacheStorage]: Improve 3fs kvstore‘s performance and resolve mla issues (#9876) 2025-09-01 19:01:48 -07:00
hzh0425andZhiqiang Xie 8c2ffaaf0f fix(hicahce-long-bench): adjust context workload generator to use full query set (#9847)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-08-31 14:51:18 -07:00
hzh0425andyizhang2077 c2a26e725c feature(eplb): add min-rebalancing-utilization-threshold for eplb (#8345)
Co-authored-by: yizhang2077 <1109276519@qq.com>
2025-08-30 11:24:29 +08:00
hzh0425 161e9dc51e feat(hicache-3fs): 3FS-Store Backup Optimizations For MLA Model. (#9692) 2025-08-29 10:48:51 -07:00
hzh0425 38cd5fb1e0 bugfix(hicache): Move exists check before key suffixing (#9749) 2025-08-28 18:29:47 -07:00
hzh0425andTeng Ma c04c17edfa refactor(hicache): Introduce generic HiCacheStorageConfig for improved configuration management (#9555)
Co-authored-by: Teng Ma <805522925@qq.com>
2025-08-26 17:55:20 -07:00
hzh0425andZhiqiang Xie 79ce3688bb BugFix(hicache): Fix host indices out of bound error (#9637)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-08-26 10:42:23 -07:00
hzh0425 83871aa12d feat(hicache): Supports 3fs-hicache compatibility with dp-attention (#9372) 2025-08-23 02:08:32 -07:00
hzh0425 f7dd651dbd feat(hicache-3fs): 3FS-SGLang Hierarchical Cache Deployment Guide​ (#9213) 2025-08-14 23:54:31 -07:00
hzh0425andZhiqiang Xie 1b7afad0dd feature(hicache): Support hf3fs-hicache reusing kvcache across different instances (#8673)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-08-09 01:03:00 -07:00
hzh0425 d1c4d51c08 bugfix(hicache): Fix 'MooncakeStore' not defined error. (#8668) 2025-08-01 15:58:17 -07:00
2fbb754e1d feature(pd-hicache): Prefill instances support reusing the RemoteStorage Cache via HiCache. (#8516)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-07-29 21:19:25 -07:00
hzh0425 a85ebf50b8 feat(hicache): support file backend reading directory config form env. (#8498) 2025-07-29 21:18:46 -07:00
hzh0425 5c08a36cbf [Fix] ensure DeepGEMM is only enabled for FP8_W8A8 models (#8110) 2025-07-16 21:33:29 -07:00