 Zhiqiang Xie
|
3b99f23c44
|
[Bugfix] Retract not releasing enough memory when page size > 1 (#9989)
|
2025-09-07 21:41:50 -07:00 |
|
|
Zhiqiang Xie
|
0b8c5721f1
|
[HiStorage] Remove delete and clear as necessary methods (#10039)
|
2025-09-06 10:27:26 +08:00 |
|
|
Zhiqiang Xie
|
369b143366
|
[HiCache] Minor fix on file storage backend (#9869)
|
2025-09-02 15:52:37 -07:00 |
|
|
Zhiqiang Xieandpansicheng
|
8b6966d020
|
[HiCache] Storage Refactoring (#9797)
Co-authored-by: pansicheng <27603155+pansicheng@users.noreply.github.com>
|
2025-08-31 22:58:21 +08:00 |
|
|
Zhiqiang Xie
|
f9076a5a2c
|
hot fix for mooncake batch set api (#9836)
|
2025-08-30 21:01:51 -07:00 |
|
|
Zhiqiang Xie
|
54e872d343
|
[HiCache] resolve conflict between chunked-prefill and hicache hit count (#9776)
|
2025-08-30 01:30:54 +08:00 |
|
|
Zhiqiang Xie
|
001f51940a
|
[HiCache] change the default policy to write through (#9772)
|
2025-08-28 18:28:39 -07:00 |
|
|
Zhiqiang Xie
|
43de1d7304
|
HiCache Storage fix host memory leak (#9648)
|
2025-08-26 10:49:40 -07:00 |
|
|
Zhiqiang Xieandgemini-code-assist[bot]
|
0eec4cb6cc
|
HiCache, add bench long context plus minor fixs (#9086)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-08-11 16:54:52 -07:00 |
|
|
Zhiqiang Xie
|
9f78f391ae
|
HiCache Storage: generate hash when inserting new nodes (#9053)
|
2025-08-11 14:18:59 -07:00 |
|
|
Zhiqiang Xie
|
b32792516a
|
REVIEWERS.md typo fix (#9048)
|
2025-08-10 22:33:37 -07:00 |
|
|
Zhiqiang Xie
|
6e0b646832
|
HiCache Storage tp fix (#8878)
|
2025-08-09 01:16:51 -07:00 |
|
|
Zhiqiang Xie
|
b0add2da00
|
HiCache storage, style change and bug fix (#8719)
|
2025-08-03 15:05:04 +08:00 |
|
|
Zhiqiang Xie
|
dd7ca00601
|
Interface change for kvcache io to support page first layout (#8318)
|
2025-08-01 11:37:49 +08:00 |
|
|
Zhiqiang Xie
|
9305ea6c2d
|
HiCache, fixing hash value indexing (#8636)
|
2025-08-01 11:29:51 +08:00 |
|
|
Zhiqiang Xie
|
528bd1ed85
|
HiCache, check before terminate prefetching (#8372)
|
2025-07-26 23:13:16 -07:00 |
|
|
Zhiqiang Xie
|
d40846d456
|
breakdown kernel update (#8334)
|
2025-07-25 08:33:17 +08:00 |
|
|
Zhiqiang Xieandpansicheng
|
145482f422
|
HiCache Storage TP Refinement (#8307)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
|
2025-07-25 08:31:47 +08:00 |
|
|
Zhiqiang Xieandpansicheng
|
f39037fffb
|
HiCache Fix (#8288)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
|
2025-07-23 16:51:32 +08:00 |
|
|
Zhiqiang Xie
|
ce86e201df
|
bug fix and tag (#8282)
|
2025-07-23 16:50:31 +08:00 |
|
|
Zhiqiang Xie
|
b43263307f
|
Hicache IO kernel refactoring (#8264)
|
2025-07-23 16:49:03 +08:00 |
|
|
Zhiqiang Xie
|
9d33fcfb8e
|
Hicache Storage Layer Prototype (#7704)
|
2025-07-18 15:20:19 +08:00 |
|
|
Zhiqiang Xie
|
2fc824b84c
|
Kernels for efficient KV cache IO (#7313)
|
2025-07-06 22:53:36 -07:00 |
|
|
Zhiqiang Xie
|
f9eb04ddb2
|
upgrade sgl kernel to 0.2.1 for main (#7676)
|
2025-07-01 00:00:13 -07:00 |
|
|
Zhiqiang Xie
|
34c3f9b2d3
|
kvcache io kernels and test case (#7382)
|
2025-06-23 11:58:59 -07:00 |
|
|
Zhiqiang Xie
|
e56685ac1b
|
Upstreaming hicache bug fixes (#7267)
|
2025-06-17 17:44:57 -07:00 |
|
|
Zhiqiang Xie
|
b26cb1c55a
|
Fix problem of large page size with chunked prefill (#6046)
|
2025-05-06 15:19:47 +08:00 |
|
|
Zhiqiang Xie
|
f8e460930a
|
Fix prefill OOM error in the case of large page size (#5081)
|
2025-05-05 16:02:55 -07:00 |
|
|
Zhiqiang Xie
|
70645f4d7d
|
upstream hicache fixes (#5570)
|
2025-04-20 23:08:30 -07:00 |
|
|
Zhiqiang Xie
|
e2574ee986
|
fix hicache write back (#5543)
|
2025-04-19 21:56:22 -07:00 |
|
|
Zhiqiang Xie
|
9d0b36c47a
|
fix deepgemm as well (#5030)
|
2025-04-03 02:41:37 -07:00 |
|
|
Zhiqiang Xie
|
a2aea59b6e
|
update cutlass tag (#5011)
|
2025-04-02 18:30:30 -07:00 |
|
|
Zhiqiang Xie
|
3fadc64793
|
bug fix for hicache host eviction (#4989)
|
2025-04-02 00:33:50 -07:00 |
|
|
Zhiqiang Xie
|
e119f04215
|
Large page size aligned hierarchical caching (#4581)
|
2025-04-01 22:38:15 -07:00 |
|
|
Zhiqiang Xie
|
12047f5e94
|
Prevent memory leak of retract_decode when page_size > 1 (#4977)
|
2025-04-01 15:30:45 -07:00 |
|
|
Zhiqiang XieandLianmin Zheng
|
a169b9f813
|
Fix oom error for large page size (#4913)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-03-30 21:34:21 -07:00 |
|
|
Zhiqiang Xie
|
4d25305700
|
Move mem_state update into debug mode (#4525)
|
2025-03-23 00:52:27 -07:00 |
|
|
Zhiqiang Xie
|
ecbfe58bb0
|
Bug fix for metrics counter (#4660)
|
2025-03-22 13:39:21 -07:00 |
|
|
Zhiqiang Xie
|
a98290aea3
|
Unit test for Hierarchical Caching (#4486)
|
2025-03-17 17:45:00 -07:00 |
|
|
Zhiqiang Xie
|
f5bbf6037d
|
Fix: Complete int32 to int64 conversion (#4465)
|
2025-03-16 18:14:27 -07:00 |
|
|
Zhiqiang Xie
|
fbdb50501f
|
Hot fix for hicache with new page aligned radixtree (#4397)
|
2025-03-13 15:50:49 -07:00 |
|
|
Zhiqiang Xie
|
10b544ae9b
|
Hierarchical Caching Refactoring and Fixing TP issue (#4082)
|
2025-03-12 11:22:35 -07:00 |
|
|
Zhiqiang Xie
|
9376ac361d
|
Memory pool fix for upstream change about eagle (#4170)
|
2025-03-07 00:58:20 -08:00 |
|
|
Zhiqiang Xie
|
aee30630d8
|
Add a pointer to the real KV cache pool (#4113)
|
2025-03-05 21:39:07 -08:00 |
|
|
|
6c7a152c5a
|
Hierarchical Caching for SGLang (#2693)
Co-authored-by: Wenxuan Tan <wenxuan.tan@wisc.edu>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-02-23 21:56:30 -08:00 |
|
|
Zhiqiang XieandLianmin Zheng
|
08104b56de
|
Sanity check to prevent performance regression (#3171)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-01-27 12:28:17 -08:00 |
|
|
Zhiqiang Xie
|
8af7048dcf
|
Query remaining memory dynamically for PrefillAdder (#2941)
|
2025-01-17 20:20:26 -08:00 |
|
|
Zhiqiang Xie
|
13387e6b7a
|
Multi-turn benchmark for hierarchical caching (#2942)
|
2025-01-17 16:17:24 -08:00 |
|
|
Zhiqiang Xie
|
5d6e9467d4
|
Cache controller for hierarchical caching (#2804)
|
2025-01-10 20:22:01 -08:00 |
|
|
Zhiqiang Xie
|
51caee740f
|
Host memory pool for hierarchical caching (#2771)
|
2025-01-07 21:38:37 +00:00 |
|