 huangtingwei
|
1dcde53928
|
[HiCache] support memory_pool_host page head layout (#11644)
|
2025-11-17 13:45:17 +08:00 |
|
|
huangtingwei
|
4ac65e3c7d
|
[PD / HiCache]fix deocde kvcache offload manager memory leak (#12774)
|
2025-11-14 03:31:53 +08:00 |
|
|
huangtingwei
|
a5e5088dfb
|
Fix errors of page head kernels in sgl-kernel for ROCm (#12604)
|
2025-11-10 15:15:50 +08:00 |
|
|
huangtingwei
|
5538e05cb1
|
fix default env var for mooncake store (#12429)
|
2025-11-01 01:25:33 +08:00 |
|
|
huangtingwei
|
3e6281d0aa
|
[HiCache]Page head layout IO kernel (#11615)
|
2025-10-26 15:53:50 +08:00 |
|
|
huangtingwei
|
cae3956585
|
check master server for mooncake store (#10510)
|
2025-10-20 09:37:09 +08:00 |
|
|
huangtingwei
|
e05555fad8
|
[HiCacheStorage] mooncake store support page_first_direct layout (#10591)
|
2025-09-28 20:45:48 -07:00 |
|
|
huangtingwei
|
7f399e4bce
|
[HiCacheStorage]support page_first_direct layout for generic set&get (#10522)
|
2025-09-19 05:47:16 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
b4c2c421e9
|
support memory_pool_host page first direct layout (#10031)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-11 23:19:44 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
5be8c2f7f7
|
Page first direct IO kernel (#10060)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-10 13:35:34 +08:00 |
|
|
huangtingweiandZhiqiang Xie
|
cb9e0e4180
|
[HiCacheStorage] fix abort request host memory leaks (#9874)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-01 18:59:29 -07:00 |
|
|
huangtingwei
|
b361750a4a
|
Mooncake store get zero copy meta optimization (#9857)
|
2025-09-01 03:27:56 -07:00 |
|
|
huangtingwei
|
55349e361d
|
support mooncake store dp attention (#9684)
|
2025-08-28 12:31:31 +08:00 |
|
|
huangtingwei
|
ae7428a8a7
|
fix mooncake store mla zero copy meta (#9678)
|
2025-08-27 15:43:16 +08:00 |
|
|
huangtingweiandZhiqiang Xie
|
6078d5fcc0
|
[HiCacheStorage] backup optimization for MLA model (#8865)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-22 18:03:51 +08:00 |
|
|
huangtingweiandZhiqiang Xie
|
0edda32001
|
Support page first layout zero copy for mooncake store (#8651)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-12 15:59:26 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
86497d99f2
|
fix page first per layer pf2lf kernel (#8915)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-09 17:16:11 -07:00 |
|
|
huangtingwei
|
76ba5bbe12
|
fix args typo in memory_pool_host (#8662)
|
2025-08-03 13:47:29 -07:00 |
|
|
|
d904959233
|
Support l3 cache (mooncake store) for hiradix cache (#7211)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
Co-authored-by: zuoyuan <zhangzuo21@mails.tsinghua.edu.cn>
Co-authored-by: @wangyueneng.wyn <wangyueneng.wyn@antgroup.com>
Co-authored-by: JinYan Su <jinyansu792@gmail.com>
|
2025-07-30 23:15:51 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
26c8a310bd
|
fix incorrect increase of hit count (#8533)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-31 06:02:42 +00:00 |
|
|
huangtingweiandChang Su
|
7732bbe458
|
bugfix: Prevent global mutation of conv.stop_str across requests (#7347)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-06-23 19:36:23 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
d2cb3024f2
|
fix bug that gpu0 occupies more memory when hicache is turned on (#5778)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-05-09 15:36:08 -07:00 |
|
|
huangtingweiandAniZpZ
|
5fbafbb8f8
|
fix MLATokenToKVPoolHost get_size_per_token bug (#5161)
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
|
2025-04-13 12:37:26 -07:00 |
|
|
huangtingwei
|
27f8e6b9c1
|
fix multimodal hash feature (#5083)
|
2025-04-07 22:43:23 -07:00 |
|