 huangtingwei
|
ae7428a8a7
|
fix mooncake store mla zero copy meta (#9678)
|
2025-08-27 15:43:16 +08:00 |
|
|
huangtingweiandZhiqiang Xie
|
6078d5fcc0
|
[HiCacheStorage] backup optimization for MLA model (#8865)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-22 18:03:51 +08:00 |
|
|
huangtingweiandZhiqiang Xie
|
0edda32001
|
Support page first layout zero copy for mooncake store (#8651)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-12 15:59:26 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
86497d99f2
|
fix page first per layer pf2lf kernel (#8915)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-09 17:16:11 -07:00 |
|
|
huangtingwei
|
76ba5bbe12
|
fix args typo in memory_pool_host (#8662)
|
2025-08-03 13:47:29 -07:00 |
|
|
|
d904959233
|
Support l3 cache (mooncake store) for hiradix cache (#7211)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
Co-authored-by: zuoyuan <zhangzuo21@mails.tsinghua.edu.cn>
Co-authored-by: @wangyueneng.wyn <wangyueneng.wyn@antgroup.com>
Co-authored-by: JinYan Su <jinyansu792@gmail.com>
|
2025-07-30 23:15:51 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
26c8a310bd
|
fix incorrect increase of hit count (#8533)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-31 06:02:42 +00:00 |
|
|
huangtingweiandChang Su
|
7732bbe458
|
bugfix: Prevent global mutation of conv.stop_str across requests (#7347)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-06-23 19:36:23 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
d2cb3024f2
|
fix bug that gpu0 occupies more memory when hicache is turned on (#5778)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-05-09 15:36:08 -07:00 |
|
|
huangtingweiandAniZpZ
|
5fbafbb8f8
|
fix MLATokenToKVPoolHost get_size_per_token bug (#5161)
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
|
2025-04-13 12:37:26 -07:00 |
|
|
huangtingwei
|
27f8e6b9c1
|
fix multimodal hash feature (#5083)
|
2025-04-07 22:43:23 -07:00 |
|