|
efa71ce5ab
|
[HiCache]Fix hybrid model move_indices (#22940)
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: flyerming <flyerming@163.com>
|
2026-04-21 00:15:39 -07:00 |
|
|
huangtingweiandhzh0425
|
7d7fdc1309
|
[HiCache]Fix CP support for hybrid model (#22782)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-04-15 23:50:29 +08:00 |
|
|
huangtingweiandhzh0425
|
3511c2deb4
|
[HiCache] Fix memory host free logic when share_indices_with_anchor enabled (#22767)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-04-15 16:31:18 +08:00 |
|
|
|
e9d6b9eb2d
|
[HiCache & HybridModel] mooncake backend support DSA & mamba model (#21259)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
|
2026-04-13 18:47:36 -07:00 |
|
|
huangtingwei
|
945d73824f
|
[HiSparse] Clarify decode token usage logs (#22331)
|
2026-04-13 18:03:25 -07:00 |
|
|
|
0c204fbd57
|
[HiSparse] Optimize the scheduling of decode backup. (#21932)
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-04-07 10:34:58 -07:00 |
|
|
huangtingwei
|
6dd2f774de
|
[HiCache & PD]Fixed detailed cache hit breakdown in PD scenarios. (#21764)
|
2026-04-01 17:44:55 -07:00 |
|
|
huangtingwei
|
d864622a68
|
[Hicache & JIT_kernel] Support page first layout & mla jit kernel (#18311)
|
2026-03-27 08:54:36 -07:00 |
|
|
huangtingwei
|
8787cf4566
|
Fix the scope of io_backend in NSATokenToKVPoolHost (#20327)
|
2026-03-12 10:33:11 +08:00 |
|
|
huangtingwei
|
0a43229be1
|
Fix mooncake store write/read bandwidth logs (#18294)
|
2026-03-09 19:54:37 -07:00 |
|
|
huangtingweiandhzh0425
|
254d3cee0b
|
[HiCache] Supports Indexer layout for NSATokenToKVPoolHost (#19912)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-03-09 18:24:06 -07:00 |
|
|
huangtingweiandmaoyuhan
|
8dfb6e1684
|
[HiCache] fix compatibility bugs with eagle and HiCacheStorage (#19570)
Co-authored-by: maoyuhan <susanmao1997@outlook.com>
|
2026-03-02 18:29:51 -08:00 |
|
|
huangtingweiandhzh0425
|
36dc973cbf
|
[HiCache] refactor page_first_direct io kernel (#18113)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-02-27 11:43:14 -08:00 |
|
|
huangtingweiandhzh0425
|
d40cb2f725
|
[HiCache] Support heterogeneous tp for hicache storage (#18541)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-02-25 00:13:57 -08:00 |
|
|
|
77fc4c4a53
|
Add mooncake store read/write bandwidth logs (#10598)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: Lei Huang <lei.huang@novita.ai>
|
2026-01-15 12:15:41 -08:00 |
|
|
huangtingwei
|
1dcde53928
|
[HiCache] support memory_pool_host page head layout (#11644)
|
2025-11-17 13:45:17 +08:00 |
|
|
huangtingwei
|
4ac65e3c7d
|
[PD / HiCache]fix deocde kvcache offload manager memory leak (#12774)
|
2025-11-14 03:31:53 +08:00 |
|
|
huangtingwei
|
a5e5088dfb
|
Fix errors of page head kernels in sgl-kernel for ROCm (#12604)
|
2025-11-10 15:15:50 +08:00 |
|
|
huangtingwei
|
5538e05cb1
|
fix default env var for mooncake store (#12429)
|
2025-11-01 01:25:33 +08:00 |
|
|
huangtingwei
|
3e6281d0aa
|
[HiCache]Page head layout IO kernel (#11615)
|
2025-10-26 15:53:50 +08:00 |
|
|
huangtingwei
|
cae3956585
|
check master server for mooncake store (#10510)
|
2025-10-20 09:37:09 +08:00 |
|
|
huangtingwei
|
e05555fad8
|
[HiCacheStorage] mooncake store support page_first_direct layout (#10591)
|
2025-09-28 20:45:48 -07:00 |
|
|
huangtingwei
|
7f399e4bce
|
[HiCacheStorage]support page_first_direct layout for generic set&get (#10522)
|
2025-09-19 05:47:16 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
b4c2c421e9
|
support memory_pool_host page first direct layout (#10031)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-11 23:19:44 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
5be8c2f7f7
|
Page first direct IO kernel (#10060)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-10 13:35:34 +08:00 |
|
|
huangtingweiandZhiqiang Xie
|
cb9e0e4180
|
[HiCacheStorage] fix abort request host memory leaks (#9874)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-09-01 18:59:29 -07:00 |
|
|
huangtingwei
|
b361750a4a
|
Mooncake store get zero copy meta optimization (#9857)
|
2025-09-01 03:27:56 -07:00 |
|
|
huangtingwei
|
55349e361d
|
support mooncake store dp attention (#9684)
|
2025-08-28 12:31:31 +08:00 |
|
|
huangtingwei
|
ae7428a8a7
|
fix mooncake store mla zero copy meta (#9678)
|
2025-08-27 15:43:16 +08:00 |
|
|
huangtingweiandZhiqiang Xie
|
6078d5fcc0
|
[HiCacheStorage] backup optimization for MLA model (#8865)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-22 18:03:51 +08:00 |
|
|
huangtingweiandZhiqiang Xie
|
0edda32001
|
Support page first layout zero copy for mooncake store (#8651)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-12 15:59:26 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
86497d99f2
|
fix page first per layer pf2lf kernel (#8915)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-08-09 17:16:11 -07:00 |
|
|
huangtingwei
|
76ba5bbe12
|
fix args typo in memory_pool_host (#8662)
|
2025-08-03 13:47:29 -07:00 |
|
|
|
d904959233
|
Support l3 cache (mooncake store) for hiradix cache (#7211)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
Co-authored-by: zuoyuan <zhangzuo21@mails.tsinghua.edu.cn>
Co-authored-by: @wangyueneng.wyn <wangyueneng.wyn@antgroup.com>
Co-authored-by: JinYan Su <jinyansu792@gmail.com>
|
2025-07-30 23:15:51 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
26c8a310bd
|
fix incorrect increase of hit count (#8533)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-07-31 06:02:42 +00:00 |
|
|
huangtingweiandChang Su
|
7732bbe458
|
bugfix: Prevent global mutation of conv.stop_str across requests (#7347)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-06-23 19:36:23 -07:00 |
|
|
huangtingweiandZhiqiang Xie
|
d2cb3024f2
|
fix bug that gpu0 occupies more memory when hicache is turned on (#5778)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-05-09 15:36:08 -07:00 |
|
|
huangtingweiandAniZpZ
|
5fbafbb8f8
|
fix MLATokenToKVPoolHost get_size_per_token bug (#5161)
Co-authored-by: AniZpZ <zhuangsen.zp@antgroup.com>
|
2025-04-13 12:37:26 -07:00 |
|
|
huangtingwei
|
27f8e6b9c1
|
fix multimodal hash feature (#5083)
|
2025-04-07 22:43:23 -07:00 |
|