11 Commits
Author SHA1 Message Date
Chao ShiandZhangheng bf9773e1da HiCache: Add @rank_consensus to various functions (#37425)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-09-14 10:44:21 +08:00
Chao Shiandhuangtingwei9988 e31e5319a0 HiCache: Reduce the number of all_reduce in check_hicache_events for PP (#37562)
Co-authored-by: huangtingwei9988 <huangtingwei.htw@antgroup.com>
2026-09-08 10:13:22 +08:00
Chao Shi 8e04f66a70 HiCache: avoid unnecessary all-reduce in check_prefetch_progress (#36425) 2026-08-29 00:52:53 +08:00
829138a31e [HiCache] Fix PP inconsistency with HiCache L3 (#22607) (#27010)
Co-authored-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: shangmingc <csmthu@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
2026-08-25 20:49:57 +08:00
Chao Shi 2ef0fe4669 TP/PP Consensus checker (#34406) 2026-08-21 01:36:03 +08:00
Chao ShiandZhangheng f369a820d4 [HiCache] Remove redundant parameters of build_xxx_stack and others (#31308)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-07-21 17:54:06 +08:00
Chao Shi bd2a5db987 [HiCache] Detect for double-free in HostKVCache (#29310) 2026-06-29 09:02:21 +08:00
Chao Shi 5fb4e2d02e [UnifiedTree] Use Qwen3-32B in unified radix pp kl tests and set KL threshold to 0.005 (#27931) 2026-06-14 13:15:35 +08:00
42fe025280 [HiCache] Fix the compatibility between PP and HiCache (L2). (#27285)
Co-authored-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: shangmingc <csmthu@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
2026-06-06 16:57:23 +08:00
Chao Shi 6ce49e5f4c [Utils] Support configure log level at runtime (#26583) 2026-05-29 14:49:06 -07:00
Chao Shi 48f3264807 [HiCache]: Check return code of cudaHostRegister (#26301) 2026-05-26 17:44:15 +08:00