12 Commits
Author SHA1 Message Date
lpdinkandZhangheng 4a651146de [Feat] hicache: Notify storage backends when the initial host-pool registration burst completes (#44030)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-10-20 14:09:13 +08:00
553836c164 [Feat] simulator: Add baseline collection and ML latency predictor training tools (#44299)
Co-authored-by: shijunyu.sjy <shijunyu.sjy@alibaba-inc.com>
Co-authored-by: baoyunong.byn <baoyunong.byn@alibaba-inc.com>
Co-authored-by: wangyi.wy <aaronwangyi0201@gmail.com>
2026-10-20 13:02:33 +08:00
e775fa7253 [Build][CI] Drop Python 3.10: require Python 3.11+ and run CUDA CI on Python 3.12 (#43021)
Co-authored-by: Mohammad Angkad <mohammad.angkad@radixark.ai>
Co-authored-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
2026-10-12 18:40:16 -07:00
Liangsheng Yin 1066decce6 [Scheduler] Replace extend_range with extend_end derived from prefix_len (#42822) 2026-10-07 16:07:16 -07:00
Liangsheng Yin e9240b3243 [Scheduler] Track prefill progress as prefix_len (#42824) 2026-10-07 15:59:06 -07:00
Liangsheng Yin 4ce23542bf [HiCache] Remove the unused HiRadixCache (#40787) 2026-09-22 16:17:12 -07:00
Shuwen Wang 80da4432d0 [Simulator] Fix meta host memory budgets on constrained runners (#40440) 2026-09-21 00:42:55 +08:00
Ruiyan Ma efa7be2091 [Simulator][Compatibility] Adapt to latest KV cache pool interfaces (#40418) 2026-09-20 18:00:06 +08:00
Alison Shao 2f7393f0d2 [Simulator] Give the OFFLINE/BLOCKING comparison tolerances real headroom (#38732) 2026-09-10 11:10:38 +08:00
59799a3687 [Simulator] Add high-fidelity CPU-based inference simulator (#33824)
Co-authored-by: zhouhaizhu.zhz <zhouhaizhu.zhz@alibaba-inc.com>
Co-authored-by: LinSiyuan814 <linsiyuan.lsy@alibaba-inc.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
2026-09-04 11:12:11 +08:00
Xiaoyu Zhang db6f0a9d53 Refactor JIT kernel and expert-pack directory layout (#36704) 2026-08-29 07:41:25 +08:00
2d8484740d Support deepseek v4 and kimi k3 on ssd (#35314)
Co-authored-by: 1BIN4 <1741738350@qq.com>
Co-authored-by: L-Ark <fliangae@connect.ust.hk>
Co-authored-by: Chikati <jxudn@connect.ust.hk>
Co-authored-by: mengzili <zilim@ust.hk>
2026-08-26 10:05:12 +08:00