Commit Graph
7 Commits
Author SHA1 Message Date
sglang-botandsglang-bot 6252993afe chore: update CI test est_time values (#38238)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-09-06 17:49:41 -07:00
6580d5cd9a weight cache: key daemon paths by GPU UUID (#36101)
Co-authored-by: siyu <liusy58@linux.alibaba.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-08-31 01:44:45 -07:00
Schwinn Saereesitthipitak 08315c56df [Fix] Account resident weight memory in KV sizing (#34053)
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
2026-08-27 02:43:04 -07:00
Xun Sun adcf73d7f7 [Weight Cache] Enhance test and support EPLB (#36198) 2026-08-26 23:11:53 -07:00
Xun Sunandsiyu a90d770c40 [Weight Cache] Support static DP/EP layouts (#33684)
Co-authored-by: siyu <liusy58@linux.alibaba.com>
2026-08-23 19:57:52 -07:00
siyuandliusy58 cb10ca16dd [FEAT] Weight Daemon abstraction (#33279)
Co-authored-by: liusy58 <liusy58@smail.nju.edu.cn>
2026-08-22 02:13:46 -07:00
f9c14e6bd4 [FEAT] Support fast engine recovery through weight cache (#27139)
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: Alex Nails <alex.nails@radixark.ai>
2026-07-25 14:31:21 +08:00