Commit Graph
55 Commits
Author SHA1 Message Date
cctryandcctry 0c065671c9 [Spec] Redo: split init_backends; account draft weights in --mem-fraction-static (#28855)
Co-authored-by: cctry <cctry@fb.com>
2026-06-21 20:45:16 -07:00
Vladislav Nosivskoy 2ad9a5b576 [UnifiedTree] Use dense model for HiCache+CP KL tests (#28726) 2026-06-20 00:18:01 +08:00
huangtingweiandhzh0425 6b7ecca663 [HiCache]Support hybrid pool staged H2D kernel (#28434)
Co-authored-by: hzh0425 <hzh0425@apache.org>
2026-06-19 09:48:03 +08:00
Zhanghengandispobock 867707f1f2 [UnifiedTree]: move some kl test from base to extra stage (#28627)
Co-authored-by: ispobock <ispobaoke@gmail.com>
2026-06-18 01:39:46 -07:00
Vladislav NosivskoyandZhangheng b7ae7149e8 [HiCache] Fix SWA L3 cache miss due to a prefetch/hit len mismatch (#27291)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-06-18 14:55:00 +08:00
Yuan Luoandluoyuan.luo 3340f4e3da [GDN][KDA][mem_cache] int8 checkpoint pool for the linear-attn prefix cache (#28185)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-06-17 20:41:46 -07:00
Michael a2aa51c818 [AMD] register 4 2-gpu tests to stage-b-test-2-gpu-large-amd (#28344) 2026-06-16 21:58:34 -07:00
Chao Shi 5fb4e2d02e [UnifiedTree] Use Qwen3-32B in unified radix pp kl tests and set KL threshold to 0.005 (#27931) 2026-06-14 13:15:35 +08:00
2495c02c2c [Refactor] Cuda Graph Runner/Backend Refactor (#23906)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2026-06-09 21:36:57 -07:00
huangtingwei f101b287ef [Unified Tree]fix compatibility with eagle key and l3 hicache (#27655) 2026-06-10 10:54:45 +08:00
Ke Bao 854d232a40 Fix flaky hicache l3 mmlu nightly test (#27688) 2026-06-10 10:01:14 +08:00
Zhangheng a39c428d3f [UnifiedTree][CI]: Reduce HiCache PP KL test concurrency to avoid decode OOM (#27483) 2026-06-07 17:12:42 +08:00
42fe025280 [HiCache] Fix the compatibility between PP and HiCache (L2). (#27285)
Co-authored-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: shangmingc <csmthu@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
2026-06-06 16:57:23 +08:00
Zhangheng 631db6c757 [UnifiedTree]: Sync sidecar component hits across TP ranks and make SWA prefetch all-or-nothing (#27264) 2026-06-05 09:23:54 +08:00
Vladislav NosivskoyandZhangheng 63dc20ae6c [UnifiedTree] Add CP sync (#25395)
Co-authored-by: Zhangheng <hzh0425@apache.org>
2026-06-03 16:10:27 +08:00
Ke Bao 28f9c1ff24 Relax mamba unified cache kl threshold (#27070) 2026-06-02 23:28:22 +08:00
Ke Bao b5e154dc73 Fix stale import after kl_nightly rename (#27064) 2026-06-02 21:46:21 +08:00
Zhangheng ee4bf0a9d3 [UnifiedTree]: Add HiCache Nightly CI For GLM5 (#26927) 2026-06-02 19:02:50 +08:00
Zhangheng eb5d4827e8 [UnifiedTree]: Split unified tree kl ci into multiple files to reduce GPU usage. (#26666) 2026-05-29 02:46:34 -07:00
Liangsheng Yin ec78fa6518 test/registered: cleanup pure model e2e tests (moves, splits, dedup, kit) (#26610) 2026-05-28 15:41:46 -07:00
Zhangheng 38f32c38ab [UnifiedRadixTree]: Support L3 HiStorage framework (#26062) 2026-05-26 22:38:00 +08:00
Liangsheng Yin 614672fea5 [Test] Stage-a sanity kits; consolidate core/ + models_e2e/ tests (#25831) 2026-05-20 01:58:48 -07:00
huangtingweiandhzh0425 c2a212bfe2 [UnifiedTree] Support DeepSeek V4 host pool with multiple layouts. (#25282)
Co-authored-by: hzh0425 <hzh0425@apache.org>
2026-05-19 09:36:00 +08:00
Cheng Wan b7267e8fce [CI] Enable weight prefetch for 8-gpu-h200 basic tests (#25684) 2026-05-18 14:12:45 -07:00
Cheng Wan 0c017db916 Update kl_div_thres to 0.02 in swa_radix_cache (#25497) 2026-05-16 16:43:12 -07:00
Zhangheng 0be539024f [BugFix]: Fix DeepSeek V4 HiCache layer count logic (#25477) 2026-05-16 23:50:01 +08:00
Liangsheng Yin b7d62bd724 [CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420) 2026-05-15 18:26:55 -07:00
Zhangheng 21b3ac52b4 [UnifiedTree]: Fix UnifiedRadixCache device match semantics with HiCache (#25277) 2026-05-16 00:40:55 +08:00
Zhangheng fe7a5dd3bf [UnifiedTree]: Add nightly hicache ci for dsa model (#25348) 2026-05-15 16:54:50 +08:00
d9fa84b25b [UnifiedTree]: Support HiCache For DeepSeek_V4 (#24691)
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
2026-05-14 20:20:52 -07:00
Liangsheng Yin 22d3f3996c ci: decouple stage and runner for cuda registry (#25197) 2026-05-13 17:28:21 -07:00
Michael 245f7d8026 [AMD] Register 5 server-style 1-GPU tests for AMD PR CI (#24572) 2026-05-12 22:45:52 -07:00
Zhangheng e299ec1bff [UnifiedRadixTree]: Fix flaky ci (#24421) 2026-05-05 20:22:19 +08:00
Zhangheng 05aed5e1d5 [UnifiedRadixTree]: Add KL accuracy CI for UnifiedTree with HiCache (#24346) 2026-05-04 20:18:10 +08:00
c0f5950636 [UnifiedRadixTree]: Support HiCache Framework for UnifiedRadixTree (#23316)
Co-authored-by: JINZ <1023553676@qq.com>
Co-authored-by: diemchai <diemchai@tencent.com>
2026-05-03 22:13:22 +08:00
sglang-botandsglang-bot da175b964d chore: update CI test est_time values (#23785)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2026-04-26 20:17:50 -07:00
bc59cc0f96 [RaidxTree Refactor]: Support Unified HybridRadixTree V2 (#21206)
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: xiezhq-hermann <xiezhq@stanford.edu>
2026-04-13 10:28:22 +08:00
265696b176 chore: update CI test est_time values (#22565)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
2026-04-10 18:15:02 -07:00
Lianmin Zheng 814202704b ci: unify PR test suite naming (#21187) 2026-03-23 00:18:45 -07:00
Ke Bao c3483e8e97 [CI] Move existing unit tests into unit directory (#20631) 2026-03-15 23:25:18 +08:00
hzh0425 197f807134 [RadixTree][7/N Refactor]: Refactor mamba radix tree, release dup kvcache in insert func (#19429) 2026-03-13 12:28:32 +08:00
roikoren755 067353f67b [Test] Refactor KL divergence and prefix cache branching to kits (#19715) 2026-03-12 16:11:59 +08:00
liubiyonggeandzhangheng cc73355a1f [Feature] Add SLRU eviction policy & fix RadixCache hit_count bug (#18843)
Co-authored-by: zhangheng <hzh0425@apache.org>
2026-03-08 21:30:55 +08:00
Yuwei An c64274c746 Piecewise Cuda Graph set default (#16331) 2026-03-02 23:18:07 +08:00
zhangheng a0d8a7ae6d [RadixTree][6/N Refactor]: Refactor SWARadixTree to simplify the computation and alignment of bigram keys. (#19427) 2026-02-28 20:01:39 +08:00
pansicheng 48642d5384 [RadixTree][4/N Refactor]: Move available_and_evictable_str to individual radix cache classes (#17852) 2026-02-19 17:03:15 +08:00
Liangsheng Yin cd90346a2b Add cache hit rate UT (#18566) 2026-02-10 21:27:41 -08:00
495290aefd enable ut test for xpu devices (#11712)
Co-authored-by: jundu <jun.du@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
2026-02-03 11:15:14 -08:00
cctry 027f314050 [Fix] data race in req_to_token pool (#17850) 2026-02-02 14:38:15 -08:00
Ke Bao 7ace64d1d8 Update mamba env setting (#17566) 2026-01-23 11:02:32 +08:00