 cctryandcctry
|
0c065671c9
|
[Spec] Redo: split init_backends; account draft weights in --mem-fraction-static (#28855)
Co-authored-by: cctry <cctry@fb.com>
|
2026-06-21 20:45:16 -07:00 |
|
Vladislav Nosivskoy
|
2ad9a5b576
|
[UnifiedTree] Use dense model for HiCache+CP KL tests (#28726)
|
2026-06-20 00:18:01 +08:00 |
|
 huangtingweiandhzh0425
|
6b7ecca663
|
[HiCache]Support hybrid pool staged H2D kernel (#28434)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-06-19 09:48:03 +08:00 |
|
 Zhanghengandispobock
|
867707f1f2
|
[UnifiedTree]: move some kl test from base to extra stage (#28627)
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-06-18 01:39:46 -07:00 |
|
 Vladislav NosivskoyandZhangheng
|
b7ae7149e8
|
[HiCache] Fix SWA L3 cache miss due to a prefetch/hit len mismatch (#27291)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-06-18 14:55:00 +08:00 |
|
 Yuan Luoandluoyuan.luo
|
3340f4e3da
|
[GDN][KDA][mem_cache] int8 checkpoint pool for the linear-attn prefix cache (#28185)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-06-17 20:41:46 -07:00 |
|
Michael
|
a2aa51c818
|
[AMD] register 4 2-gpu tests to stage-b-test-2-gpu-large-amd (#28344)
|
2026-06-16 21:58:34 -07:00 |
|
Chao Shi
|
5fb4e2d02e
|
[UnifiedTree] Use Qwen3-32B in unified radix pp kl tests and set KL threshold to 0.005 (#27931)
|
2026-06-14 13:15:35 +08:00 |
|
  
|
2495c02c2c
|
[Refactor] Cuda Graph Runner/Backend Refactor (#23906)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2026-06-09 21:36:57 -07:00 |
|
huangtingwei
|
f101b287ef
|
[Unified Tree]fix compatibility with eagle key and l3 hicache (#27655)
|
2026-06-10 10:54:45 +08:00 |
|
Ke Bao
|
854d232a40
|
Fix flaky hicache l3 mmlu nightly test (#27688)
|
2026-06-10 10:01:14 +08:00 |
|
Zhangheng
|
a39c428d3f
|
[UnifiedTree][CI]: Reduce HiCache PP KL test concurrency to avoid decode OOM (#27483)
|
2026-06-07 17:12:42 +08:00 |
|
   
|
42fe025280
|
[HiCache] Fix the compatibility between PP and HiCache (L2). (#27285)
Co-authored-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: shangmingc <csmthu@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-06-06 16:57:23 +08:00 |
|
Zhangheng
|
631db6c757
|
[UnifiedTree]: Sync sidecar component hits across TP ranks and make SWA prefetch all-or-nothing (#27264)
|
2026-06-05 09:23:54 +08:00 |
|
 Vladislav NosivskoyandZhangheng
|
63dc20ae6c
|
[UnifiedTree] Add CP sync (#25395)
Co-authored-by: Zhangheng <hzh0425@apache.org>
|
2026-06-03 16:10:27 +08:00 |
|
Ke Bao
|
28f9c1ff24
|
Relax mamba unified cache kl threshold (#27070)
|
2026-06-02 23:28:22 +08:00 |
|
Ke Bao
|
b5e154dc73
|
Fix stale import after kl_nightly rename (#27064)
|
2026-06-02 21:46:21 +08:00 |
|
Zhangheng
|
ee4bf0a9d3
|
[UnifiedTree]: Add HiCache Nightly CI For GLM5 (#26927)
|
2026-06-02 19:02:50 +08:00 |
|
Zhangheng
|
eb5d4827e8
|
[UnifiedTree]: Split unified tree kl ci into multiple files to reduce GPU usage. (#26666)
|
2026-05-29 02:46:34 -07:00 |
|
Liangsheng Yin
|
ec78fa6518
|
test/registered: cleanup pure model e2e tests (moves, splits, dedup, kit) (#26610)
|
2026-05-28 15:41:46 -07:00 |
|
Zhangheng
|
38f32c38ab
|
[UnifiedRadixTree]: Support L3 HiStorage framework (#26062)
|
2026-05-26 22:38:00 +08:00 |
|
Liangsheng Yin
|
614672fea5
|
[Test] Stage-a sanity kits; consolidate core/ + models_e2e/ tests (#25831)
|
2026-05-20 01:58:48 -07:00 |
|
 huangtingweiandhzh0425
|
c2a212bfe2
|
[UnifiedTree] Support DeepSeek V4 host pool with multiple layouts. (#25282)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-05-19 09:36:00 +08:00 |
|
Cheng Wan
|
b7267e8fce
|
[CI] Enable weight prefetch for 8-gpu-h200 basic tests (#25684)
|
2026-05-18 14:12:45 -07:00 |
|
Cheng Wan
|
0c017db916
|
Update kl_div_thres to 0.02 in swa_radix_cache (#25497)
|
2026-05-16 16:43:12 -07:00 |
|
Zhangheng
|
0be539024f
|
[BugFix]: Fix DeepSeek V4 HiCache layer count logic (#25477)
|
2026-05-16 23:50:01 +08:00 |
|
Liangsheng Yin
|
b7d62bd724
|
[CI] Rename basic CI stage-a/b/c -> base-a/b/c for symmetry with extra CI (#25420)
|
2026-05-15 18:26:55 -07:00 |
|
Zhangheng
|
21b3ac52b4
|
[UnifiedTree]: Fix UnifiedRadixCache device match semantics with HiCache (#25277)
|
2026-05-16 00:40:55 +08:00 |
|
Zhangheng
|
fe7a5dd3bf
|
[UnifiedTree]: Add nightly hicache ci for dsa model (#25348)
|
2026-05-15 16:54:50 +08:00 |
|
 
|
d9fa84b25b
|
[UnifiedTree]: Support HiCache For DeepSeek_V4 (#24691)
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
|
2026-05-14 20:20:52 -07:00 |
|
Liangsheng Yin
|
22d3f3996c
|
ci: decouple stage and runner for cuda registry (#25197)
|
2026-05-13 17:28:21 -07:00 |
|
Michael
|
245f7d8026
|
[AMD] Register 5 server-style 1-GPU tests for AMD PR CI (#24572)
|
2026-05-12 22:45:52 -07:00 |
|
Zhangheng
|
e299ec1bff
|
[UnifiedRadixTree]: Fix flaky ci (#24421)
|
2026-05-05 20:22:19 +08:00 |
|
Zhangheng
|
05aed5e1d5
|
[UnifiedRadixTree]: Add KL accuracy CI for UnifiedTree with HiCache (#24346)
|
2026-05-04 20:18:10 +08:00 |
|
 
|
c0f5950636
|
[UnifiedRadixTree]: Support HiCache Framework for UnifiedRadixTree (#23316)
Co-authored-by: JINZ <1023553676@qq.com>
Co-authored-by: diemchai <diemchai@tencent.com>
|
2026-05-03 22:13:22 +08:00 |
|
 sglang-botandsglang-bot
|
da175b964d
|
chore: update CI test est_time values (#23785)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-04-26 20:17:50 -07:00 |
|
   
|
bc59cc0f96
|
[RaidxTree Refactor]: Support Unified HybridRadixTree V2 (#21206)
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: xiezhq-hermann <xiezhq@stanford.edu>
|
2026-04-13 10:28:22 +08:00 |
|
  
|
265696b176
|
chore: update CI test est_time values (#22565)
Co-authored-by: Cheng Wan <chwan@rice.edu>
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2026-04-10 18:15:02 -07:00 |
|
Lianmin Zheng
|
814202704b
|
ci: unify PR test suite naming (#21187)
|
2026-03-23 00:18:45 -07:00 |
|
Ke Bao
|
c3483e8e97
|
[CI] Move existing unit tests into unit directory (#20631)
|
2026-03-15 23:25:18 +08:00 |
|
hzh0425
|
197f807134
|
[RadixTree][7/N Refactor]: Refactor mamba radix tree, release dup kvcache in insert func (#19429)
|
2026-03-13 12:28:32 +08:00 |
|
roikoren755
|
067353f67b
|
[Test] Refactor KL divergence and prefix cache branching to kits (#19715)
|
2026-03-12 16:11:59 +08:00 |
|
 liubiyonggeandzhangheng
|
cc73355a1f
|
[Feature] Add SLRU eviction policy & fix RadixCache hit_count bug (#18843)
Co-authored-by: zhangheng <hzh0425@apache.org>
|
2026-03-08 21:30:55 +08:00 |
|
Yuwei An
|
c64274c746
|
Piecewise Cuda Graph set default (#16331)
|
2026-03-02 23:18:07 +08:00 |
|
zhangheng
|
a0d8a7ae6d
|
[RadixTree][6/N Refactor]: Refactor SWARadixTree to simplify the computation and alignment of bigram keys. (#19427)
|
2026-02-28 20:01:39 +08:00 |
|
pansicheng
|
48642d5384
|
[RadixTree][4/N Refactor]: Move available_and_evictable_str to individual radix cache classes (#17852)
|
2026-02-19 17:03:15 +08:00 |
|
Liangsheng Yin
|
cd90346a2b
|
Add cache hit rate UT (#18566)
|
2026-02-10 21:27:41 -08:00 |
|
 
|
495290aefd
|
enable ut test for xpu devices (#11712)
Co-authored-by: jundu <jun.du@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
|
2026-02-03 11:15:14 -08:00 |
|
cctry
|
027f314050
|
[Fix] data race in req_to_token pool (#17850)
|
2026-02-02 14:38:15 -08:00 |
|
Ke Bao
|
7ace64d1d8
|
Update mamba env setting (#17566)
|
2026-01-23 11:02:32 +08:00 |
|