Liangsheng Yin eb76aaba88 [core] Always-on StreamingSession in UnifiedRadixCache (#23202)

2026-04-19 21:19:43 -07:00

..

cpp_radix_tree

Fix syntax errors in cpp_radix_tree (#13315)

2025-11-15 11:35:43 +08:00

hybrid_cache

[HiCache]Fix CP support for hybrid model (#22782)

2026-04-15 23:50:29 +08:00

sparsity

HiSparse for Sparse Attention (#20343)

2026-03-22 23:09:31 -07:00

storage

hicache storage backend mooncake support ascend hixl (#20016)

2026-04-14 20:51:06 +08:00

unified_cache_components

[UnifiedRadixTree]: Add HiCache hook interface for TreeComponent (#22924)

2026-04-17 12:09:41 +08:00

allocator.py

[Triton] Use dynamic loop bound in alloc_extend_kernel (#19898)

2026-03-04 16:15:58 -08:00

base_prefix_cache.py

integrate streaming session into UnifiedRadixCache (#23145)

2026-04-19 20:47:41 -07:00

cache_init_params.py

[core] Always-on StreamingSession in UnifiedRadixCache (#23202)

2026-04-19 21:19:43 -07:00

chunk_cache.py

[RadixTree][8/N Refactor]: unify lock interface (#20330)

2026-03-16 11:49:51 +08:00

common.py

[core] Always-on StreamingSession in UnifiedRadixCache (#23202)

2026-04-19 21:19:43 -07:00

evict_policy.py

[Feature] Add SLRU eviction policy & fix RadixCache hit_count bug (#18843)

2026-03-08 21:30:55 +08:00

flush_cache.py

Update docs (#1839)

2024-10-30 02:49:08 -07:00

hi_mamba_radix_cache.py

[BugFix][RadixTree]:Fix stale eviction assertion in HiMambaRadixCache host eviction path (#22592)

2026-04-16 10:49:30 +08:00

hicache_storage.py

[HiCache] fix: HiCacheFile component key suffixing (#22891)

2026-04-17 13:06:28 -07:00

hiradix_cache.py

[HiCache & HybridModel] mooncake backend support DSA & mamba model (#21259)

2026-04-13 18:47:36 -07:00

hisparse_memory_pool.py

[sgl] improve accuracy of additional page requirement during spec decode (#22406)

2026-04-16 15:50:51 -07:00

mamba_radix_cache.py

[HiMambaTree]: Optimize mamba host lock mechanism (#21750)

2026-03-31 21:52:24 +08:00

memory_pool_host.py

[HiCache] Fix memory host free logic when share_indices_with_anchor enabled (#22767)

2026-04-15 16:31:18 +08:00

memory_pool.py

Multi platform Plugin (#21388)

2026-04-19 17:23:51 -07:00

multimodal_cache.py

[VLM] Chunk-aware ViT encoding with per-image cache and lazy device transfer (#22038)

2026-04-04 16:55:17 +08:00

radix_cache_cpp.py

[RadixTree][8/N Refactor]: unify lock interface (#20330)

2026-03-16 11:49:51 +08:00

radix_cache.py

Move hash utils out of hicache_storage to break CUDA import chain (#22214)

2026-04-06 18:16:40 -07:00

swa_memory_pool.py

[sgl] improve accuracy of additional page requirement during spec decode (#22406)

2026-04-16 15:50:51 -07:00

swa_radix_cache.py

Fix SWA eviction boundary and page-align chunked prefill (#22470)

2026-04-09 22:09:43 -07:00

unified_radix_cache.py

[core] Always-on StreamingSession in UnifiedRadixCache (#23202)

2026-04-19 21:19:43 -07:00

utils.py

Move hash utils out of hicache_storage to break CUDA import chain (#22214)

2026-04-06 18:16:40 -07:00