cctry e0e6a6efb2 Fix CPP Radix Cache and add test to CI (#11645)

2025-11-11 11:51:37 -08:00

..

cpp_radix_tree

[RadixTree] Reduce Stack Push/Pop Overhead for Leaf Nodes, Improve radix_tree Leaf Collection Performance (#12199)

2025-11-11 23:35:39 +08:00

storage

Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224)

2025-11-11 02:56:22 +08:00

allocator_ascend.py

[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)

2025-10-17 16:49:46 -07:00

allocator.py

EAGLE cache fix for SWARadixCache (#11231)

2025-10-07 18:21:37 +08:00

base_prefix_cache.py

Tiny simplify evcition metrics collector (#12983)

2025-11-11 23:23:48 +08:00

chunk_cache.py

Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224)

2025-11-11 02:56:22 +08:00

common.py

Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224)

2025-11-11 02:56:22 +08:00

evict_policy.py

[HiCache] feat: add more eviction policy (#11506)

2025-10-18 15:49:45 +00:00

flush_cache.py

Update docs (#1839)

2024-10-30 02:49:08 -07:00

hicache_storage.py

[Fix]: HiCache hasher failed when EAGLE mode enabled (#12025)

2025-10-24 23:53:13 +08:00

hiradix_cache.py

Tiny simplify evcition metrics collector (#12983)

2025-11-11 23:23:48 +08:00

mamba_radix_cache.py

Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224)

2025-11-11 02:56:22 +08:00

memory_pool_host.py

[Bug fix] Fix severe memory waste issue with torch.empty pin_memory (#12266)

2025-10-31 21:30:37 +08:00

memory_pool.py

[Refactor] rename set_index_k_and_scale_buffer to set_index_k_scale_b… (#12956)

2025-11-09 20:35:19 -08:00

multimodal_cache.py

feat: basic support for server-level multimodal cache (#10775)

2025-11-10 00:27:50 +08:00

radix_cache_cpp.py

Fix CPP Radix Cache and add test to CI (#11645)

2025-11-11 11:51:37 -08:00

radix_cache.py

Tiny simplify evcition metrics collector (#12983)

2025-11-11 23:23:48 +08:00

swa_radix_cache.py

Tiny simplify evcition metrics collector (#12983)

2025-11-11 23:23:48 +08:00

utils.py

[PD] feat: refactor custom mem pool and add barex pd support (#12332)

2025-11-09 18:51:34 +08:00