sglang

allocator

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

cpp_radix_tree

Fix syntax errors in cpp_radix_tree (#13315 )

2025-11-15 11:35:43 +08:00

cpp_utils

[HiCache] Optimize HiCache hash generation with bulk token byte conversion (#28287 )

2026-07-01 15:44:23 +08:00

hybrid_cache

[HiCache] Optimize HiCache hash generation with bulk token byte conversion (#28287 )

2026-07-01 15:44:23 +08:00

layout

feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533 )

2026-06-29 14:49:54 -07:00

pool_host

[HiCache][AMD] Add UMBP tiered DRAM + SSD L3 storage backend with hugepage host allocator (#25377 )

2026-07-01 22:21:37 +08:00

sparsity

hisparse: support NIXL DRAM KV destinations for HiSparse (#27563 )

2026-06-27 22:32:29 +08:00

storage

[HiCache][AMD] Add UMBP tiered DRAM + SSD L3 storage backend with hugepage host allocator (#25377 )

2026-07-01 22:21:37 +08:00

triton_ops

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

unified_cache_components

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

base_prefix_cache.py

feat: first-class session identity in SGLang (#29436 )

2026-06-28 07:16:38 -07:00

base_swa_memory_pool.py

Unify full→SWA index translation in init_forward_metadata; drop pool caches (#27091 )

2026-06-03 16:12:27 -07:00

cache_init_params.py

feat: first-class session identity in SGLang (#29436 )

2026-06-28 07:16:38 -07:00

chunk_cache.py

model: support baidu unlimited-ocr (#29186 )

2026-06-27 23:36:19 +08:00

common.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

deepseek_v4_compress_state.py

Optimize C128 state pool allocation using request state pool (#28612 )

2026-06-30 19:11:29 -07:00

deepseek_v4_memory_pool.py

Optimize C128 state pool allocation using request state pool (#28612 )

2026-06-30 19:11:29 -07:00

events.py

fix: batch BlockRemoved events per radix node (#29265 )

2026-06-26 16:13:40 +08:00

evict_policy.py

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984 )

2026-06-11 17:38:05 -07:00

flush_cache.py

Update docs (#1839 )

2024-10-30 02:49:08 -07:00

hi_mamba_radix_cache.py

[BugFix] NCCL deadlock in HiCache writing_check by making all_reduce unconditional (#26923 )

2026-06-22 01:47:44 +08:00

hicache_storage.py

[mem_cache][5/N] refactor: extract host KV cache base layer into pool_host package (#27273 )

2026-06-20 20:44:08 +08:00

hiradix_cache.py

[minimax-m3] Split 2/4: mem-cache / HiCache / sparse KV pool (#28713 )

2026-06-28 00:19:38 +08:00

hisparse_memory_pool.py

[mem_cache][3/N] refactor: move HiSparse allocators to allocator/hisparse.py (#26678 )

2026-06-11 19:50:24 +08:00

kv_cache_builder.py

[HiCache]fix draft host pool allocator type (#29823 )

2026-07-01 19:31:16 +08:00

mamba_checkpoint_pool.py

[GDN][KDA][mem_cache] int8 checkpoint pool for the linear-attn prefix cache (#28185 )

2026-06-17 20:41:46 -07:00

mamba_radix_cache.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

memory_pool_host.py

[minimax-m3] Split 2/4: mem-cache / HiCache / sparse KV pool (#28713 )

2026-06-28 00:19:38 +08:00

memory_pool.py

Fix MambaPool.clear_slots OOM by replacing expand-based tensor allocation with scalar zeroing (#27923 )

2026-07-02 09:26:55 +08:00

mmap_allocator.py

Refactor NIXL hicache. Add O_DIRECT support (#25173 )

2026-06-01 17:28:53 +02:00

multi_ended_allocator.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

multimodal_cache.py

[VLM] Chunk-aware ViT encoding with per-image cache and lazy device transfer (#22038 )

2026-04-04 16:55:17 +08:00

pure_swa_radix_cache.py

model: support baidu unlimited-ocr (#29186 )

2026-06-27 23:36:19 +08:00

radix_cache_cpp.py

[perf] reduce overhead of fill_ids list reconstruction and decref (#27965 )

2026-06-14 00:41:11 -07:00

radix_cache.py

[HiCache] Optimize HiCache hash generation with bulk token byte conversion (#28287 )

2026-07-01 15:44:23 +08:00

registry.py

model: support baidu unlimited-ocr (#29186 )

2026-06-27 23:36:19 +08:00

session_radix_cache.py

feat: first-class session identity in SGLang (#29436 )

2026-06-28 07:16:38 -07:00

swa_memory_pool.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

swa_radix_cache.py

[bug2] skip swa recovery on locked full kv (#29352 )

2026-06-30 16:07:06 -07:00

unified_memory_pool.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

unified_radix_cache.py

[bug1] keep full kv when swa skips leaf data (#29351 )

2026-07-01 00:51:18 +08:00

utils.py

[HiCache] Optimize HiCache hash generation with bulk token byte conversion (#28287 )

2026-07-01 15:44:23 +08:00