sglang

allocator

Size KV pool after CUDA graph capture (opt-in) (#30157 )

2026-07-07 12:05:01 -07:00

cpp_radix_tree

Fix syntax errors in cpp_radix_tree (#13315 )

2025-11-15 11:35:43 +08:00

cpp_utils

[HiCache] Optimize HiCache hash generation with bulk token byte conversion (#28287 )

2026-07-01 15:44:23 +08:00

hybrid_cache

[AMD] Enable unified-KV HiCache on DeepSeek-V4 (#29417 )

2026-07-09 12:58:47 -07:00

layout

feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533 )

2026-06-29 14:49:54 -07:00

pool_host

[Feat][GLM5.2] Add DSA Cache Layer Split under Prefill CP (#29421 )

2026-07-09 03:03:56 -07:00

sparsity

hisparse: support NIXL DRAM KV destinations for HiSparse (#27563 )

2026-06-27 22:32:29 +08:00

storage

[refactor] Retire the legacy config accessor and the remaining process singletons (#30493 )

2026-07-09 02:10:47 -07:00

triton_ops

Support speculative decoding on CPU (#27862 )

2026-07-09 10:27:09 +08:00

unified_cache_components

[AMD] Enable unified-KV HiCache on DeepSeek-V4 (#29417 )

2026-07-09 12:58:47 -07:00

base_prefix_cache.py

[AMD] Enable unified-KV HiCache on DeepSeek-V4 (#29417 )

2026-07-09 12:58:47 -07:00

base_swa_memory_pool.py

Unify full→SWA index translation in init_forward_metadata; drop pool caches (#27091 )

2026-06-03 16:12:27 -07:00

cache_init_params.py

feat: first-class session identity in SGLang (#29436 )

2026-06-28 07:16:38 -07:00

chunk_cache.py

model: support baidu unlimited-ocr (#29186 )

2026-06-27 23:36:19 +08:00

common.py

[refactor] Retire the legacy config accessor and the remaining process singletons (#30493 )

2026-07-09 02:10:47 -07:00

deepseek_v4_compress_state.py

[AMD] Fix DeepSeek V4 MTP accuracy issue (#30333 )

2026-07-06 23:57:57 -07:00

deepseek_v4_memory_pool.py

[AMD] Enable unified-KV HiCache on DeepSeek-V4 (#29417 )

2026-07-09 12:58:47 -07:00

dsa_cache_layer_split.py

[Bugfix] Migrate retired parallel accessors (#30653 )

2026-07-09 11:22:34 -07:00

events.py

fix: batch BlockRemoved events per radix node (#29265 )

2026-06-26 16:13:40 +08:00

evict_policy.py

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984 )

2026-06-11 17:38:05 -07:00

flush_cache.py

Update docs (#1839 )

2024-10-30 02:49:08 -07:00

hi_mamba_radix_cache.py

[refactor] Retire the legacy config accessor and the remaining process singletons (#30493 )

2026-07-09 02:10:47 -07:00

hicache_storage.py

feat(mem_cache): add client-side metadata cache for HiCacheFile storage (#29716 )

2026-07-07 18:21:46 -07:00

hiradix_cache.py

[refactor] Retire the legacy config accessor and the remaining process singletons (#30493 )

2026-07-09 02:10:47 -07:00

hisparse_memory_pool.py

[mem_cache][3/N] refactor: move HiSparse allocators to allocator/hisparse.py (#26678 )

2026-06-11 19:50:24 +08:00

kv_cache_builder.py

[mem_cache][6/N] refactor: move MHA host-pool into pool_host/mha.py (#30249 )

2026-07-08 20:12:52 +08:00

kv_vmm_backing.py

Size KV pool after CUDA graph capture (opt-in) (#30157 )

2026-07-07 12:05:01 -07:00

mamba_checkpoint_pool.py

[refactor] Retire the legacy config accessor and the remaining process singletons (#30493 )

2026-07-09 02:10:47 -07:00

mamba_radix_cache.py

[refactor] Retire the legacy config accessor and the remaining process singletons (#30493 )

2026-07-09 02:10:47 -07:00

memory_pool_host.py

[Feat][GLM5.2] Add DSA Cache Layer Split under Prefill CP (#29421 )

2026-07-09 03:03:56 -07:00

memory_pool.py

[Feat][GLM5.2] Add DSA Cache Layer Split under Prefill CP (#29421 )

2026-07-09 03:03:56 -07:00

mmap_allocator.py

Refactor NIXL hicache. Add O_DIRECT support (#25173 )

2026-06-01 17:28:53 +02:00

multi_ended_allocator.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

multimodal_cache.py

[VLM] Chunk-aware ViT encoding with per-image cache and lazy device transfer (#22038 )

2026-04-04 16:55:17 +08:00

pure_swa_radix_cache.py

model: support baidu unlimited-ocr (#29186 )

2026-06-27 23:36:19 +08:00

radix_cache_cpp.py

[perf] reduce overhead of fill_ids list reconstruction and decref (#27965 )

2026-06-14 00:41:11 -07:00

radix_cache.py

[HiCache] Optimize HiCache hash generation with bulk token byte conversion (#28287 )

2026-07-01 15:44:23 +08:00

registry.py

Feat/flexkv main connector (#29701 )

2026-07-07 15:35:52 +08:00

session_radix_cache.py

feat: first-class session identity in SGLang (#29436 )

2026-06-28 07:16:38 -07:00

swa_memory_pool.py

Size KV pool after CUDA graph capture (opt-in) (#30157 )

2026-07-07 12:05:01 -07:00

swa_radix_cache.py

[AMD] Fix stale SWA ring buffer on radix prefix reuse for DeepSeek-V4 with unified_kv backend (#30339 )

2026-07-09 11:28:22 -07:00

unified_memory_pool.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

unified_radix_cache.py

[AMD] Enable unified-KV HiCache on DeepSeek-V4 (#29417 )

2026-07-09 12:58:47 -07:00

utils.py

[HiCache] Optimize HiCache hash generation with bulk token byte conversion (#28287 )

2026-07-01 15:44:23 +08:00