sglang

allocator

[mem_cache][2/N] refactor: move SWATokenToKVPoolAllocator to allocator/swa.py (#26676 )

2026-06-04 15:10:37 +08:00

cpp_radix_tree

Fix syntax errors in cpp_radix_tree (#13315 )

2025-11-15 11:35:43 +08:00

hybrid_cache

[UnifiedTree]: Support l3 storage for swa and deepseek v4 (#26881 )

2026-06-04 10:17:34 +08:00

sparsity

[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821 )

2026-05-20 00:18:04 -07:00

storage

[UnifiedTree]: Support l3 storage for swa and deepseek v4 (#26881 )

2026-06-04 10:17:34 +08:00

triton_ops

[codex] Centralize Triton utility kernels (#26000 )

2026-06-02 16:47:45 +08:00

unified_cache_components

[UnifiedTree]: Sync sidecar component hits across TP ranks and make SWA prefetch all-or-nothing (#27264 )

2026-06-05 09:23:54 +08:00

base_prefix_cache.py

[UnifiedTree]: Support l3 storage for swa and deepseek v4 (#26881 )

2026-06-04 10:17:34 +08:00

base_swa_memory_pool.py

Unify full→SWA index translation in init_forward_metadata; drop pool caches (#27091 )

2026-06-03 16:12:27 -07:00

cache_init_params.py

[Mamba] extra buffer lazy support (#27118 )

2026-06-03 12:42:11 -07:00

chunk_cache.py

[mem_cache][2/N] refactor: move SWATokenToKVPoolAllocator to allocator/swa.py (#26676 )

2026-06-04 15:10:37 +08:00

common.py

[mem_cache][2/N] refactor: move SWATokenToKVPoolAllocator to allocator/swa.py (#26676 )

2026-06-04 15:10:37 +08:00

deepseek_v4_compress_state.py

Amd/deepseek v4 rebase main 0509 (#24933 )

2026-05-18 09:15:07 -07:00

deepseek_v4_memory_pool.py

Unify full→SWA index translation in init_forward_metadata; drop pool caches (#27091 )

2026-06-03 16:12:27 -07:00

events.py

perf: migrate Req token-id storage to array.array('q') in Scheduler (#25098 )

2026-05-22 10:51:07 -07:00

evict_policy.py

[Feature] Add SLRU eviction policy & fix RadixCache hit_count bug (#18843 )

2026-03-08 21:30:55 +08:00

flush_cache.py

Update docs (#1839 )

2024-10-30 02:49:08 -07:00

hi_mamba_radix_cache.py

[BugFix]: Fix HiMamba HiCache prefetch hang after L3 sidecar transfer (#27366 )

2026-06-05 20:37:40 +08:00

hicache_storage.py

[HiCache] feat: support draft offload for mooncake (#24984 )

2026-06-02 21:42:04 -07:00

hiradix_cache.py

hicache kv events: publish split write-through fragments (#27072 )

2026-06-03 14:52:25 -07:00

hisparse_memory_pool.py

[PD & HiSparse] Add DeepSeek V4 support for HiSparse direct Prefill-to-Decode DRAM (#24880 )

2026-06-05 15:39:48 +08:00

kv_cache_builder.py

[Mamba] extra buffer lazy support (#27118 )

2026-06-03 12:42:11 -07:00

mamba_radix_cache.py

[Mamba] extra buffer lazy support (#27118 )

2026-06-03 12:42:11 -07:00

memory_pool_host.py

[PD & HiSparse] Add DeepSeek V4 support for HiSparse direct Prefill-to-Decode DRAM (#24880 )

2026-06-05 15:39:48 +08:00

memory_pool.py

Plug mamba_extra_buffer ping-pong slot leaks (#26941 )

2026-06-04 21:46:36 +08:00

mmap_allocator.py

Refactor NIXL hicache. Add O_DIRECT support (#25173 )

2026-06-01 17:28:53 +02:00

multimodal_cache.py

[VLM] Chunk-aware ViT encoding with per-image cache and lazy device transfer (#22038 )

2026-04-04 16:55:17 +08:00

radix_cache_cpp.py

[UnifiedRadixCache] Fix HiCache load back start node (#25088 )

2026-05-14 13:18:12 +08:00

radix_cache.py

hicache kv events: publish split write-through fragments (#27072 )

2026-06-03 14:52:25 -07:00

registry.py

[MLX] Support Qwen3.5 (dense) Model (#25754 )

2026-05-30 17:05:02 +08:00

swa_memory_pool.py

[mem_cache][2/N] refactor: move SWATokenToKVPoolAllocator to allocator/swa.py (#26676 )

2026-06-04 15:10:37 +08:00

swa_radix_cache.py

[mem_cache][2/N] refactor: move SWATokenToKVPoolAllocator to allocator/swa.py (#26676 )

2026-06-04 15:10:37 +08:00

unified_radix_cache.py

[UnifiedTree]: Fix CP Reduce For L3 HiCache (#27330 )

2026-06-05 14:03:54 +08:00

utils.py

[codex] Centralize Triton utility kernels (#26000 )

2026-06-02 16:47:45 +08:00