sglang

test_asymmetric_mha_pool_host_unit.py

fix(hicache): support staged write-back for asymmetric MHA (#30981 )

2026-07-22 09:58:49 +08:00

test_asymmetric_mha_pool.py

[Kernel] Fuse KV-cache writes for asymmetric K/V (head_dim != v_head_dim) (#32813 )

2026-07-30 00:26:10 -07:00

test_decode_radix_lock_ref.py

[P/D disagg] Decode-side radix cache for SWA hybrid models (unified radix tree) (#27770 )

2026-08-21 09:25:06 +08:00

test_decode_retraction_backup.py

[HiCache] Allow a retraction host pool smaller than the device pool (#35543 )

2026-08-19 22:59:57 -07:00

test_dllm_fdfo_kv_reuse.py

O(1) slot allocation in ReqToTokenPool.alloc() (#32208 )

2026-08-11 11:26:05 -07:00

test_dsa_layer_shard_utils.py

[Feat][GLM5.2] Add DSA Cache Layer Split under Prefill CP (#29421 )

2026-07-09 03:03:56 -07:00

test_dsa_layer_split_broadcast.py

Facade DSA index-cache: MTP topk-reuse state + index-K storage (#28609 )

2026-08-06 00:34:31 -07:00

test_dsa_pool_host_unit.py

[mem_cache][9/N] refactor: move DSAIndexerPoolHost to pool_host.dsa (#35306 )

2026-08-21 15:59:15 +08:00

test_dsv4_compress_write_pad.py

[DSV4] Fix silent KV corruption when speculative draft tokens > 4 (#34189 )

2026-08-09 15:54:41 -07:00

test_embedding_cache_controller.py

[EPD] Batch embedding cache host-device range copies (#31574 )

2026-08-14 22:01:12 +08:00

test_evict_policy.py

[CI] reduce CPU CI scope with base-c suite (#28623 )

2026-06-24 16:18:06 +08:00

test_flashkda_strided_state_access.py

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00

test_full_loc_fast_path.py

[unified-memory] Support MLA-hybrid-Mamba (Kimi-Linear) on the Triton backend (#32971 )

2026-07-30 22:10:34 -07:00

test_hicache_dcp_host_pool.py

[DCP]Localize HiCache DCP indices once per transfer, not per layer (#34889 )

2026-08-16 21:54:51 -07:00

test_hicache_file_lru_unit.py

[misc] Remove unit test cases that fail the admission criteria (round 2) (#30703 )

2026-07-09 16:35:59 -07:00

test_hicache_load_back_timing.py

refactor(hicache): flatten L2 transfer execution (#34793 )

2026-08-16 00:33:34 -07:00

test_hicache_nixl_cleaner.py

Fix NIXL cleaner grouping for hybrid cache keys (#35130 )

2026-08-18 13:55:51 -05:00

test_hicache_nixl_storage.py

[HiCache & HybridModel] nixl hicache backend support hybrid models (#29191 )

2026-07-13 09:09:37 -07:00

test_hicache_staged_write_back_dispatch.py

[mem_cache][9/N] refactor: move DSAIndexerPoolHost to pool_host.dsa (#35306 )

2026-08-21 15:59:15 +08:00

test_hiradix_cache_unit.py

perf(kv-events): coalesce cache events (#31479 )

2026-08-13 13:36:53 -07:00

test_hiradix_pp_sync_drain.py

Fix HiCache PP sync test fixture (#35446 )

2026-08-19 12:25:17 +08:00

test_hisparse_allocator.py

[P/D disagg] Decode-side radix cache for SWA hybrid models (unified radix tree) (#27770 )

2026-08-21 09:25:06 +08:00

test_hisparse_max_token_pool_size.py

Fix/hisparse host backed max request length (#28753 )

2026-08-10 16:58:13 +08:00

test_hybrid_pool_assembler.py

[HiCache] Support DCP with DSpark (#35221 )

2026-08-19 01:42:19 -07:00

test_kda_fused_decode_strided_state.py

feat(kernels): port standalone Kimi K3 kernels (#32890 )

2026-08-01 13:26:47 +08:00

test_layout_compat.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

test_mamba_donated_alloc_ratio.py

config: the KV-cache configurator reads the bags (#34096 )

2026-08-09 14:45:42 -07:00

test_mamba_path_state_cap.py

[Cleanup] Move mamba-max-states-per-path validation into _handle_mamba_backend (#32502 )

2026-07-28 14:21:21 -07:00

test_mamba_state_transfer_buffers.py

Skip empty linear-attention state buffers in PD transfer (#35689 )

2026-08-21 01:00:50 +08:00

test_mamba_unittest.py

perf(kv-events): coalesce cache events (#31479 )

2026-08-13 13:36:53 -07:00

test_mem_cache_utils.py

feat: add cache salt support to KV cache events (#30827 )

2026-08-12 16:14:04 -07:00

test_mem_pool_host.py

[HiCache] Split the host-memory budget across co-located ranks (#35540 )

2026-08-19 13:01:58 -07:00

test_minimax_sparse_pool_host_unit.py

[HiCache] Split the host-memory budget across co-located ranks (#35540 )

2026-08-19 13:01:58 -07:00

test_minimax_sparse_pool_pd_unit.py

[minimax-m3] Split 2/4: mem-cache / HiCache / sparse KV pool (#28713 )

2026-06-28 00:19:38 +08:00

test_mmap_allocator.py

feat(hicache): Add shared memory allocator for host KV cache (#29326 )

2026-07-25 12:05:37 +08:00

test_mooncake_group_semantics.py

[HiCache] Add model-aware key isolation to Mooncake Store (#31920 )

2026-07-23 10:20:13 +08:00

test_mooncake_standalone_dummy_mamba.py

[HiCache] fix: Mooncake Dummy Client mode for hybrid Mamba models (#25278 )

2026-05-27 10:29:52 +08:00

test_mooncake_tenant_config.py

Add Mooncake tenant id support (#30256 )

2026-07-29 18:17:41 +08:00

test_multi_ended_allocator.py

[misc] Remove unit test cases that fail the admission criteria (#30690 )

2026-07-09 15:31:28 -07:00

test_mxfp8_scale_transfer_buffers.py

Support mxfp8 KV cache in PD transfer (#35718 )

2026-08-21 13:05:06 +08:00

test_page_major_layout.py

feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533 )

2026-06-29 14:49:54 -07:00

test_paged_free_segment.py

[Bugfix] Fix batched KV free aliasing (#34067 )

2026-08-08 03:34:44 -07:00

test_pd_envelope_transfer_layout.py

[PD] Support --enable-unified-memory with PD disaggregation (kimi-linear MLA hybrid-Mamba) (#33362 )

2026-08-10 16:07:58 -07:00

test_pure_swa_chunk_cache.py

[Fix] Respect cache_protected_len in ChunkCache and disabled-radix release paths (#31662 )

2026-07-18 12:04:25 -07:00

test_quantized_kv_pool.py

[Feature] Add FP4 KV Cache Design and support SM120 GPUs (#21601 )

2026-07-17 14:49:43 -07:00

test_radix_cache_cpp_unit.py

feat: add cache salt support to KV cache events (#30827 )

2026-08-12 16:14:04 -07:00

test_radix_cache_slru_accuracy.py

[CI] Move CPU-only unit tests to the CPU suite and trim dead 5090 registrations (#33654 )

2026-08-05 01:43:29 -07:00

test_radix_cache_unit.py

Refactor kv cache event mixin into a recorder (#35164 )

2026-08-19 01:20:17 +08:00

test_radix_force_miss.py

feat: add cache salt support to KV cache events (#30827 )

2026-08-12 16:14:04 -07:00

test_registry.py

Using unified radix tree by default for all case (#35081 )

2026-08-21 10:45:46 +08:00

test_replayssm_ring_accounting.py

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00

test_session_token_share_unit.py

feat: add cache salt support to KV cache events (#30827 )

2026-08-12 16:14:04 -07:00

test_session_unified_radix_cache.py

feat: Session-reference-aware Unified Radix Cache for agentic multi-turn workloads (#29173 )

2026-08-02 13:43:55 +08:00

test_store_cache_4d.py

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630 , Phase 2) (#30044 )

2026-07-10 21:41:08 +08:00

test_streaming_session_unit.py

feat: add cache salt support to KV cache events (#30827 )

2026-08-12 16:14:04 -07:00

test_swa_alloc_extend_page_estimation.py

[PD] Optimize SWA allocation (#28085 )

2026-06-15 11:01:55 -07:00

test_swa_cpu_copy_filter.py

Support CPU offload for mxfp8 KV cache (#35888 )

2026-08-22 10:19:06 +08:00

test_swa_eviction_boundary.py

Retain SWA down to the last state checkpoint (#34729 )

2026-08-15 01:12:38 +08:00

test_swa_lock_release_lifecycle.py

[misc] Remove unit test cases that fail the admission criteria (round 2) (#30703 )

2026-07-09 16:35:59 -07:00

test_swa_unittest.py

[Fix] Clear full-to-SWA mapping with index_fill_ to avoid a blocking H2D copy (#35773 )

2026-08-21 01:23:26 -07:00

test_tree_core_registry.py

feat: Session-reference-aware Unified Radix Cache for agentic multi-turn workloads (#29173 )

2026-08-02 13:43:55 +08:00

test_triton_kernel_layout.py

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630 , Phase 2) (#30044 )

2026-07-10 21:41:08 +08:00

test_umbp_host_allocator.py

[HiCache][AMD] Add UMBP tiered DRAM + SSD L3 storage backend with hugepage host allocator (#25377 )

2026-07-01 22:21:37 +08:00

test_umbp_store.py

fix(hicache/umbp): support DeepSeek-V4 hybrid HostPoolGroup (multi-po… (#30762 )

2026-08-13 15:40:07 +08:00

test_unified_handout_zeroing.py

[unified memory] Support DSPARK speculative decoding + fix two NaN root causes (page hand-out zeroing, CuTe int32 slot-stride wrap) (#33974 )

2026-08-10 10:35:06 -07:00

test_unified_mamba_views.py

Bump FlashInfer to 0.6.17 and remove Kimi K3 workarounds (#33997 )

2026-08-12 02:17:26 -07:00

test_unified_mla_dense_block_table.py

[unified-memory] Support fa3, the default MLA backend on pre-Blackwell hosts (#33046 )

2026-07-31 11:46:46 -07:00

test_unified_mla_gpu_parity.py

[unified-memory] Support MLA-hybrid-Mamba (Kimi-Linear) on the Triton backend (#32971 )

2026-07-30 22:10:34 -07:00

test_unified_mla_views.py

[unified-memory] Support MLA-hybrid-Mamba (Kimi-Linear) on the Triton backend (#32971 )

2026-07-30 22:10:34 -07:00

test_unified_radix_cache_bench.py

[CI] Fail lint when a registered file's TestCase classes never run (#32735 )

2026-07-29 00:45:01 -07:00

test_unified_radix_cache_unittest.py

Fix buffer-mode HiCache load-back ownership races; add optional prefetch anchor lock (#35769 )

2026-08-21 20:20:36 -07:00

test_unified_radix_hicache_dispatch.py

[UnifiedTree]: move /mem_cache/unifed_cache_component dir to /mem_cache/unified_cache (#32484 )

2026-07-28 16:28:21 +08:00