sglang

test_asymmetric_mha_pool_host_unit.py

fix(hicache): support staged write-back for asymmetric MHA (#30981 )

2026-07-22 09:58:49 +08:00

test_asymmetric_mha_pool.py

[Kernel] Fuse KV-cache writes for asymmetric K/V (head_dim != v_head_dim) (#32813 )

2026-07-30 00:26:10 -07:00

test_decode_radix_lock_ref.py

[CI] Move CPU-only unit tests to the CPU suite and trim dead 5090 registrations (#33654 )

2026-08-05 01:43:29 -07:00

test_dllm_fdfo_kv_reuse.py

config: retire the last process-global config field reads (#33338 )

2026-08-02 21:24:42 -07:00

test_dsa_layer_shard_utils.py

[Feat][GLM5.2] Add DSA Cache Layer Split under Prefill CP (#29421 )

2026-07-09 03:03:56 -07:00

test_dsa_layer_split_broadcast.py

Facade DSA index-cache: MTP topk-reuse state + index-K storage (#28609 )

2026-08-06 00:34:31 -07:00

test_dsa_pool_host_unit.py

[mem_cache][7/N] refactor: move MLATokenToKVPoolHost to pool_host.mla (#30616 )

2026-07-13 14:23:38 +08:00

test_embedding_cache_controller.py

[misc] Remove unit test cases that fail the admission criteria (round 2) (#30703 )

2026-07-09 16:35:59 -07:00

test_evict_policy.py

[CI] reduce CPU CI scope with base-c suite (#28623 )

2026-06-24 16:18:06 +08:00

test_flashkda_strided_state_access.py

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00

test_full_loc_fast_path.py

[unified-memory] Support MLA-hybrid-Mamba (Kimi-Linear) on the Triton backend (#32971 )

2026-07-30 22:10:34 -07:00

test_hicache_dcp_host_pool.py

[Feat] DCP + HiCache L2 Support (ported from kimi-k3) (#33112 )

2026-08-02 23:35:27 +08:00

test_hicache_file_lru_unit.py

[misc] Remove unit test cases that fail the admission criteria (round 2) (#30703 )

2026-07-09 16:35:59 -07:00

test_hicache_load_back_timing.py

Observability enhancement for HiCache (#32388 )

2026-08-05 14:13:06 -07:00

test_hicache_nixl_cleaner.py

[HiCache] Add NIXL FILE cache cleaner (#28258 )

2026-06-24 08:13:55 -07:00

test_hicache_nixl_storage.py

[HiCache & HybridModel] nixl hicache backend support hybrid models (#29191 )

2026-07-13 09:09:37 -07:00

test_hicache_staged_write_back_dispatch.py

Observability enhancement for HiCache (#32388 )

2026-08-05 14:13:06 -07:00

test_hiradix_cache_unit.py

[AMD] Register 3 unit mem_cache + utils tests for stage-b-test-1-gpu-small-amd (#29782 )

2026-07-01 12:57:48 -07:00

test_hiradix_pp_sync_drain.py

[HiCache] Fix hicache host memory leak by bounding PP-sync work_list (#28916 )

2026-06-23 16:39:03 +08:00

test_hisparse_allocator.py

[HiSparse]Fix DeepSeek V4 HiSparse PD Transfers with Separate Host and Device KV Indices (#31901 )

2026-08-03 20:35:04 +08:00

test_hybrid_pool_assembler.py

Fix --hicache-size allocating ~2x host memory on hybrid Mamba (#32915 )

2026-08-01 02:37:57 +08:00

test_kda_fused_decode_strided_state.py

feat(kernels): port standalone Kimi K3 kernels (#32890 )

2026-08-01 13:26:47 +08:00

test_layout_compat.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678 )

2026-07-01 13:21:59 -07:00

test_mamba_donated_alloc_ratio.py

fix(PP): size the mamba pool per pipeline stage, not per whole model (#33666 )

2026-08-06 13:10:43 -07:00

test_mamba_path_state_cap.py

[Cleanup] Move mamba-max-states-per-path validation into _handle_mamba_backend (#32502 )

2026-07-28 14:21:21 -07:00

test_mamba_unittest.py

Remove the HiMambaRadixTree that is no longer in use (#33468 )

2026-08-07 23:01:40 +08:00

test_mem_cache_utils.py

[HiCache] Optimize HiCache hash generation with bulk token byte conversion (#28287 )

2026-07-01 15:44:23 +08:00

test_mem_pool_host.py

feat(hicache): Add shared memory allocator for host KV cache (#29326 )

2026-07-25 12:05:37 +08:00

test_minimax_sparse_pool_host_unit.py

[mem_cache][6/N] refactor: move MHA host-pool into pool_host/mha.py (#30249 )

2026-07-08 20:12:52 +08:00

test_minimax_sparse_pool_pd_unit.py

[minimax-m3] Split 2/4: mem-cache / HiCache / sparse KV pool (#28713 )

2026-06-28 00:19:38 +08:00

test_mmap_allocator.py

feat(hicache): Add shared memory allocator for host KV cache (#29326 )

2026-07-25 12:05:37 +08:00

test_mooncake_group_semantics.py

[HiCache] Add model-aware key isolation to Mooncake Store (#31920 )

2026-07-23 10:20:13 +08:00

test_mooncake_standalone_dummy_mamba.py

[HiCache] fix: Mooncake Dummy Client mode for hybrid Mamba models (#25278 )

2026-05-27 10:29:52 +08:00

test_mooncake_tenant_config.py

Add Mooncake tenant id support (#30256 )

2026-07-29 18:17:41 +08:00

test_multi_ended_allocator.py

[misc] Remove unit test cases that fail the admission criteria (#30690 )

2026-07-09 15:31:28 -07:00

test_page_major_layout.py

feat(mem_cache): page-major (layer-major within a page) KV/state layout (#29533 )

2026-06-29 14:49:54 -07:00

test_paged_free_segment.py

[Kimi] Support DCP + DSpark (ported from kimi-k3 branch) (#32828 )

2026-07-31 17:39:00 -07:00

test_pure_swa_chunk_cache.py

[Fix] Respect cache_protected_len in ChunkCache and disabled-radix release paths (#31662 )

2026-07-18 12:04:25 -07:00

test_quantized_kv_pool.py

[Feature] Add FP4 KV Cache Design and support SM120 GPUs (#21601 )

2026-07-17 14:49:43 -07:00

test_radix_cache_slru_accuracy.py

[CI] Move CPU-only unit tests to the CPU suite and trim dead 5090 registrations (#33654 )

2026-08-05 01:43:29 -07:00

test_radix_cache_unit.py

[srt] Batch scheduler cache frees (#33475 )

2026-08-06 21:49:59 -07:00

test_radix_force_miss.py

Add num_waiting_uncached_tokens load metric (#27174 )

2026-06-03 18:29:49 -07:00

test_registry.py

[UnifiedTree]: move /mem_cache/unifed_cache_component dir to /mem_cache/unified_cache (#32484 )

2026-07-28 16:28:21 +08:00

test_replayssm_ring_accounting.py

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00

test_session_token_share_unit.py

Return top-p/top-k sampling mask/nucleas (#27408 )

2026-07-13 17:58:51 -05:00

test_session_unified_radix_cache.py

feat: Session-reference-aware Unified Radix Cache for agentic multi-turn workloads (#29173 )

2026-08-02 13:43:55 +08:00

test_store_cache_4d.py

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630 , Phase 2) (#30044 )

2026-07-10 21:41:08 +08:00

test_streaming_session_unit.py

Skip mamba lock during decoding (#32228 )

2026-07-29 21:53:28 +08:00

test_swa_alloc_extend_page_estimation.py

[PD] Optimize SWA allocation (#28085 )

2026-06-15 11:01:55 -07:00

test_swa_eviction_boundary.py

Let cache backend do not couple with owned committed kv details and avoid kv_committed_freed/kv_overallocated_freed fields (#29428 )

2026-07-15 14:43:10 +08:00

test_swa_lock_release_lifecycle.py

[misc] Remove unit test cases that fail the admission criteria (round 2) (#30703 )

2026-07-09 16:35:59 -07:00

test_swa_unittest.py

[srt] Batch scheduler cache frees (#33475 )

2026-08-06 21:49:59 -07:00

test_tree_core_registry.py

feat: Session-reference-aware Unified Radix Cache for agentic multi-turn workloads (#29173 )

2026-08-02 13:43:55 +08:00

test_triton_kernel_layout.py

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630 , Phase 2) (#30044 )

2026-07-10 21:41:08 +08:00

test_umbp_host_allocator.py

[HiCache][AMD] Add UMBP tiered DRAM + SSD L3 storage backend with hugepage host allocator (#25377 )

2026-07-01 22:21:37 +08:00

test_umbp_store.py

[HiCache][AMD] Add UMBP tiered DRAM + SSD L3 storage backend with hugepage host allocator (#25377 )

2026-07-01 22:21:37 +08:00

test_unified_mamba_views.py

[Kimi] Support kimi-k3 (#32541 )

2026-08-04 13:22:49 -07:00

test_unified_mla_dense_block_table.py

[unified-memory] Support fa3, the default MLA backend on pre-Blackwell hosts (#33046 )

2026-07-31 11:46:46 -07:00

test_unified_mla_gpu_parity.py

[unified-memory] Support MLA-hybrid-Mamba (Kimi-Linear) on the Triton backend (#32971 )

2026-07-30 22:10:34 -07:00

test_unified_mla_views.py

[unified-memory] Support MLA-hybrid-Mamba (Kimi-Linear) on the Triton backend (#32971 )

2026-07-30 22:10:34 -07:00

test_unified_radix_cache_bench.py

[CI] Fail lint when a registered file's TestCase classes never run (#32735 )

2026-07-29 00:45:01 -07:00

test_unified_radix_cache_unittest.py

[HiCache] write_back: reclaim duplicated host copy first under host pressure (#33777 )

2026-08-07 15:59:59 -07:00

test_unified_radix_hicache_dispatch.py

[UnifiedTree]: move /mem_cache/unifed_cache_component dir to /mem_cache/unified_cache (#32484 )

2026-07-28 16:28:21 +08:00