3 people 4bea51d885 feat(unified-memory): dense KV views for uniform-row MHA/SWA models (#34602) ...

Co-authored-by: Caihua Li <caihua.li@bytedance.com>
Co-authored-by: Cheng Wan <cheng.wan@radixark.ai>

2026-08-30 15:10:12 -07:00

..

__init__.py

feat(unified-memory): dense KV views for uniform-row MHA/SWA models (#34602)

2026-08-30 15:10:12 -07:00

aiter_unified_attention.py

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)

2026-07-10 21:41:08 +08:00

cache_move.py

feat(unified-memory): dense KV views for uniform-row MHA/SWA models (#34602)

2026-08-30 15:10:12 -07:00

cache_ops.py

[AMD] Add concat_and_cast_mha_k_pad_kernel to support 12-head and enable K3 aiter prefill kernel (#34837)

2026-08-15 14:39:30 -07:00

fused_fp8_qkv_kv_cache.py

[Kernel] Phase 4 batch-2: migrate JIT operator groups into kernels.ops (no shims) (RFC #29630) (#32015)

2026-07-22 17:49:51 +08:00

hicache.py

[Misc] Clean up python/sglang package structure (#35062)

2026-08-17 14:24:35 -07:00

hisparse.py

[HiSparse] Support hisparse multi-step swap io kernel (#32162)

2026-08-24 17:29:44 -07:00

kv_indices.py

feat(unified-memory): dense KV views for uniform-row MHA/SWA models (#34602)

2026-08-30 15:10:12 -07:00

kvcache.py

[Kernel] Fuse KV-cache writes for asymmetric K/V (head_dim != v_head_dim) (#32813)

2026-07-30 00:26:10 -07:00

minimax_store_kv_index.py

[Kernel] Phase 4 batch-2: migrate JIT operator groups into kernels.ops (no shims) (RFC #29630) (#32015)

2026-07-22 17:49:51 +08:00

mla_buffer.py

[Kernel] Skip reserved writes in MLA KV cache (#36003)

2026-08-25 22:42:23 -07:00

pd_dcp_gather.py

[PD] Pack DCP1→DCP-N PD KV transfers into dest-contiguous RDMA blocks (#35762)

2026-08-28 21:41:30 -07:00

rope_cache.py

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)

2026-07-10 21:41:08 +08:00

set_mla_kv_buffer.py

[Kernel] Skip reserved writes in MLA KV cache (#36003)

2026-08-25 22:42:23 -07:00

triton_store_cache.py

fix mqa preshuffle layout issue for deepseek v4 (#31563)

2026-07-29 07:36:48 -07:00

trtllm_mha_graph_metadata.py

[Perf] Skip blocks past per-request live length in full-width Triton kernels (#32109)

2026-07-22 22:00:25 -07:00

trtllm_mha_page_table.py

[Fix] Guard kernel OOB accesses and harden runtime edge cases (#30847)

2026-07-11 14:22:13 -05:00

zero_pages.py

[unified memory] Support DSPARK speculative decoding + fix two NaN root causes (page hand-out zeroing, CuTe int32 slot-stride wrap) (#33974)

2026-08-10 10:35:06 -07:00