3 people 8cc112d486 [DSA] Skip indexer KV cache for skip-topk layers (#30531) ...

Co-authored-by: Brayden Zhong <brayden@radixark.ai>
Co-authored-by: mmangkad <mohammad.angkad@radixark.ai>

2026-08-17 02:02:23 -07:00

..

model_runner_components

config: the post-publish consumers of the supplied-instance surface read the bags

2026-08-15 00:39:35 -07:00

runner

[Spec] Resolve shared-read ends from the backend declaration alone (#35059)

2026-08-17 01:35:29 -07:00

runner_backend

Profiling Enhancements [1/3]: cuda graph profile traces (#24370)

2026-08-06 03:19:35 -07:00

runner_backend_utils

[misc] Remove break-graph debug log; reclaim pid-less /dev/shm leaks in CI (#33929)

2026-08-06 21:18:01 -07:00

runner_utils

[AMD] [GLM5] Skip DSA decode indexer when kv_len <= index_topk (dense k-only fast path) (#31324)

2026-08-16 16:30:54 -07:00

cpu_graph_runner.py

[CPU] Add support for Gemma4 on Xeon (#22498)

2026-08-17 10:52:26 +08:00

cuda_graph_buffer_registry.py

[misc] Unify MLA scaling init and remove dead buffer / scaling code (#33363)

2026-08-05 15:59:33 -07:00

cuda_graph_config.py

fix(server): capture legal multi-request prefill CUDA graph batches (#30206)

2026-08-03 16:56:59 -07:00

forward_batch_deepseek_mha_mixin.py

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)

2026-07-10 21:41:08 +08:00

forward_batch_info.py

[NPU] Support DeepSeek-V4 DSpark and refactor DSV4 cache management (#33676)

2026-08-17 16:27:44 +08:00

forward_context.py

[Refactor] Cuda Graph Runner/Backend Refactor (#23906)

2026-06-09 21:36:57 -07:00

graph_memory_usage.py

[Observability] Add startup, memory, and hybrid SWA diagnostics (#33375)

2026-08-04 12:50:09 -07:00

graph_shared_output.py

Share one logits output buffer across prefill/decode/draft cuda-graph runners (#29779)

2026-07-01 23:30:56 -07:00

hook_manager.py

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

input_buffers.py

[misc] Unify MLA scaling init and remove dead buffer / scaling code (#33363)

2026-08-05 15:59:33 -07:00

mindspore_runner.py

[NPU]mindspore model support moe (#15363)

2026-02-02 17:52:49 +08:00

model_runner.py

[Spec] Resolve shared-read ends from the backend declaration alone (#35059)

2026-08-17 01:35:29 -07:00

pool_configurator.py

[DSA] Skip indexer KV cache for skip-topk layers (#30531)

2026-08-17 02:02:23 -07:00