fzyzcjy 39e508b7fc Extract layer-index setup into a module (#31156)

2026-07-14 15:59:07 +08:00

..

model_runner_components

Extract layer-index setup into a module (#31156)

2026-07-14 15:59:07 +08:00

runner

Introduce NgramEmbeddingManager component (#31154)

2026-07-14 15:58:08 +08:00

runner_backend

[cuda-graph] Size breakable-graph shared buffer from warmup output; slice by produced row count (#30834)

2026-07-11 10:41:44 -07:00

runner_backend_utils

Fix diffusion BCG lifetime and add Z-Image-Turbo CI (#30584)

2026-07-10 21:19:59 +08:00

runner_utils

[Spec] Rename num_tokens_per_bs to num_tokens_per_req (#30977)

2026-07-13 13:47:53 -05:00

cpu_graph_runner.py

[Spec] Rename num_tokens_per_bs to num_tokens_per_req (#30977)

2026-07-13 13:47:53 -05:00

cuda_graph_buffer_registry.py

[Spec] Rename num_tokens_per_bs to num_tokens_per_req (#30977)

2026-07-13 13:47:53 -05:00

cuda_graph_config.py

[refactor] Retire the legacy config accessor and the remaining process singletons (#30493)

2026-07-09 02:10:47 -07:00

forward_batch_deepseek_mha_mixin.py

[Kernel] Introduce sglang.kernels namespace and migrate scattered triton_ops kernels (RFC #29630, Phase 2) (#30044)

2026-07-10 21:41:08 +08:00

forward_batch_info.py

Introduce NgramEmbeddingManager component (#31154)

2026-07-14 15:58:08 +08:00

forward_context.py

[Refactor] Cuda Graph Runner/Backend Refactor (#23906)

2026-06-09 21:36:57 -07:00

graph_shared_output.py

Share one logits output buffer across prefill/decode/draft cuda-graph runners (#29779)

2026-07-01 23:30:56 -07:00

hook_manager.py

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

input_buffers.py

[refactor] Retire DecodeInputBuffers / PrefillInputBuffers in favor of CudaGraphBufferRegistry (#27192)

2026-06-03 20:52:56 -07:00

mindspore_runner.py

[NPU]mindspore model support moe (#15363)

2026-02-02 17:52:49 +08:00

model_runner_kv_cache_mixin.py

Extract layer-index setup into a module (#31156)

2026-07-14 15:59:07 +08:00

model_runner.py

Extract layer-index setup into a module (#31156)

2026-07-14 15:59:07 +08:00

pool_configurator.py

Extract hybrid-arch helpers into configs.hybrid_arch and ModelConfig (#31150)

2026-07-14 15:55:32 +08:00