3 people 23ab10a63e Support speculative decoding with unified SWA memory (#36403) ...

Co-authored-by: yhzhuang <yhzhuang@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

2026-09-03 10:44:57 -07:00

..

model_runner_components

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

runner

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

runner_backend

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

runner_backend_utils

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

runner_utils

[Memory] Size the CUDA graph pool from warmup measurements and fix graph-pool borrowing (#36911)

2026-09-01 09:32:38 -07:00

cpu_graph_runner.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

cuda_graph_buffer_registry.py

[PP] Support prefill CUDA graph proxy tensors (#36248)

2026-08-30 23:11:45 -07:00

cuda_graph_config.py

[Config] Round 5.1: the published-side readers ask the bags, and a platform fact gets one address (#37086)

2026-08-30 02:18:33 -07:00

forward_batch_deepseek_mha_mixin.py

[Feature] Unified memory: support decode context parallelism for Kimi-Linear (#36890)

2026-09-01 12:44:26 -07:00

forward_batch_info.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

forward_context.py

[Refactor] Cuda Graph Runner/Backend Refactor (#23906)

2026-06-09 21:36:57 -07:00

graph_memory_usage.py

[Observability] Add startup, memory, and hybrid SWA diagnostics (#33375)

2026-08-04 12:50:09 -07:00

graph_shared_output.py

config: borrowed-record reads follow the config bags (#35908)

2026-08-23 01:19:20 -07:00

hook_manager.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

input_buffers.py

[CI][RFC] Replace black-jupyter with ruff-format (#37210)

2026-09-02 19:46:08 -07:00

mindspore_runner.py

config: the runtime readers take the published bags (#36254)

2026-08-26 05:08:25 -07:00

model_runner.py

[Speculative Decoding] Add native UNO serving support (#37667)

2026-09-03 20:08:41 +08:00

pool_configurator.py

Support speculative decoding with unified SWA memory (#36403)

2026-09-03 10:44:57 -07:00

step_span_utils.py

Profiling Enhancements [2/3]: detailed execution step annotations (#24911)

2026-08-18 01:09:07 -07:00