Xiaoyu Zhang b276a9acee chore: cleanup garbage code (#29770)

2026-07-02 16:14:01 +08:00

..

runner

Share one logits output buffer across prefill/decode/draft cuda-graph runners (#29779)

2026-07-01 23:30:56 -07:00

runner_backend

[XPU] Enable XPU graph support (decode full-graph + prefill tc_piecewise) (#29053)

2026-07-02 13:24:35 +08:00

runner_backend_utils

Enable Breakable Cuda Graph as Default (#29458)

2026-07-01 22:04:44 -07:00

runner_utils

Share one logits output buffer across prefill/decode/draft cuda-graph runners (#29779)

2026-07-01 23:30:56 -07:00

triton_ops

[codex] Centralize Triton utility kernels (#26000)

2026-06-02 16:47:45 +08:00

cpu_graph_runner.py

[CPU] add indices in chunk_gated_delta_rule (#29267)

2026-06-26 07:51:07 +08:00

cuda_graph_buffer_registry.py

[CPU] Fix model failures on Xeon (#29497)

2026-07-02 13:20:18 +08:00

cuda_graph_config.py

Enable Breakable Cuda Graph as Default (#29458)

2026-07-01 22:04:44 -07:00

forward_batch_deepseek_mha_mixin.py

[feature] implement dcp for deepseek_v2 (#14194)

2026-06-25 15:15:04 -07:00

forward_batch_info.py

[NPU] Support DeepSeek V4 Flash MTP on Ascend (#28980)

2026-06-30 16:22:13 +08:00

forward_context.py

[Refactor] Cuda Graph Runner/Backend Refactor (#23906)

2026-06-09 21:36:57 -07:00

graph_shared_output.py

Share one logits output buffer across prefill/decode/draft cuda-graph runners (#29779)

2026-07-01 23:30:56 -07:00

hook_manager.py

Rename: --hooks to --forward-hooks (#13994)

2025-11-26 22:26:28 +08:00

input_buffers.py

[refactor] Retire DecodeInputBuffers / PrefillInputBuffers in favor of CudaGraphBufferRegistry (#27192)

2026-06-03 20:52:56 -07:00

mindspore_runner.py

[NPU]mindspore model support moe (#15363)

2026-02-02 17:52:49 +08:00

model_runner_kv_cache_mixin.py

feat(mem_cache): unified memory pool for hybrid Mamba / SWA models (#29678)

2026-07-01 13:21:59 -07:00

model_runner.py

chore: cleanup garbage code (#29770)

2026-07-02 16:14:01 +08:00

pool_configurator.py

Optimize C128 state pool allocation using request state pool (#28612)

2026-06-30 19:11:29 -07:00