Lianmin ZhengandItai Gat dea2be5ae3 [CUDA Graph] Allow custom decode graph runners (#33553) ...

Co-authored-by: Itai Gat <itaigat.mail@gmail.com>

2026-08-04 12:48:56 -07:00

..

__init__.py

Introduce WeightUpdater and WeightExporter components (#31148)

2026-07-14 15:53:33 +08:00

attention_backend_setup.py

refactor: wrap split backends once on full-attention backends (#31439)

2026-07-17 19:15:04 +08:00

cuda_graph_setup.py

[CUDA Graph] Allow custom decode graph runners (#33553)

2026-08-04 12:48:56 -07:00

kv_pool_runtime.py

[mem_cache] Label HiCache host pools and clarify post-capture KV sizing logs (#33445)

2026-08-04 04:21:36 -07:00

layer_setup.py

Add Inkling model support (#31681)

2026-07-19 22:57:37 -07:00

load_model_utils.py

[Elastic EP] Fix recovery lifecycle and add manual coverage (#31744)

2026-07-25 14:32:47 +08:00

misc_utils.py

Fix the chunked-prefix-cache gate writing config the backends never read (#33168)

2026-08-01 08:57:28 -07:00

moe_ep_setup.py

Extract MoE/EP setup into a moe_ep_setup module (#31159)

2026-07-14 16:00:24 +08:00

ngram_embedding_manager.py

Fix LongCat n-gram token-table crashes on padded batches (#31312)

2026-07-22 20:24:21 +08:00

remote_instance_weight_transporter.py

config: route parallel config-leaf reads through get_parallel() (#33170)

2026-08-01 08:58:39 -07:00

spec_aux_hidden_state.py

Extract spec aux-hidden-state resolution into a module (#31157)

2026-07-14 15:59:35 +08:00

weight_exporter.py

Introduce WeightUpdater and WeightExporter components (#31148)

2026-07-14 15:53:33 +08:00

weight_updater.py

[FEAT] Support fast engine recovery through weight cache (#27139)

2026-07-25 14:31:21 +08:00