Zhiqiang Xie beaf3d9252 [HiCache] Replace skip_lock_node_ids with a segment lock protocol (#36848)

2026-09-09 14:55:51 -07:00

..

ascend

[NPU]support mf device urma and host rdma trans type (#38174)

2026-09-09 09:44:19 +08:00

base

【NPU】Support EAGLE when PP enabled in prefill nodes (#32207)

2026-09-08 15:45:36 +08:00

common

[rust-server] fix p/d bootstrap across dp listeners (#36234)

2026-09-08 13:22:32 +08:00

encoder

[Config] Round 6.4: the runtime reads the bags, not the record (#38049)

2026-09-06 21:41:46 -07:00

fake

[PD] Gate deferred decode KV release on backend capability (#37454)

2026-09-03 15:42:21 -07:00

mooncake

fix(glm-5.2-nvfp4): bound Mooncake synchronous transfer batches (#32758)

2026-09-08 22:14:33 +08:00

mori

[PD] Bound transfer engine init with SGLANG_DISAGGREGATION_ENGINE_INIT_TIMEOUT (#37874)

2026-09-03 17:16:55 -07:00

nixl

GLM-5.3-Flash support (#36507)

2026-09-06 02:27:59 -07:00

decode_hicache_mixin.py

[HiCache] Replace skip_lock_node_ids with a segment lock protocol (#36848)

2026-09-09 14:55:51 -07:00

decode_kvcache_offload_manager.py

[mem_cache] Require page-aligned starts in free_segment and drop the boundary trim (#37729)

2026-09-03 13:28:33 -07:00

decode_schedule_batch_mixin.py

[Unified Tree] Support Branching-Point Caching for the SWA Component (#34565)

2026-09-05 12:29:16 +08:00

decode.py

[HiCache] Replace skip_lock_node_ids with a segment lock protocol (#36848)

2026-09-09 14:55:51 -07:00

kv_events.py

refactor(hicache): simplify decode offload state bookkeeping (#37299)

2026-08-31 23:09:41 -07:00

prefill.py

[Scheduler] Add HRRN schedule policy to significantly reduce TTFT (#32911)

2026-09-08 22:14:03 +08:00

utils.py

support qwen 3.8 flash next (#37500)

2026-09-08 13:56:21 -07:00