cctry dbe9e3b706 [PD] Early-send cached-prefix KV overlapping uncached prefill forward (#29316)

2026-06-25 13:31:53 -07:00

..

ascend

[NPU]pp support mla kv transfer (#23893)

2026-05-13 09:10:02 +08:00

base

[AMD] Support unified_kv_triton for disaggregation (#27935)

2026-06-13 14:08:27 -07:00

common

Fix CP page filtering by request-local position (#28718)

2026-06-22 20:47:29 +08:00

fake

[PD] Add conclude_state to fake KV backend (#25599)

2026-05-18 19:56:42 +08:00

mooncake

[AMD] Support unified_kv_triton for disaggregation (#27935)

2026-06-13 14:08:27 -07:00

mori

[AMD] Support unified_kv_triton for disaggregation (#27935)

2026-06-13 14:08:27 -07:00

nixl

[PD] Fix data race in NixlKVManager for NIXL backend (#28897)

2026-06-24 18:11:01 +08:00

decode_hicache_mixin.py

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984)

2026-06-11 17:38:05 -07:00

decode_kvcache_offload_manager.py

feat: Support HiCache for MiMo-V2 models (1/N) (#27378)

2026-06-13 15:40:27 +08:00

decode_schedule_batch_mixin.py

Remove Req.extend_logprob_start_len field and make it pure (#27625)

2026-06-25 09:06:14 +08:00

decode.py

Inline extend_range accessors and remove the extend_input_len/fill_len properties (#27611)

2026-06-25 08:56:44 +08:00

encode_grpc_server.py

[Refactor] Introduce sock_send/sock_recv wrappers for zmq IPC (#29012)

2026-06-23 15:54:36 -07:00

encode_receiver.py

[EPD][BugFix] Fix encode_with_global_cache_mooncake (#28031)

2026-06-15 19:47:52 +08:00

encode_server.py

[Cleanup] IPC struct renames, better typing, and SenderWrapper removal (#29214)

2026-06-24 17:25:24 -07:00

kv_events.py

feat(kv-events): expose structured KV-event publisher block on /server_info (#25844)

2026-05-23 01:59:45 +08:00

prefill.py

[PD] Early-send cached-prefix KV overlapping uncached prefill forward (#29316)

2026-06-25 13:31:53 -07:00

utils.py

Fix CP page filtering by request-local position (#28718)

2026-06-22 20:47:29 +08:00