Shangming Cai 57909f731b [PD] Fix KV cache corruption on abort by notifying ongoing prefill (#27372) ...

Signed-off-by: Shangming Cai <csmthu@gmail.com>

2026-06-06 00:56:13 +08:00

..

ascend

[NPU]pp support mla kv transfer (#23893)

2026-05-13 09:10:02 +08:00

base

[Refactor] Rename NSA → DSA: user-facing aliases, file/class/import rename (#25821)

2026-05-20 00:18:04 -07:00

common

[PD] Fix KV cache corruption on abort by notifying ongoing prefill (#27372)

2026-06-06 00:56:13 +08:00

fake

[PD] Add conclude_state to fake KV backend (#25599)

2026-05-18 19:56:42 +08:00

mooncake

[PD] Fix KV cache corruption on abort by notifying ongoing prefill (#27372)

2026-06-06 00:56:13 +08:00

mori

[PD][MoRI] Align hybrid state transfer with per-component schema (#26539)

2026-05-29 00:54:46 -07:00

nixl

[Bugfix] Clean up failed NIXL sender state (#27011)

2026-06-03 12:15:15 +08:00

decode_hicache_mixin.py

[PD]: Support HiCache prefetching and pd-incremental transfer on decode side (#26227)

2026-06-02 15:40:10 +08:00

decode_kvcache_offload_manager.py

[BugFix] fix(hicache): fix two slot-reuse races in DecodeKVCacheOffloadManager (#24226)

2026-05-20 18:20:19 -07:00

decode_schedule_batch_mixin.py

[Scheduler] Defer prefill input_ids H2D to forward stream, unify resolve via future_map (#25945)

2026-05-30 02:58:13 -07:00

decode.py

fix(pd): clear stale bootstrap_room when freeing metadata buffer slot (#27374)

2026-06-05 19:46:35 +08:00

encode_grpc_server.py

Wrap IPv6 addresses in gRPC, bench_serving, and log messages (#21236)

2026-03-29 00:36:31 -07:00

encode_receiver.py

[EPD] Optimize the Mooncake backend (#22587)

2026-05-29 10:42:24 +08:00

encode_server.py

[EPD] feat: encoder DP mode with per-rank subprocess workers (#26576)

2026-06-04 12:37:41 +08:00

kv_events.py

feat(kv-events): expose structured KV-event publisher block on /server_info (#25844)

2026-05-23 01:59:45 +08:00

prefill.py

[PD] Deduplicate PD logprob normalization (#27085)

2026-06-03 19:08:15 +08:00

utils.py

[PD] Optimistic prefill (#26780)

2026-06-02 01:16:14 -07:00