3 people 806365e778 feat: Support HiCache for MiMo-V2 models (1/N) (#27378) ...

Co-authored-by: Zhangheng <hzh0425@apache.org>
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>

2026-06-13 15:40:27 +08:00

..

ascend

[NPU]pp support mla kv transfer (#23893)

2026-05-13 09:10:02 +08:00

base

[PD] Fix negative prefill kv_transfer_alloc_ms under optimistic prefill (#27885)

2026-06-11 13:12:25 -07:00

common

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984)

2026-06-11 17:38:05 -07:00

fake

[PD] Add conclude_state to fake KV backend (#25599)

2026-05-18 19:56:42 +08:00

mooncake

[PD] Fix ZMQ stale socket reconnection in PD disaggregation (#27796)

2026-06-11 19:51:12 +08:00

mori

[PD][AMD]: incremental KV transfer with decode radix cache (#26288)

2026-06-13 00:06:44 -07:00

nixl

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984)

2026-06-11 17:38:05 -07:00

decode_hicache_mixin.py

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984)

2026-06-11 17:38:05 -07:00

decode_kvcache_offload_manager.py

feat: Support HiCache for MiMo-V2 models (1/N) (#27378)

2026-06-13 15:40:27 +08:00

decode_schedule_batch_mixin.py

Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637)

2026-06-08 14:52:18 +08:00

decode.py

fix(pd): disable overlap for spec+grammar in disagg decode loop (#28039)

2026-06-12 14:08:36 -07:00

encode_grpc_server.py

Wrap IPv6 addresses in gRPC, bench_serving, and log messages (#21236)

2026-03-29 00:36:31 -07:00

encode_receiver.py

Add EPD disaggregated encode tracing (#25994)

2026-06-12 16:16:14 +08:00

encode_server.py

Add EPD disaggregated encode tracing (#25994)

2026-06-12 16:16:14 +08:00

kv_events.py

feat(kv-events): expose structured KV-event publisher block on /server_info (#25844)

2026-05-23 01:59:45 +08:00

prefill.py

[RL] Handle Mooncake buffers across memory release (#27696)

2026-06-11 11:15:00 +08:00

utils.py

[PD] Optimistic prefill (#26780)

2026-06-02 01:16:14 -07:00