3 people 33719cfb31 [PD] Optimize SWA allocation (#28085) ...

Co-authored-by: cctry <cctry@fb.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

2026-06-15 11:01:55 -07:00

..

ascend

[NPU]pp support mla kv transfer (#23893)

2026-05-13 09:10:02 +08:00

base

[AMD] Support unified_kv_triton for disaggregation (#27935)

2026-06-13 14:08:27 -07:00

common

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984)

2026-06-11 17:38:05 -07:00

fake

[PD] Add conclude_state to fake KV backend (#25599)

2026-05-18 19:56:42 +08:00

mooncake

[AMD] Support unified_kv_triton for disaggregation (#27935)

2026-06-13 14:08:27 -07:00

mori

[AMD] Support unified_kv_triton for disaggregation (#27935)

2026-06-13 14:08:27 -07:00

nixl

[AMD] Support unified_kv_triton for disaggregation (#27935)

2026-06-13 14:08:27 -07:00

decode_hicache_mixin.py

[lint] Enable Ruff UP037 to drop redundant quoted annotations (#27984)

2026-06-11 17:38:05 -07:00

decode_kvcache_offload_manager.py

feat: Support HiCache for MiMo-V2 models (1/N) (#27378)

2026-06-13 15:40:27 +08:00

decode_schedule_batch_mixin.py

Refactor Req.fill_ids into full_untruncated_fill_ids + fill_len with equivalence (#26637)

2026-06-08 14:52:18 +08:00

decode.py

[PD] Optimize SWA allocation (#28085)

2026-06-15 11:01:55 -07:00

encode_grpc_server.py

Wrap IPv6 addresses in gRPC, bench_serving, and log messages (#21236)

2026-03-29 00:36:31 -07:00

encode_receiver.py

[EPD][BugFix] Fix encode_with_global_cache_mooncake (#28031)

2026-06-15 19:47:52 +08:00

encode_server.py

[EPD][BugFix] Fix encode_with_global_cache_mooncake (#28031)

2026-06-15 19:47:52 +08:00

kv_events.py

feat(kv-events): expose structured KV-event publisher block on /server_info (#25844)

2026-05-23 01:59:45 +08:00

prefill.py

Unify NVTX annotation helpers and split the enable gate per subsystem (#28165)

2026-06-14 00:04:59 -07:00

utils.py

feat: report multimodal (image/audio/video) token counts in usage.prompt_tokens_details (#27122)

2026-06-15 11:04:10 +08:00