[Router] Add bucket-aware policy domains and native cache indexing (#38108)

Signed-off-by: Vincent Gao <vincentbo@linux.alibaba.com> Co-authored-by: inkcherry <mingzhi.liu@amd.com> Co-authored-by: yangbodong22011 <13137470+yangbodong22011@users.noreply.github.com>
2026-09-06 19:47:51 +08:00
parent a176ba2f7b
commit 5bebe7a033
76 changed files with 5842 additions and 3639 deletions
@@ -186,7 +186,7 @@ class Gateway:
                         each worker's mode (plain) and any disaggregation
                         metadata are learned from ``/server_info``.
            policy: Policy kind — ``round_robin``, ``random``, ``power_of_two``,
-                    or ``cache_aware_zmq``.
+                    or ``cache_aware``.
            kv_indexer_endpoint: Optional external KV Indexer gRPC endpoint.
            timeout: How long to wait for ``/readyz`` before giving up.
        """