Kangyan-ZhouandClaude Opus 4.8 21647f1f5d [router] Apply chat template before cache-aware hashing (fix overlap=0 on chat traffic) (#27386) ...

Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>

2026-06-10 10:27:54 -07:00

..

config

feat(agentic router): add sticky-session routing policy (#27394)

2026-06-07 20:05:27 -07:00

discovery

[router] Configure experimental sgl-router via CLI flags instead of a config file (#27073)

2026-06-05 10:02:10 +08:00

health

[router] Add request/TTFT/worker metrics + Grafana dashboard to experimental sgl-router (#27591)

2026-06-09 07:25:56 -07:00

policies

[router] Apply chat template before cache-aware hashing (fix overlap=0 on chat traffic) (#27386)

2026-06-10 10:27:54 -07:00

proxy

[router] Add request/TTFT/worker metrics + Grafana dashboard to experimental sgl-router (#27591)

2026-06-09 07:25:56 -07:00

server

[router] Add request/TTFT/worker metrics + Grafana dashboard to experimental sgl-router (#27591)

2026-06-09 07:25:56 -07:00

tokenizer

[router] Apply chat template before cache-aware hashing (fix overlap=0 on chat traffic) (#27386)

2026-06-10 10:27:54 -07:00

workers

[router] Add request/TTFT/worker metrics + Grafana dashboard to experimental sgl-router (#27591)

2026-06-09 07:25:56 -07:00

lib.rs

sgl-router: experimental Rust HTTP router for SGLang worker pools (#25851)

2026-05-25 15:34:05 +08:00

main.rs

[router] Configure experimental sgl-router via CLI flags instead of a config file (#27073)

2026-06-05 10:02:10 +08:00