4 people ecd97de1fc [Router] Add load-aware prefill admission and bounded policy proposals (#37843) ...

Signed-off-by: Vincent Gao <vincentbo@linux.alibaba.com>
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

2026-09-05 11:53:26 +08:00

..

sgl-router

[Router] Add load-aware prefill admission and bounded policy proposals (#37843)

2026-09-05 11:53:26 +08:00