3 people e2d56bbbfc [Router] Bound the e2e worker memory budget so prefill graph capture stops OOMing (#39713) ...

Co-authored-by: Kangyan Zhou <kangyan.zhou@radixark.ai>
Co-authored-by: Claude Opus 5 (1M context) <noreply@anthropic.com>

2026-09-16 00:13:09 -07:00

..

__init__.py

sgl-router: experimental Rust HTTP router for SGLang worker pools (#25851)

2026-05-25 15:34:05 +08:00

gateway.py

[Router] Add bucket-aware policy domains and native cache indexing (#38108)

2026-09-06 19:47:51 +08:00

model_pool.py

[Router] Real-GPU e2e coverage for storage-tier-aware cache routing (3/4) (#39110)

2026-09-15 15:48:51 -07:00

model_specs.py

[Router] Bound the e2e worker memory budget so prefill graph capture stops OOMing (#39713)

2026-09-16 00:13:09 -07:00

test_model_pool.py

[Router] Add load-aware prefill admission and bounded policy proposals (#37843)

2026-09-05 11:53:26 +08:00