12 Commits
Author SHA1 Message Date
6220f45d8e [PD] Add /v1/responses support to the HTTP PD router (#36141)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-09-13 22:48:13 +08:00
grunerandAmit Gruner 0ab427d0e1 [SMG] Add /v1/models fallback for model name discovery (#25293)
Co-authored-by: Amit Gruner <agruner@crusoe.ai>
2026-05-18 22:02:35 +08:00
Kangyan-ZhouandClaude Opus 4.7 d74d9bda49 [gateway] Align /v1/loads and /model_info with sglang server; drop dead /rerank (#24167)
Co-authored-by: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-05-02 11:43:30 -07:00
David Cheung ed427e1299 Migrate all callers from /get_server_info to /server_info (#21463) 2026-04-01 21:17:50 -07:00
Simo Lin 0236522214 refactor: remove crate re-export aliases from lib.rs (#18737) 2026-02-12 09:17:24 -08:00
fzyzcjy 9c2530642c Change routing policy API to be async to support more policies (#17048) 2026-01-17 17:12:51 +08:00
Ziwen Zhao cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
fzyzcjy ff3ddb9d9b Support min num routing keys in key-based load balancing policy (#16564) 2026-01-12 21:38:03 -08:00
Simo Lin ed729d22b3 [model-gateway] refactor workflow engine from type erasure to typed engines (#16973) 2026-01-12 10:47:00 -08:00
Chang Su b98bd9a5fb [model-gateway] Tighten visibility in modules and remove unused re-exports (#16524) 2026-01-05 17:38:50 -08:00
Simo Lin e53160bb31 [model-gateway] reorganize integration tests into logical subdirectories (#16451) 2026-01-04 21:49:20 -08:00
Simo Lin f84487af59 [model-gateway] : Rust integration tests for integration_mock replacement (#16441) 2026-01-04 21:01:47 -08:00