Commit Graph
28 Commits
Author SHA1 Message Date
Keyang Ru 72392f2908 [router] basic mcp support for openai router response api (#10978) 2025-09-27 21:49:33 -04:00
Keyang Ru a73eb8cd20 [router] Support Oracle DB(ATP) Data Connector (#10845) 2025-09-24 23:59:32 -04:00
Keyang Ru f4e3ebeb05 [router] Support streaming for Openai Router Response api (#10822) 2025-09-23 14:56:28 -07:00
Keyang Ru 366043db8e [router] Add get and cancel method for response api (#10387) 2025-09-12 16:19:38 -07:00
Keyang Ru a23bdeaf04 [router] Basic OAI Response api (#10346) 2025-09-11 20:56:17 -07:00
Keyang Ru 7b141f816c [router][ci] Add gpu utilization analyze with nvml (#10345) 2025-09-11 19:26:02 -07:00
Keyang Ru 1ee11df8ac [router][ci] add gpu process check and free port before start server (#10338) 2025-09-11 14:24:16 -07:00
Keyang Ru dee197e11b [router] Add OpenAI backend support - core function (#10254) 2025-09-11 14:13:51 -07:00
Keyang Ru 480d1b8b20 [router] add benchmark for regular router and pd router (#10280) 2025-09-11 12:04:11 -07:00
Keyang Ru cda7e47ce7 [router] Add PD router mmlu test (#10256) 2025-09-10 08:47:24 -07:00
Keyang Ru 718f25ae6e Explicitly export CMAKE_BUILD_PARALLEL_LEVEL (#10193) 2025-09-08 22:35:27 -07:00
Keyang Ru 9eb50ecc9c [router] Improve the router e2e tests (#10102) 2025-09-06 16:19:28 -07:00
Keyang Ru b3e7a2cee4 increase the rust e2e timeout (#10116) 2025-09-06 16:17:34 -07:00
Keyang Ru 21b9a4b435 [router] Introduce router integration tests (#10086) 2025-09-05 18:52:53 -07:00
Keyang Ru 4f0e28d7fc [router] add rust cache for rust unit test (#10079) 2025-09-05 09:58:59 -07:00
Keyang Ru 045ab92dc0 [router] add py binding unit tests to coverage 80% (#10043) 2025-09-05 08:40:21 -07:00
Keyang Ru 3f2d0cefcd [router] Add MCP Tool Handler (#9615) 2025-08-27 19:12:39 -07:00
Keyang Ru 5ef545e678 [router] Move all protocols to spec.rs file (#9519) 2025-08-22 14:18:47 -07:00
Keyang RuandYineng Zhang 3828db4309 [router] Add IGW (Inference Gateway) Feature Flag (#9371)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-08-20 17:38:57 -07:00
Keyang Ru f515449582 Fix gpt-oss response api streaming issue (#9368) 2025-08-19 20:19:42 -07:00
Keyang Ru 5ae5ecaa15 [router] Implement OpenAI Responses API specification (#9367) 2025-08-19 20:14:47 -07:00
Keyang Ru c5057262fa [Router] Add validation module for API parameters (#9335) 2025-08-19 13:25:53 -07:00
Keyang Ru ce67b2d586 [router]restructure protocol modules for better organization (#9321) 2025-08-19 01:07:58 +00:00
Keyang Ru 886454e8e7 [MISC] use dynamic choices for tool-call-parser argument (#9316) 2025-08-18 13:02:10 -07:00
Keyang Ruandkey4ng 4093d460ce [CI] migrate router to BM.A10.4 runner (#8992)
Co-authored-by: key4ng <rukeyang@gamil.com>
2025-08-11 22:41:18 -07:00
Keyang Ruandkey4ng 7c9697178e [CI]Add genai-bench Performance Validation for PD Router (#8477)
Co-authored-by: key4ng <rukeyang@gamil.com>
2025-07-28 16:58:23 -07:00
Keyang Ru 29bd4c8135 [CI] Add CI Testing for Prefill-Decode Disaggregation with Router (#7540) 2025-06-27 00:18:56 -07:00
Keyang Ru 5e7fdc79fa [OAI Server Refactor] [ChatCompletions & Completions] Support Return Hidden State (#7329)
Signed-off-by: keru <rukeyang@gmail.com>
2025-06-20 19:18:53 -07:00