Commit Graph
70 Commits
Author SHA1 Message Date
Keyang Ru 401ed0c594 [router] Add comprehensive validation to Responses API (#13127) 2025-11-12 11:19:27 -08:00
Keyang Ru 0493775b06 [router][ci] Quick Improvement to make CI more stable (#12869) 2025-11-10 13:56:35 -08:00
Keyang Ru 9840bf4f84 [router][ci] Fix maturin build (#13012) 2025-11-10 12:33:32 -08:00
Keyang Ru d3d7f960b5 [router] Switch MCP tests from DeepWiki to self-hosted Brave search server (#12849) 2025-11-07 16:16:07 -08:00
Keyang Ru 5c9273c032 [router] Support structured model output for openai and grpc router (#12431) 2025-11-07 10:16:45 -08:00
Keyang Ru 8be0e1bc9c fix ci (#12760) 2025-11-06 00:21:11 -08:00
Keyang Ru 74630ba310 [router][ci] Disable cache (#12752) 2025-11-05 22:49:03 -08:00
Keyang Ru 74243dffa2 Revert "[router] web_search_preview tool basic implementation" (#12716) 2025-11-05 18:57:39 -08:00
Keyang Ru 4ea4c48bb0 Revert "[ci] fix permission" (#12732) 2025-11-05 18:26:29 -08:00
Keyang Ru a5affb0caf [ci] fix permission (#12729) 2025-11-05 17:43:48 -08:00
Keyang Ru 5925d3d719 fix labeler (#12718) 2025-11-05 17:34:56 -08:00
Keyang RuandChang Su 7ef1964a66 [router] add basic ci tests for gpt-oss model support (#12651)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-11-05 15:45:11 -08:00
Keyang Ru b0476a0642 [router][quick fix] Add minimal option for reasoning effort in spec (#12711) 2025-11-05 15:43:19 -08:00
Keyang Ru 80802c4cc6 [router][ci] speed up python binding to 1.5 min (#12673) 2025-11-05 14:52:33 -08:00
Keyang Ru 72b5f3d0bb [ci] install released version router (#12410) 2025-10-30 21:59:08 -07:00
Keyang Ru 96ac24c09e [router] web_search_preview tool basic implementation (#12290) 2025-10-30 14:37:28 -07:00
Keyang Ru 4d2f17bd0b [router] Function call support for openai router Responses API (#12386) 2025-10-30 12:45:10 -07:00
Keyang Ru 69bf801173 [router] Fix safety_identifier missing (#12404) 2025-10-30 10:40:50 -07:00
Keyang Ru 737b58d6dc [rust][ci] Add end-to-end tests for Oracle history backend (#12233) 2025-10-28 10:57:32 -07:00
Keyang Ru 9288544180 [router] Fix type unmatch during validation (#12257) 2025-10-28 06:04:54 -07:00
Keyang Ru 4ea42f7cea [router] Refactor data connector architecture with unified storage modules (#12096) 2025-10-24 22:44:34 -07:00
Keyang Ru d7f0d88fa2 [router] implement response api get input item function and refactor input/output store (#11924) 2025-10-24 10:44:21 -07:00
Keyang Ru e321c97113 [router] Add comprehensive E2E tests for Response API (#11988) 2025-10-23 05:13:51 -07:00
Keyang Ru 77258ce039 [router] Support multiple worker URLs for OpenAI router (#11723) 2025-10-22 09:27:58 -07:00
Keyang Ru 63cfe1b032 [router] Add gRPC E2E test suite (#11790) 2025-10-21 17:51:21 -07:00
Keyang Ru 87a92e459a Fix openai input_text type compatibility (#11935) 2025-10-21 16:10:35 -07:00
Keyang Ru 2bc3fcd420 [doc] update router document (#11767) 2025-10-17 10:26:54 -07:00
Keyang Ru 7780230a15 Revert "[router] fix get_models endpoint for openai router (#11687)" (#11740) 2025-10-16 18:36:53 -07:00
Keyang Ru 7a7f99beb7 [router] add spec.rs to enables tests under spec folder (#11734) 2025-10-16 16:07:26 -07:00
Keyang RuandChang Su 4c9bcb9d56 [Router] Refactor protocol definitions: split spec.rs into modular files (#11677)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-16 13:44:44 -07:00
Keyang Ru 0975ba99bc [router] fix get_models endpoint for openai router (#11687) 2025-10-16 09:00:08 -07:00
Keyang Ru d2478cd4ff [router] Fix response api related spec (#11621) 2025-10-15 09:59:38 -07:00
Keyang Ruandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> eb8cac6fe2 [router] add py binding and readme for openai router and history backend (#11453)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-10-14 09:42:34 -07:00
Keyang Ru 63e84352b7 [router] openai router: support grok model (#11511) 2025-10-12 22:44:43 -04:00
Keyang Ru a0835c3a62 [router] Fix ci nvcc not found error (#11411) 2025-10-10 15:43:16 -07:00
Keyang Ru eb7d9261c0 [router] conversation item API: create, retrieve and delete (#11369) 2025-10-09 17:43:16 -04:00
Keyang Ru 84768d1017 [router] Refactor OpenAI router: split monolithic file and move location (#11359) 2025-10-09 00:46:39 -04:00
Keyang Ru 7ac6b900f4 [router] Support history management using conversation (#11339) 2025-10-08 15:24:02 -07:00
Keyang Ru 4ed67c27e3 [router] support Openai router conversation API CRUD (#11297) 2025-10-07 15:31:35 -07:00
Keyang Ru 34151f173b [router] Steaming support for MCP Tool Calls in OpenAI Router (#11173) 2025-10-03 00:19:43 -07:00
Keyang Ru a28b394fba [router] Add multi-turn tool calling loop support for MCP integration (#11143) 2025-10-01 12:50:21 -07:00
Keyang Ru 7fb551a75d [router] add mcp list and mcp call in output array (#11112) 2025-09-30 21:41:54 -04:00
Keyang Ru 72392f2908 [router] basic mcp support for openai router response api (#10978) 2025-09-27 21:49:33 -04:00
Keyang Ru a73eb8cd20 [router] Support Oracle DB(ATP) Data Connector (#10845) 2025-09-24 23:59:32 -04:00
Keyang Ru f4e3ebeb05 [router] Support streaming for Openai Router Response api (#10822) 2025-09-23 14:56:28 -07:00
Keyang Ru 366043db8e [router] Add get and cancel method for response api (#10387) 2025-09-12 16:19:38 -07:00
Keyang Ru a23bdeaf04 [router] Basic OAI Response api (#10346) 2025-09-11 20:56:17 -07:00
Keyang Ru 7b141f816c [router][ci] Add gpu utilization analyze with nvml (#10345) 2025-09-11 19:26:02 -07:00
Keyang Ru 1ee11df8ac [router][ci] add gpu process check and free port before start server (#10338) 2025-09-11 14:24:16 -07:00
Keyang Ru dee197e11b [router] Add OpenAI backend support - core function (#10254) 2025-09-11 14:13:51 -07:00
Keyang Ru 480d1b8b20 [router] add benchmark for regular router and pd router (#10280) 2025-09-11 12:04:11 -07:00
Keyang Ru cda7e47ce7 [router] Add PD router mmlu test (#10256) 2025-09-10 08:47:24 -07:00
Keyang Ru 718f25ae6e Explicitly export CMAKE_BUILD_PARALLEL_LEVEL (#10193) 2025-09-08 22:35:27 -07:00
Keyang Ru 9eb50ecc9c [router] Improve the router e2e tests (#10102) 2025-09-06 16:19:28 -07:00
Keyang Ru b3e7a2cee4 increase the rust e2e timeout (#10116) 2025-09-06 16:17:34 -07:00
Keyang Ru 21b9a4b435 [router] Introduce router integration tests (#10086) 2025-09-05 18:52:53 -07:00
Keyang Ru 4f0e28d7fc [router] add rust cache for rust unit test (#10079) 2025-09-05 09:58:59 -07:00
Keyang Ru 045ab92dc0 [router] add py binding unit tests to coverage 80% (#10043) 2025-09-05 08:40:21 -07:00
Keyang Ru 3f2d0cefcd [router] Add MCP Tool Handler (#9615) 2025-08-27 19:12:39 -07:00
Keyang Ru 5ef545e678 [router] Move all protocols to spec.rs file (#9519) 2025-08-22 14:18:47 -07:00
Keyang RuandYineng Zhang 3828db4309 [router] Add IGW (Inference Gateway) Feature Flag (#9371)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-08-20 17:38:57 -07:00
Keyang Ru f515449582 Fix gpt-oss response api streaming issue (#9368) 2025-08-19 20:19:42 -07:00
Keyang Ru 5ae5ecaa15 [router] Implement OpenAI Responses API specification (#9367) 2025-08-19 20:14:47 -07:00
Keyang Ru c5057262fa [Router] Add validation module for API parameters (#9335) 2025-08-19 13:25:53 -07:00
Keyang Ru ce67b2d586 [router]restructure protocol modules for better organization (#9321) 2025-08-19 01:07:58 +00:00
Keyang Ru 886454e8e7 [MISC] use dynamic choices for tool-call-parser argument (#9316) 2025-08-18 13:02:10 -07:00
Keyang Ruandkey4ng 4093d460ce [CI] migrate router to BM.A10.4 runner (#8992)
Co-authored-by: key4ng <rukeyang@gamil.com>
2025-08-11 22:41:18 -07:00
Keyang Ruandkey4ng 7c9697178e [CI]Add genai-bench Performance Validation for PD Router (#8477)
Co-authored-by: key4ng <rukeyang@gamil.com>
2025-07-28 16:58:23 -07:00
Keyang Ru 29bd4c8135 [CI] Add CI Testing for Prefill-Decode Disaggregation with Router (#7540) 2025-06-27 00:18:56 -07:00
Keyang Ru 5e7fdc79fa [OAI Server Refactor] [ChatCompletions & Completions] Support Return Hidden State (#7329)
Signed-off-by: keru <rukeyang@gmail.com>
2025-06-20 19:18:53 -07:00