Keyang Ru
|
401ed0c594
|
[router] Add comprehensive validation to Responses API (#13127)
|
2025-11-12 11:19:27 -08:00 |
|
Keyang Ru
|
0493775b06
|
[router][ci] Quick Improvement to make CI more stable (#12869)
|
2025-11-10 13:56:35 -08:00 |
|
Keyang Ru
|
9840bf4f84
|
[router][ci] Fix maturin build (#13012)
|
2025-11-10 12:33:32 -08:00 |
|
Keyang Ru
|
d3d7f960b5
|
[router] Switch MCP tests from DeepWiki to self-hosted Brave search server (#12849)
|
2025-11-07 16:16:07 -08:00 |
|
Keyang Ru
|
5c9273c032
|
[router] Support structured model output for openai and grpc router (#12431)
|
2025-11-07 10:16:45 -08:00 |
|
Keyang Ru
|
8be0e1bc9c
|
fix ci (#12760)
|
2025-11-06 00:21:11 -08:00 |
|
Keyang Ru
|
74630ba310
|
[router][ci] Disable cache (#12752)
|
2025-11-05 22:49:03 -08:00 |
|
Keyang Ru
|
74243dffa2
|
Revert "[router] web_search_preview tool basic implementation" (#12716)
|
2025-11-05 18:57:39 -08:00 |
|
Keyang Ru
|
4ea4c48bb0
|
Revert "[ci] fix permission" (#12732)
|
2025-11-05 18:26:29 -08:00 |
|
Keyang Ru
|
a5affb0caf
|
[ci] fix permission (#12729)
|
2025-11-05 17:43:48 -08:00 |
|
Keyang Ru
|
5925d3d719
|
fix labeler (#12718)
|
2025-11-05 17:34:56 -08:00 |
|
 Keyang RuandChang Su
|
7ef1964a66
|
[router] add basic ci tests for gpt-oss model support (#12651)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-11-05 15:45:11 -08:00 |
|
Keyang Ru
|
b0476a0642
|
[router][quick fix] Add minimal option for reasoning effort in spec (#12711)
|
2025-11-05 15:43:19 -08:00 |
|
Keyang Ru
|
80802c4cc6
|
[router][ci] speed up python binding to 1.5 min (#12673)
|
2025-11-05 14:52:33 -08:00 |
|
Keyang Ru
|
72b5f3d0bb
|
[ci] install released version router (#12410)
|
2025-10-30 21:59:08 -07:00 |
|
Keyang Ru
|
96ac24c09e
|
[router] web_search_preview tool basic implementation (#12290)
|
2025-10-30 14:37:28 -07:00 |
|
Keyang Ru
|
4d2f17bd0b
|
[router] Function call support for openai router Responses API (#12386)
|
2025-10-30 12:45:10 -07:00 |
|
Keyang Ru
|
69bf801173
|
[router] Fix safety_identifier missing (#12404)
|
2025-10-30 10:40:50 -07:00 |
|
Keyang Ru
|
737b58d6dc
|
[rust][ci] Add end-to-end tests for Oracle history backend (#12233)
|
2025-10-28 10:57:32 -07:00 |
|
Keyang Ru
|
9288544180
|
[router] Fix type unmatch during validation (#12257)
|
2025-10-28 06:04:54 -07:00 |
|
Keyang Ru
|
4ea42f7cea
|
[router] Refactor data connector architecture with unified storage modules (#12096)
|
2025-10-24 22:44:34 -07:00 |
|
Keyang Ru
|
d7f0d88fa2
|
[router] implement response api get input item function and refactor input/output store (#11924)
|
2025-10-24 10:44:21 -07:00 |
|
Keyang Ru
|
e321c97113
|
[router] Add comprehensive E2E tests for Response API (#11988)
|
2025-10-23 05:13:51 -07:00 |
|
Keyang Ru
|
77258ce039
|
[router] Support multiple worker URLs for OpenAI router (#11723)
|
2025-10-22 09:27:58 -07:00 |
|
Keyang Ru
|
63cfe1b032
|
[router] Add gRPC E2E test suite (#11790)
|
2025-10-21 17:51:21 -07:00 |
|
Keyang Ru
|
87a92e459a
|
Fix openai input_text type compatibility (#11935)
|
2025-10-21 16:10:35 -07:00 |
|
Keyang Ru
|
2bc3fcd420
|
[doc] update router document (#11767)
|
2025-10-17 10:26:54 -07:00 |
|
Keyang Ru
|
7780230a15
|
Revert "[router] fix get_models endpoint for openai router (#11687)" (#11740)
|
2025-10-16 18:36:53 -07:00 |
|
Keyang Ru
|
7a7f99beb7
|
[router] add spec.rs to enables tests under spec folder (#11734)
|
2025-10-16 16:07:26 -07:00 |
|
 Keyang RuandChang Su
|
4c9bcb9d56
|
[Router] Refactor protocol definitions: split spec.rs into modular files (#11677)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-10-16 13:44:44 -07:00 |
|
Keyang Ru
|
0975ba99bc
|
[router] fix get_models endpoint for openai router (#11687)
|
2025-10-16 09:00:08 -07:00 |
|
Keyang Ru
|
d2478cd4ff
|
[router] Fix response api related spec (#11621)
|
2025-10-15 09:59:38 -07:00 |
|
![gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>](/assets/img/avatar_default.png) Keyang Ruandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
eb8cac6fe2
|
[router] add py binding and readme for openai router and history backend (#11453)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-10-14 09:42:34 -07:00 |
|
Keyang Ru
|
63e84352b7
|
[router] openai router: support grok model (#11511)
|
2025-10-12 22:44:43 -04:00 |
|
Keyang Ru
|
a0835c3a62
|
[router] Fix ci nvcc not found error (#11411)
|
2025-10-10 15:43:16 -07:00 |
|
Keyang Ru
|
eb7d9261c0
|
[router] conversation item API: create, retrieve and delete (#11369)
|
2025-10-09 17:43:16 -04:00 |
|
Keyang Ru
|
84768d1017
|
[router] Refactor OpenAI router: split monolithic file and move location (#11359)
|
2025-10-09 00:46:39 -04:00 |
|
Keyang Ru
|
7ac6b900f4
|
[router] Support history management using conversation (#11339)
|
2025-10-08 15:24:02 -07:00 |
|
Keyang Ru
|
4ed67c27e3
|
[router] support Openai router conversation API CRUD (#11297)
|
2025-10-07 15:31:35 -07:00 |
|
Keyang Ru
|
34151f173b
|
[router] Steaming support for MCP Tool Calls in OpenAI Router (#11173)
|
2025-10-03 00:19:43 -07:00 |
|
Keyang Ru
|
a28b394fba
|
[router] Add multi-turn tool calling loop support for MCP integration (#11143)
|
2025-10-01 12:50:21 -07:00 |
|
Keyang Ru
|
7fb551a75d
|
[router] add mcp list and mcp call in output array (#11112)
|
2025-09-30 21:41:54 -04:00 |
|
Keyang Ru
|
72392f2908
|
[router] basic mcp support for openai router response api (#10978)
|
2025-09-27 21:49:33 -04:00 |
|
Keyang Ru
|
a73eb8cd20
|
[router] Support Oracle DB(ATP) Data Connector (#10845)
|
2025-09-24 23:59:32 -04:00 |
|
Keyang Ru
|
f4e3ebeb05
|
[router] Support streaming for Openai Router Response api (#10822)
|
2025-09-23 14:56:28 -07:00 |
|
Keyang Ru
|
366043db8e
|
[router] Add get and cancel method for response api (#10387)
|
2025-09-12 16:19:38 -07:00 |
|
Keyang Ru
|
a23bdeaf04
|
[router] Basic OAI Response api (#10346)
|
2025-09-11 20:56:17 -07:00 |
|
Keyang Ru
|
7b141f816c
|
[router][ci] Add gpu utilization analyze with nvml (#10345)
|
2025-09-11 19:26:02 -07:00 |
|
Keyang Ru
|
1ee11df8ac
|
[router][ci] add gpu process check and free port before start server (#10338)
|
2025-09-11 14:24:16 -07:00 |
|
Keyang Ru
|
dee197e11b
|
[router] Add OpenAI backend support - core function (#10254)
|
2025-09-11 14:13:51 -07:00 |
|
Keyang Ru
|
480d1b8b20
|
[router] add benchmark for regular router and pd router (#10280)
|
2025-09-11 12:04:11 -07:00 |
|
Keyang Ru
|
cda7e47ce7
|
[router] Add PD router mmlu test (#10256)
|
2025-09-10 08:47:24 -07:00 |
|
Keyang Ru
|
718f25ae6e
|
Explicitly export CMAKE_BUILD_PARALLEL_LEVEL (#10193)
|
2025-09-08 22:35:27 -07:00 |
|
Keyang Ru
|
9eb50ecc9c
|
[router] Improve the router e2e tests (#10102)
|
2025-09-06 16:19:28 -07:00 |
|
Keyang Ru
|
b3e7a2cee4
|
increase the rust e2e timeout (#10116)
|
2025-09-06 16:17:34 -07:00 |
|
Keyang Ru
|
21b9a4b435
|
[router] Introduce router integration tests (#10086)
|
2025-09-05 18:52:53 -07:00 |
|
Keyang Ru
|
4f0e28d7fc
|
[router] add rust cache for rust unit test (#10079)
|
2025-09-05 09:58:59 -07:00 |
|
Keyang Ru
|
045ab92dc0
|
[router] add py binding unit tests to coverage 80% (#10043)
|
2025-09-05 08:40:21 -07:00 |
|
Keyang Ru
|
3f2d0cefcd
|
[router] Add MCP Tool Handler (#9615)
|
2025-08-27 19:12:39 -07:00 |
|
Keyang Ru
|
5ef545e678
|
[router] Move all protocols to spec.rs file (#9519)
|
2025-08-22 14:18:47 -07:00 |
|
 Keyang RuandYineng Zhang
|
3828db4309
|
[router] Add IGW (Inference Gateway) Feature Flag (#9371)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-08-20 17:38:57 -07:00 |
|
Keyang Ru
|
f515449582
|
Fix gpt-oss response api streaming issue (#9368)
|
2025-08-19 20:19:42 -07:00 |
|
Keyang Ru
|
5ae5ecaa15
|
[router] Implement OpenAI Responses API specification (#9367)
|
2025-08-19 20:14:47 -07:00 |
|
Keyang Ru
|
c5057262fa
|
[Router] Add validation module for API parameters (#9335)
|
2025-08-19 13:25:53 -07:00 |
|
Keyang Ru
|
ce67b2d586
|
[router]restructure protocol modules for better organization (#9321)
|
2025-08-19 01:07:58 +00:00 |
|
Keyang Ru
|
886454e8e7
|
[MISC] use dynamic choices for tool-call-parser argument (#9316)
|
2025-08-18 13:02:10 -07:00 |
|
 Keyang Ruandkey4ng
|
4093d460ce
|
[CI] migrate router to BM.A10.4 runner (#8992)
Co-authored-by: key4ng <rukeyang@gamil.com>
|
2025-08-11 22:41:18 -07:00 |
|
 Keyang Ruandkey4ng
|
7c9697178e
|
[CI]Add genai-bench Performance Validation for PD Router (#8477)
Co-authored-by: key4ng <rukeyang@gamil.com>
|
2025-07-28 16:58:23 -07:00 |
|
Keyang Ru
|
29bd4c8135
|
[CI] Add CI Testing for Prefill-Decode Disaggregation with Router (#7540)
|
2025-06-27 00:18:56 -07:00 |
|
Keyang Ru
|
5e7fdc79fa
|
[OAI Server Refactor] [ChatCompletions & Completions] Support Return Hidden State (#7329)
Signed-off-by: keru <rukeyang@gmail.com>
|
2025-06-20 19:18:53 -07:00 |
|