Commit Graph
182 Commits
Author SHA1 Message Date
Simo Lin 5354d7b7fd [model-gateway] clean up router manager function order (#13776) 2025-11-22 16:16:20 -08:00
Chang Su 0d2d687812 [router][grpc] Support num_reasoning_tokens in haromy models (#13047) 2025-11-18 16:40:32 -08:00
ybyang 3b18fd4cf5 [router] bindings for go (#13384)
Signed-off-by: ybyang <ybyang7@iflytek.com>
2025-11-16 10:12:10 -08:00
Keyang Ru 401ed0c594 [router] Add comprehensive validation to Responses API (#13127) 2025-11-12 11:19:27 -08:00
4ef4390540 bugfix: multi-model routing for /generate api (#12979)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-11-12 11:13:27 -08:00
Chang Su e5e65e3d2a [router][grpc] Support vllm backend for grpc router (#13120) 2025-11-12 02:29:20 -08:00
d28caaf60a [router] Support complex assistant and tool messages in /chat/completions (#12860)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2025-11-12 00:14:15 -08:00
Ziwen Zhao 7b877ab83d [Router] use call_id instead of id for matching function calls in Responses API for Harmony (#13056) 2025-11-11 17:16:47 -08:00
syy-hw 611a4fd08b [router] bucket policy (#11719) 2025-11-10 02:02:53 -08:00
Chang Su e434187289 [router][grpc] Move all error logs to their call sites (#12859) 2025-11-07 15:55:34 -08:00
Chang Su fe19a580fb [router][grpc] Refactor: Add builders for chat and responses (#12852) 2025-11-07 15:43:32 -08:00
Keyang Ru 5c9273c032 [router] Support structured model output for openai and grpc router (#12431) 2025-11-07 10:16:45 -08:00
Chang Su 837b08eb2e [router][grpc] Support mixin tool calls in Responses API (#12736) 2025-11-05 21:29:45 -08:00
Keyang Ru 74243dffa2 Revert "[router] web_search_preview tool basic implementation" (#12716) 2025-11-05 18:57:39 -08:00
Keyang RuandChang Su 7ef1964a66 [router] add basic ci tests for gpt-oss model support (#12651)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-11-05 15:45:11 -08:00
Keyang Ru b0476a0642 [router][quick fix] Add minimal option for reasoning effort in spec (#12711) 2025-11-05 15:43:19 -08:00
Chang Su ffba61a100 [router][grpc] Make harmony parser checks recipient first before channel (#12713) 2025-11-05 15:33:52 -08:00
Chang Su 4fe53e5888 [router][grpc] Support streaming parsing with Tool Choice in chat completions API (#12677) 2025-11-05 12:12:21 -08:00
Chang Su 9f5e701879 [router][grpc] Implement tool_choice support for Responses API (#12668) 2025-11-04 21:43:42 -08:00
Chang Su 1357ab025a [router][grpc] Emit OutputItemDone event and store output item array (#12656) 2025-11-04 17:01:03 -08:00
Chang Su 887742a1e7 [router][grpc] Fix index issues in reasoning content and missing streaming events (#12650) 2025-11-04 15:38:43 -08:00
Chang Su 0e82fd3df4 [router][grpc] Fix model validation, tool call check, streaming logic and misc in responses (#12616) 2025-11-04 02:21:58 -08:00
Chang Su 83804bc626 [router][grpc] Restructure modules and code clean up (#12598) 2025-11-03 23:59:27 -08:00
Chang Su 0b41a293fa [router][grpc] Consolidate error messages build in error.rs (#12301) 2025-11-03 14:41:45 -08:00
Keyang Ru 96ac24c09e [router] web_search_preview tool basic implementation (#12290) 2025-10-30 14:37:28 -07:00
Keyang Ru 4d2f17bd0b [router] Function call support for openai router Responses API (#12386) 2025-10-30 12:45:10 -07:00
Keyang Ru 69bf801173 [router] Fix safety_identifier missing (#12404) 2025-10-30 10:40:50 -07:00
rongfu.leng 2cf3d0f89f [router] use safety_identifier replace user on chat history storage (#12185) 2025-10-30 08:47:22 -07:00
Simo Lin 700daa3463 [router] harmony responses api streaming support (#12395) 2025-10-30 07:30:48 -07:00
Simo LinandChang Su 03b3e89aea [router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-29 18:52:56 -07:00
Chang Su b48354c537 [router][grpc] Fix inconsistent behavior of conversation_id not found (#12299) 2025-10-28 16:24:43 -07:00
Simo Lin c5642a7a7a [router] use mcp struct from sdk and clean up code across codebase (#12249) 2025-10-28 00:33:10 -07:00
Simo Lin 83b2240074 [router] remove code duplication (#12245) 2025-10-27 23:01:44 -07:00
rongfu.leng 09af0a7b5a [sgl-route] Optimize the use of constant slices and retain to simplif… (#12159)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
2025-10-26 21:14:33 -07:00
Chang Su a124b517f6 [router] Remove SharedXxxStorage type aliases to make Arc explicit (#12171) 2025-10-26 14:48:07 -07:00
Chang Su d05a968ba8 [router][grpc] Add ResponsesContext and fix error propagation in responses api (#12164) 2025-10-26 14:07:19 -07:00
Simo Lin 9e949e5877 [router] centralize mcp tool args handling (#12155) 2025-10-26 01:47:12 -07:00
Chang Su 6dbb569bc3 [router][grpc] Fix tool call id in parse_json_schema_response (#12152) 2025-10-26 01:40:53 -07:00
Simo Lin 212f5e4822 [router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097) 2025-10-25 21:26:28 -07:00
Keyang Ru 4ea42f7cea [router] Refactor data connector architecture with unified storage modules (#12096) 2025-10-24 22:44:34 -07:00
Simo Lin 5983e5bd1b [router] migrate app context to builder pattern 1/n (#12086) 2025-10-24 13:35:22 -07:00
Keyang Ru d7f0d88fa2 [router] implement response api get input item function and refactor input/output store (#11924) 2025-10-24 10:44:21 -07:00
Arthur Cheng 53c2934dce [Router] Consolidate ConnectionMode enum to core module (#11937) 2025-10-23 05:15:49 -07:00
Simo Lin 5dccf69713 [router] create worker removal step and clean up worker manager (#11921) 2025-10-22 13:26:06 -07:00
Keyang Ru 77258ce039 [router] Support multiple worker URLs for OpenAI router (#11723) 2025-10-22 09:27:58 -07:00
Chang Su 590bc4b7a7 [router][grpc] Fix background tasks stored with wrong id (#11945) 2025-10-21 18:38:51 -07:00
Chang Su 70f6309cd4 [router][grpc] Support v1/responses API (#11926) 2025-10-21 17:41:48 -07:00
Keyang Ru 87a92e459a Fix openai input_text type compatibility (#11935) 2025-10-21 16:10:35 -07:00
Chang Su e69094df64 [router][grpc] Remove continue_final_message in ChatTemplateParams and add minijinja-contrib (#11882) 2025-10-20 18:03:09 -07:00
Simo Lin b4948512b8 [router] remove encoding header for oai router (#11881) 2025-10-20 17:39:00 -07:00