Commit Graph

137 Commits

Author SHA1 Message Date
Simo Lin
4c1e909a80 [router] minmax-m2 xml tool parser (#13148) 2025-11-12 23:24:54 -08:00
Keyang Ru
401ed0c594 [router] Add comprehensive validation to Responses API (#13127) 2025-11-12 11:19:27 -08:00
Siyuan Chen
4ef4390540 bugfix: multi-model routing for /generate api (#12979)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-11-12 11:13:27 -08:00
Chang Su
e5e65e3d2a [router][grpc] Support vllm backend for grpc router (#13120) 2025-11-12 02:29:20 -08:00
Danylo Vashchilenko
d28caaf60a [router] Support complex assistant and tool messages in /chat/completions (#12860)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2025-11-12 00:14:15 -08:00
syy-hw
611a4fd08b [router] bucket policy (#11719) 2025-11-10 02:02:53 -08:00
Keyang Ru
5c9273c032 [router] Support structured model output for openai and grpc router (#12431) 2025-11-07 10:16:45 -08:00
Chang Su
4fe53e5888 [router][grpc] Support streaming parsing with Tool Choice in chat completions API (#12677) 2025-11-05 12:12:21 -08:00
Chang Su
9f5e701879 [router][grpc] Implement tool_choice support for Responses API (#12668) 2025-11-04 21:43:42 -08:00
fzyzcjy
d84790db39 Support aggregating engine metrics in sgl-router (#11456) 2025-11-04 01:59:50 -08:00
Chang Su
83804bc626 [router][grpc] Restructure modules and code clean up (#12598) 2025-11-03 23:59:27 -08:00
rongfu.leng
2cf3d0f89f [router] use safety_identifier replace user on chat history storage (#12185) 2025-10-30 08:47:22 -07:00
Simo Lin
03b3e89aea [router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-29 18:52:56 -07:00
Chang Su
b48354c537 [router][grpc] Fix inconsistent behavior of conversation_id not found (#12299) 2025-10-28 16:24:43 -07:00
Simo Lin
d85d6dba3b [router] configure workflow retries and timeout based on routerConfig (#12252) 2025-10-28 00:41:20 -07:00
Simo Lin
c5642a7a7a [router] use mcp struct from sdk and clean up code across codebase (#12249) 2025-10-28 00:33:10 -07:00
Simo Lin
212f5e4822 [router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097) 2025-10-25 21:26:28 -07:00
Chang Su
4463e90dd2 [router][grpc] Remove gpt_oss parsers and remove _parser suffix in tool parser files (#12091) 2025-10-24 15:14:41 -07:00
Simo Lin
5983e5bd1b [router] migrate app context to builder pattern 1/n (#12086) 2025-10-24 13:35:22 -07:00
Simo Lin
770d63123c [router] fix ut router config init to use build pattern (#12084) 2025-10-24 11:16:31 -07:00
Keyang Ru
d7f0d88fa2 [router] implement response api get input item function and refactor input/output store (#11924) 2025-10-24 10:44:21 -07:00
Simo Lin
6d6e24bcc4 [router] Add builder pattern for RouterConfig with zero duplication (#12030) 2025-10-23 16:46:10 -07:00
Arthur Cheng
53c2934dce [Router] Consolidate ConnectionMode enum to core module (#11937) 2025-10-23 05:15:49 -07:00
Simo Lin
5dccf69713 [router] create worker removal step and clean up worker manager (#11921) 2025-10-22 13:26:06 -07:00
Keyang Ru
77258ce039 [router] Support multiple worker URLs for OpenAI router (#11723) 2025-10-22 09:27:58 -07:00
Tien Nguyen
28ddfb37d7 fix(sql-router): fix conflict port in test (#11826)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2025-10-20 18:06:34 -07:00
Simo Lin
ddcba74b4d [router] Worker Management Workflow Engine (#11868) 2025-10-20 17:00:22 -07:00
ybyang
d513ee93ef [2/2] [feature] support openai like classification api in router (#11670) 2025-10-18 19:31:08 -07:00
Simo Lin
a7ae61ed77 [router] Add Configurable L0 and L1 Tokenizer Caching (#11688) 2025-10-18 18:33:53 -07:00
Keyang Ru
7780230a15 Revert "[router] fix get_models endpoint for openai router (#11687)" (#11740) 2025-10-16 18:36:53 -07:00
Chang Su
dc01313da1 [router] Add rustfmt and set group imports by default (#11732) 2025-10-16 17:33:29 -07:00
Keyang Ru
7a7f99beb7 [router] add spec.rs to enables tests under spec folder (#11734) 2025-10-16 16:07:26 -07:00
Chang Su
c7962868c1 [router] Fix tool_choice normalization in ChatCompletionRequest and fix ut (#11731) 2025-10-16 14:20:13 -07:00
Keyang Ru
4c9bcb9d56 [Router] Refactor protocol definitions: split spec.rs into modular files (#11677)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-16 13:44:44 -07:00
Keyang Ru
0975ba99bc [router] fix get_models endpoint for openai router (#11687) 2025-10-16 09:00:08 -07:00
Keyang Ru
d2478cd4ff [router] Fix response api related spec (#11621) 2025-10-15 09:59:38 -07:00
Simo Lin
3962e39d7c [router] cleanup app context and move to startup (#11617) 2025-10-14 10:19:28 -07:00
Simo Lin
0b9915c132 [router] update generate spec to align with sgl io struct (#11591) 2025-10-14 02:51:33 -04:00
Chang Su
27ef1459e6 [router][protocols] Add Axum validate extractor and use it for /v1/chat/completions endpoint (#11588) 2025-10-13 22:51:15 -07:00
Simo Lin
728af88781 [router] allow user to specify chat template path (#11549) 2025-10-13 10:47:57 -07:00
Keyang Ru
63e84352b7 [router] openai router: support grok model (#11511) 2025-10-12 22:44:43 -04:00
Keyang Ru
eb7d9261c0 [router] conversation item API: create, retrieve and delete (#11369) 2025-10-09 17:43:16 -04:00
Chang Su
ab926dd697 [router][grpc] Fix streaming bugs: empty tool names, state pollution, and panics (#11373) 2025-10-09 06:53:23 -04:00
Chang Su
a0557642ea [router][lint] Add unused_qualifications to cargo lint warnings (#11366) 2025-10-08 22:17:11 -07:00
Keyang Ru
84768d1017 [router] Refactor OpenAI router: split monolithic file and move location (#11359) 2025-10-09 00:46:39 -04:00
Chang Su
fccac7d126 [router][grpc] Add dependencies in Cargo.toml to support chat template rendering (#11342) 2025-10-08 15:38:37 -07:00
Keyang Ru
7ac6b900f4 [router] Support history management using conversation (#11339) 2025-10-08 15:24:02 -07:00
Keyang Ru
4ed67c27e3 [router] support Openai router conversation API CRUD (#11297) 2025-10-07 15:31:35 -07:00
Chang Su
64582caa84 [router][grpc] Refactor chat template content format detection (#11288) 2025-10-07 08:38:51 -07:00
Simo Lin
79d3495177 [router] add reasoning and tool parser argument in router (#11290) 2025-10-07 09:08:32 -04:00