Commit Graph
27 Commits
Author SHA1 Message Date
Simo Lin 51a86ce69e [model-gateway] change rust package name to sgl-model-gateway instead (#14283) 2025-12-02 00:06:54 -08:00
Keyang Ru 5c9273c032 [router] Support structured model output for openai and grpc router (#12431) 2025-11-07 10:16:45 -08:00
Simo LinandChang Su 03b3e89aea [router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-29 18:52:56 -07:00
Simo Lin 212f5e4822 [router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097) 2025-10-25 21:26:28 -07:00
Simo Lin 6d6e24bcc4 [router] Add builder pattern for RouterConfig with zero duplication (#12030) 2025-10-23 16:46:10 -07:00
Arthur Cheng 53c2934dce [Router] Consolidate ConnectionMode enum to core module (#11937) 2025-10-23 05:15:49 -07:00
Keyang Ru 77258ce039 [router] Support multiple worker URLs for OpenAI router (#11723) 2025-10-22 09:27:58 -07:00
ybyang d513ee93ef [2/2] [feature] support openai like classification api in router (#11670) 2025-10-18 19:31:08 -07:00
Simo Lin a7ae61ed77 [router] Add Configurable L0 and L1 Tokenizer Caching (#11688) 2025-10-18 18:33:53 -07:00
Chang Su dc01313da1 [router] Add rustfmt and set group imports by default (#11732) 2025-10-16 17:33:29 -07:00
Keyang RuandChang Su 4c9bcb9d56 [Router] Refactor protocol definitions: split spec.rs into modular files (#11677)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-16 13:44:44 -07:00
Keyang Ru d2478cd4ff [router] Fix response api related spec (#11621) 2025-10-15 09:59:38 -07:00
Simo Lin 3962e39d7c [router] cleanup app context and move to startup (#11617) 2025-10-14 10:19:28 -07:00
Simo Lin 728af88781 [router] allow user to specify chat template path (#11549) 2025-10-13 10:47:57 -07:00
Keyang Ru 63e84352b7 [router] openai router: support grok model (#11511) 2025-10-12 22:44:43 -04:00
Keyang Ru eb7d9261c0 [router] conversation item API: create, retrieve and delete (#11369) 2025-10-09 17:43:16 -04:00
Chang Su a0557642ea [router][lint] Add unused_qualifications to cargo lint warnings (#11366) 2025-10-08 22:17:11 -07:00
Keyang Ru 7ac6b900f4 [router] Support history management using conversation (#11339) 2025-10-08 15:24:02 -07:00
Keyang Ru 4ed67c27e3 [router] support Openai router conversation API CRUD (#11297) 2025-10-07 15:31:35 -07:00
Simo Lin 79d3495177 [router] add reasoning and tool parser argument in router (#11290) 2025-10-07 09:08:32 -04:00
Keyang Ru 34151f173b [router] Steaming support for MCP Tool Calls in OpenAI Router (#11173) 2025-10-03 00:19:43 -07:00
Keyang Ru a28b394fba [router] Add multi-turn tool calling loop support for MCP integration (#11143) 2025-10-01 12:50:21 -07:00
Keyang Ru 7fb551a75d [router] add mcp list and mcp call in output array (#11112) 2025-09-30 21:41:54 -04:00
Keyang Ru 72392f2908 [router] basic mcp support for openai router response api (#10978) 2025-09-27 21:49:33 -04:00
Simo Lin aae7ead2d0 [router] remove old/oudated/useless comments across code base (#10968) 2025-09-26 10:48:50 -07:00
Keyang Ru 5ef545e678 [router] Move all protocols to spec.rs file (#9519) 2025-08-22 14:18:47 -07:00
Keyang Ru 5ae5ecaa15 [router] Implement OpenAI Responses API specification (#9367) 2025-08-19 20:14:47 -07:00