Commit Graph
159 Commits
Author SHA1 Message Date
Chang Su 0b41a293fa [router][grpc] Consolidate error messages build in error.rs (#12301) 2025-11-03 14:41:45 -08:00
Keyang Ru 96ac24c09e [router] web_search_preview tool basic implementation (#12290) 2025-10-30 14:37:28 -07:00
Keyang Ru 4d2f17bd0b [router] Function call support for openai router Responses API (#12386) 2025-10-30 12:45:10 -07:00
Keyang Ru 69bf801173 [router] Fix safety_identifier missing (#12404) 2025-10-30 10:40:50 -07:00
rongfu.leng 2cf3d0f89f [router] use safety_identifier replace user on chat history storage (#12185) 2025-10-30 08:47:22 -07:00
Simo Lin 700daa3463 [router] harmony responses api streaming support (#12395) 2025-10-30 07:30:48 -07:00
Simo LinandChang Su 03b3e89aea [router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-29 18:52:56 -07:00
Chang Su b48354c537 [router][grpc] Fix inconsistent behavior of conversation_id not found (#12299) 2025-10-28 16:24:43 -07:00
Simo Lin c5642a7a7a [router] use mcp struct from sdk and clean up code across codebase (#12249) 2025-10-28 00:33:10 -07:00
Simo Lin 83b2240074 [router] remove code duplication (#12245) 2025-10-27 23:01:44 -07:00
rongfu.leng 09af0a7b5a [sgl-route] Optimize the use of constant slices and retain to simplif… (#12159)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
2025-10-26 21:14:33 -07:00
Chang Su a124b517f6 [router] Remove SharedXxxStorage type aliases to make Arc explicit (#12171) 2025-10-26 14:48:07 -07:00
Chang Su d05a968ba8 [router][grpc] Add ResponsesContext and fix error propagation in responses api (#12164) 2025-10-26 14:07:19 -07:00
Simo Lin 9e949e5877 [router] centralize mcp tool args handling (#12155) 2025-10-26 01:47:12 -07:00
Chang Su 6dbb569bc3 [router][grpc] Fix tool call id in parse_json_schema_response (#12152) 2025-10-26 01:40:53 -07:00
Simo Lin 212f5e4822 [router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097) 2025-10-25 21:26:28 -07:00
Keyang Ru 4ea42f7cea [router] Refactor data connector architecture with unified storage modules (#12096) 2025-10-24 22:44:34 -07:00
Simo Lin 5983e5bd1b [router] migrate app context to builder pattern 1/n (#12086) 2025-10-24 13:35:22 -07:00
Keyang Ru d7f0d88fa2 [router] implement response api get input item function and refactor input/output store (#11924) 2025-10-24 10:44:21 -07:00
Arthur Cheng 53c2934dce [Router] Consolidate ConnectionMode enum to core module (#11937) 2025-10-23 05:15:49 -07:00
Simo Lin 5dccf69713 [router] create worker removal step and clean up worker manager (#11921) 2025-10-22 13:26:06 -07:00
Keyang Ru 77258ce039 [router] Support multiple worker URLs for OpenAI router (#11723) 2025-10-22 09:27:58 -07:00
Chang Su 590bc4b7a7 [router][grpc] Fix background tasks stored with wrong id (#11945) 2025-10-21 18:38:51 -07:00
Chang Su 70f6309cd4 [router][grpc] Support v1/responses API (#11926) 2025-10-21 17:41:48 -07:00
Keyang Ru 87a92e459a Fix openai input_text type compatibility (#11935) 2025-10-21 16:10:35 -07:00
Chang Su e69094df64 [router][grpc] Remove continue_final_message in ChatTemplateParams and add minijinja-contrib (#11882) 2025-10-20 18:03:09 -07:00
Simo Lin b4948512b8 [router] remove encoding header for oai router (#11881) 2025-10-20 17:39:00 -07:00
ybyang d513ee93ef [2/2] [feature] support openai like classification api in router (#11670) 2025-10-18 19:31:08 -07:00
Simo Lin a7ae61ed77 [router] Add Configurable L0 and L1 Tokenizer Caching (#11688) 2025-10-18 18:33:53 -07:00
Chang Su ca240eefb4 [router][grpc] Support parallel queue puts in grpc_request_manager and remove mutex for grpc_client (#11798) 2025-10-17 20:49:43 -07:00
Keyang Ru 7780230a15 Revert "[router] fix get_models endpoint for openai router (#11687)" (#11740) 2025-10-16 18:36:53 -07:00
Chang Su dc01313da1 [router] Add rustfmt and set group imports by default (#11732) 2025-10-16 17:33:29 -07:00
Simo Lin 64affab495 [router] fix p and d worker filtering and bootstrap port handling (#11729) 2025-10-16 14:19:39 -07:00
Keyang RuandChang Su 4c9bcb9d56 [Router] Refactor protocol definitions: split spec.rs into modular files (#11677)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-16 13:44:44 -07:00
Keyang Ru 0975ba99bc [router] fix get_models endpoint for openai router (#11687) 2025-10-16 09:00:08 -07:00
Keyang Ruandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> eb8cac6fe2 [router] add py binding and readme for openai router and history backend (#11453)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-10-14 09:42:34 -07:00
Simo Lin 0b9915c132 [router] update generate spec to align with sgl io struct (#11591) 2025-10-14 02:51:33 -04:00
Chang Su 27ef1459e6 [router][protocols] Add Axum validate extractor and use it for /v1/chat/completions endpoint (#11588) 2025-10-13 22:51:15 -07:00
Chang Su 4b694e7d5a [router][grpc] Add error handling to generate_tool_constraints (#11562) 2025-10-13 12:26:09 -07:00
Chang Su 7b59b0b8b0 [router][grpc] Further delegate non-stream processing to processing.rs (#11553) 2025-10-13 10:36:27 -07:00
Keyang Ru 63e84352b7 [router] openai router: support grok model (#11511) 2025-10-12 22:44:43 -04:00
fzyzcjy d957177a22 Super tiny delete unused openai router in sgl-router (#11448) 2025-10-11 15:59:30 +08:00
Chang Su 92777135a0 [router][grpc] Consolidate parser checks for chat completions (#11439) 2025-10-10 20:44:29 -04:00
Simo Lin c495833186 [router] leverage RAII to actively cancel request during client disconnect (#11399) 2025-10-10 20:43:38 -04:00
Keyang Ru eb7d9261c0 [router] conversation item API: create, retrieve and delete (#11369) 2025-10-09 17:43:16 -04:00
Chang Su ab926dd697 [router][grpc] Fix streaming bugs: empty tool names, state pollution, and panics (#11373) 2025-10-09 06:53:23 -04:00
Chang Su a0557642ea [router][lint] Add unused_qualifications to cargo lint warnings (#11366) 2025-10-08 22:17:11 -07:00
Keyang Ru 84768d1017 [router] Refactor OpenAI router: split monolithic file and move location (#11359) 2025-10-09 00:46:39 -04:00
Keyang Ru 7ac6b900f4 [router] Support history management using conversation (#11339) 2025-10-08 15:24:02 -07:00
Chang Su a1080b72a0 [router] Fix all unused_qualifications (#11341) 2025-10-08 13:55:27 -07:00