Commit Graph

379 Commits

Author SHA1 Message Date
Chang Su
9f5e701879 [router][grpc] Implement tool_choice support for Responses API (#12668) 2025-11-04 21:43:42 -08:00
Chang Su
1357ab025a [router][grpc] Emit OutputItemDone event and store output item array (#12656) 2025-11-04 17:01:03 -08:00
Chang Su
887742a1e7 [router][grpc] Fix index issues in reasoning content and missing streaming events (#12650) 2025-11-04 15:38:43 -08:00
Chang Su
0e82fd3df4 [router][grpc] Fix model validation, tool call check, streaming logic and misc in responses (#12616) 2025-11-04 02:21:58 -08:00
fzyzcjy
d84790db39 Support aggregating engine metrics in sgl-router (#11456) 2025-11-04 01:59:50 -08:00
Chang Su
83804bc626 [router][grpc] Restructure modules and code clean up (#12598) 2025-11-03 23:59:27 -08:00
Chang Su
0b41a293fa [router][grpc] Consolidate error messages build in error.rs (#12301) 2025-11-03 14:41:45 -08:00
Keyang Ru
72b5f3d0bb [ci] install released version router (#12410) 2025-10-30 21:59:08 -07:00
Simo Lin
6237754842 [router] 0.2.2 release (#12399) 2025-10-30 14:40:13 -07:00
Keyang Ru
96ac24c09e [router] web_search_preview tool basic implementation (#12290) 2025-10-30 14:37:28 -07:00
Keyang Ru
4d2f17bd0b [router] Function call support for openai router Responses API (#12386) 2025-10-30 12:45:10 -07:00
Keyang Ru
69bf801173 [router] Fix safety_identifier missing (#12404) 2025-10-30 10:40:50 -07:00
rongfu.leng
2cf3d0f89f [router] use safety_identifier replace user on chat history storage (#12185) 2025-10-30 08:47:22 -07:00
Simo Lin
700daa3463 [router] harmony responses api streaming support (#12395) 2025-10-30 07:30:48 -07:00
Simo Lin
03b3e89aea [router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-29 18:52:56 -07:00
Simo Lin
5259becd3c [bug] fix router installation to include additional dependency (#12348) 2025-10-29 12:45:18 -07:00
Chang Su
d717e73ea8 [router] refactor mcp to use LRU and fix pooling bug (#12346) 2025-10-29 12:18:54 -07:00
Simo Lin
b53d9e11c6 [bug] fix router pypi license file (#12345) 2025-10-29 10:05:00 -07:00
Chang Su
400bddf24c [router] fix router release workflow and add build test in PR (#12315) 2025-10-29 08:11:45 -07:00
Feng Su
1e90fe2ed1 [Bug fix] trace: fix import error in mini_lb if sgl-router image does not install sglang (#12338) 2025-10-29 07:45:08 -07:00
Chang Su
b48354c537 [router][grpc] Fix inconsistent behavior of conversation_id not found (#12299) 2025-10-28 16:24:43 -07:00
Simo Lin
84a9d0eab2 [router] support arm, windows, mac, linux, reduce wheel size and number (#12285) 2025-10-28 12:18:51 -07:00
Keyang Ru
737b58d6dc [rust][ci] Add end-to-end tests for Oracle history backend (#12233) 2025-10-28 10:57:32 -07:00
Simo Lin
25e73640f4 [router] upgrade grpc dependency and py 3.13 3.14 support (#12284) 2025-10-28 08:51:32 -07:00
Keyang Ru
9288544180 [router] Fix type unmatch during validation (#12257) 2025-10-28 06:04:54 -07:00
Feng Su
ea96106000 [Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 2 (#10804)
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
2025-10-28 01:25:46 -07:00
Simo Lin
d85d6dba3b [router] configure workflow retries and timeout based on routerConfig (#12252) 2025-10-28 00:41:20 -07:00
Simo Lin
c5642a7a7a [router] use mcp struct from sdk and clean up code across codebase (#12249) 2025-10-28 00:33:10 -07:00
Simo Lin
83b2240074 [router] remove code duplication (#12245) 2025-10-27 23:01:44 -07:00
rongfu.leng
09af0a7b5a [sgl-route] Optimize the use of constant slices and retain to simplif… (#12159)
Signed-off-by: rongfu.leng <lenronfu@gmail.com>
2025-10-26 21:14:33 -07:00
Chang Su
a124b517f6 [router] Remove SharedXxxStorage type aliases to make Arc explicit (#12171) 2025-10-26 14:48:07 -07:00
Chang Su
d05a968ba8 [router][grpc] Add ResponsesContext and fix error propagation in responses api (#12164) 2025-10-26 14:07:19 -07:00
Simo Lin
9e949e5877 [router] centralize mcp tool args handling (#12155) 2025-10-26 01:47:12 -07:00
Chang Su
6dbb569bc3 [router][grpc] Fix tool call id in parse_json_schema_response (#12152) 2025-10-26 01:40:53 -07:00
Chang Su
773d89da8c [router] cleaned up all the redundant comments in the config module (#12147) 2025-10-25 23:10:59 -07:00
Simo Lin
212f5e4822 [router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097) 2025-10-25 21:26:28 -07:00
Keyang Ru
4ea42f7cea [router] Refactor data connector architecture with unified storage modules (#12096) 2025-10-24 22:44:34 -07:00
Chang Su
4463e90dd2 [router][grpc] Remove gpt_oss parsers and remove _parser suffix in tool parser files (#12091) 2025-10-24 15:14:41 -07:00
Simo Lin
229f236da8 [router] migrate app context to builder pattern 2/n (#12089) 2025-10-24 15:04:32 -07:00
Simo Lin
5983e5bd1b [router] migrate app context to builder pattern 1/n (#12086) 2025-10-24 13:35:22 -07:00
Simo Lin
770d63123c [router] fix ut router config init to use build pattern (#12084) 2025-10-24 11:16:31 -07:00
Keyang Ru
d7f0d88fa2 [router] implement response api get input item function and refactor input/output store (#11924) 2025-10-24 10:44:21 -07:00
Simo Lin
dbf17a8313 [router] Add mTLS Support for Router-to-Worker Communication (#12019)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-23 23:14:09 -07:00
Simo Lin
6d6e24bcc4 [router] Add builder pattern for RouterConfig with zero duplication (#12030) 2025-10-23 16:46:10 -07:00
Chang Su
28b8a4064d [router][CI] Clean up imports and prints statements in sgl-router/py_test (#12024) 2025-10-23 11:56:57 -07:00
Simo Lin
a4b637d87a [router] change ci names and update log level in ci (#12021) 2025-10-23 10:36:19 -07:00
Arthur Cheng
53c2934dce [Router] Consolidate ConnectionMode enum to core module (#11937) 2025-10-23 05:15:49 -07:00
Keyang Ru
e321c97113 [router] Add comprehensive E2E tests for Response API (#11988) 2025-10-23 05:13:51 -07:00
Simo Lin
5dccf69713 [router] create worker removal step and clean up worker manager (#11921) 2025-10-22 13:26:06 -07:00
Keyang Ru
77258ce039 [router] Support multiple worker URLs for OpenAI router (#11723) 2025-10-22 09:27:58 -07:00