Commit Graph

418 Commits

Author SHA1 Message Date
Simo Lin
37c8761567 [model-gateway] remove grpc feature flag and mark as default (#13330) 2025-11-15 03:16:57 -08:00
Xinyue Zhang
4a10e37ba7 [router] Fix flaky router e2e tests (#13306) 2025-11-15 02:00:25 -08:00
Simo Lin
b732ffa404 [model-gateway] move python to binding folder (#13295) 2025-11-15 00:32:21 -08:00
Simo Lin
172c71a23d [model-gateway] smg release 0.2.3 (#13312) 2025-11-14 19:04:20 -08:00
Xinyue Zhang
14dc052382 [router]Replace requests lib with openai in e2e_response_api (#13293) 2025-11-14 16:56:40 -08:00
fzyzcjy
1f134f850a fix outdated router doc (#13255) 2025-11-14 14:00:42 +09:00
Chang Su
c9e5799bd1 [router][grpc] Refine docs in minimax_m2 to match other parsers (#13218) 2025-11-14 06:47:24 +09:00
Edmund Suen
c2d69e8b56 fix: display served_model_name in /v1/models (#13155) 2025-11-13 17:07:55 +09:00
Simo Lin
4c1e909a80 [router] minmax-m2 xml tool parser (#13148) 2025-11-12 23:24:54 -08:00
Simo Lin
6d21392b0e [router] remove worker url requirement (#13172) 2025-11-12 17:32:58 -08:00
Xinyue Zhang
2cdde3d46d [router] Fix Flaky test_circuit_breaker_opens_and_recovers (#13164) 2025-11-12 12:07:42 -08:00
Keyang Ru
401ed0c594 [router] Add comprehensive validation to Responses API (#13127) 2025-11-12 11:19:27 -08:00
Siyuan Chen
4ef4390540 bugfix: multi-model routing for /generate api (#12979)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-11-12 11:13:27 -08:00
Chang Su
e5e65e3d2a [router][grpc] Support vllm backend for grpc router (#13120) 2025-11-12 02:29:20 -08:00
Simo Lin
3cdec20c6b [router] add minmax m2 reasoning parser (#13137) 2025-11-12 18:27:05 +09:00
Danylo Vashchilenko
d28caaf60a [router] Support complex assistant and tool messages in /chat/completions (#12860)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2025-11-12 00:14:15 -08:00
Simo Lin
ae68158f2e [router] move radix tree to policy crate and addreses some code styles (#13131) 2025-11-11 23:36:04 -08:00
Ziwen Zhao
7b877ab83d [Router] use call_id instead of id for matching function calls in Responses API for Harmony (#13056) 2025-11-11 17:16:47 -08:00
Chang Su
2ca25a8aab Revert "fix: display served_model_name in /v1/models" (#13093) 2025-11-11 15:58:46 -08:00
Edmund Suen
a06c44f905 fix: display served_model_name in /v1/models (#13063) 2025-11-12 00:13:58 +08:00
rongfu.leng
2fe4e69fca [router] add postgres databases data connector (#12218) 2025-11-10 16:51:50 -08:00
Keyang Ru
0493775b06 [router][ci] Quick Improvement to make CI more stable (#12869) 2025-11-10 13:56:35 -08:00
Keyang Ru
9840bf4f84 [router][ci] Fix maturin build (#13012) 2025-11-10 12:33:32 -08:00
syy-hw
611a4fd08b [router] bucket policy (#11719) 2025-11-10 02:02:53 -08:00
Keyang Ru
d3d7f960b5 [router] Switch MCP tests from DeepWiki to self-hosted Brave search server (#12849) 2025-11-07 16:16:07 -08:00
Chang Su
e434187289 [router][grpc] Move all error logs to their call sites (#12859) 2025-11-07 15:55:34 -08:00
Chang Su
fe19a580fb [router][grpc] Refactor: Add builders for chat and responses (#12852) 2025-11-07 15:43:32 -08:00
Keyang Ru
5c9273c032 [router] Support structured model output for openai and grpc router (#12431) 2025-11-07 10:16:45 -08:00
Chang Su
2cb42dc184 [router][grpc] Add more mcp test cases to responses api (#12749) 2025-11-06 10:20:00 -08:00
Keyang Ru
8be0e1bc9c fix ci (#12760) 2025-11-06 00:21:11 -08:00
Keyang Ru
74630ba310 [router][ci] Disable cache (#12752) 2025-11-05 22:49:03 -08:00
Chang Su
837b08eb2e [router][grpc] Support mixin tool calls in Responses API (#12736) 2025-11-05 21:29:45 -08:00
Keyang Ru
74243dffa2 Revert "[router] web_search_preview tool basic implementation" (#12716) 2025-11-05 18:57:39 -08:00
Keyang Ru
7ef1964a66 [router] add basic ci tests for gpt-oss model support (#12651)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-11-05 15:45:11 -08:00
Keyang Ru
b0476a0642 [router][quick fix] Add minimal option for reasoning effort in spec (#12711) 2025-11-05 15:43:19 -08:00
Chang Su
ffba61a100 [router][grpc] Make harmony parser checks recipient first before channel (#12713) 2025-11-05 15:33:52 -08:00
Keyang Ru
80802c4cc6 [router][ci] speed up python binding to 1.5 min (#12673) 2025-11-05 14:52:33 -08:00
wyx
3651cfbf62 [router] fix: validate HTTP status codes in health check (#12631) 2025-11-05 13:37:17 -08:00
Chang Su
4fe53e5888 [router][grpc] Support streaming parsing with Tool Choice in chat completions API (#12677) 2025-11-05 12:12:21 -08:00
Chang Su
9f5e701879 [router][grpc] Implement tool_choice support for Responses API (#12668) 2025-11-04 21:43:42 -08:00
Chang Su
1357ab025a [router][grpc] Emit OutputItemDone event and store output item array (#12656) 2025-11-04 17:01:03 -08:00
Chang Su
887742a1e7 [router][grpc] Fix index issues in reasoning content and missing streaming events (#12650) 2025-11-04 15:38:43 -08:00
Chang Su
0e82fd3df4 [router][grpc] Fix model validation, tool call check, streaming logic and misc in responses (#12616) 2025-11-04 02:21:58 -08:00
fzyzcjy
d84790db39 Support aggregating engine metrics in sgl-router (#11456) 2025-11-04 01:59:50 -08:00
Chang Su
83804bc626 [router][grpc] Restructure modules and code clean up (#12598) 2025-11-03 23:59:27 -08:00
Chang Su
0b41a293fa [router][grpc] Consolidate error messages build in error.rs (#12301) 2025-11-03 14:41:45 -08:00
Keyang Ru
72b5f3d0bb [ci] install released version router (#12410) 2025-10-30 21:59:08 -07:00
Simo Lin
6237754842 [router] 0.2.2 release (#12399) 2025-10-30 14:40:13 -07:00
Keyang Ru
96ac24c09e [router] web_search_preview tool basic implementation (#12290) 2025-10-30 14:37:28 -07:00
Keyang Ru
4d2f17bd0b [router] Function call support for openai router Responses API (#12386) 2025-10-30 12:45:10 -07:00