Lianmin Zheng
|
bc3d2a85af
|
[Minor] update docs (#14212)
|
2025-12-01 02:33:58 -08:00 |
|
Chang Su
|
66f242b98f
|
[model gateway][grpc] Add tojson filter to override minijinja's tojson (#14013)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-11-26 11:05:01 -08:00 |
|
Simo Lin
|
4c1e909a80
|
[router] minmax-m2 xml tool parser (#13148)
|
2025-11-12 23:24:54 -08:00 |
|
Keyang Ru
|
401ed0c594
|
[router] Add comprehensive validation to Responses API (#13127)
|
2025-11-12 11:19:27 -08:00 |
|
Siyuan Chen
|
4ef4390540
|
bugfix: multi-model routing for /generate api (#12979)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-11-12 11:13:27 -08:00 |
|
Chang Su
|
e5e65e3d2a
|
[router][grpc] Support vllm backend for grpc router (#13120)
|
2025-11-12 02:29:20 -08:00 |
|
Danylo Vashchilenko
|
d28caaf60a
|
[router] Support complex assistant and tool messages in /chat/completions (#12860)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-11-12 00:14:15 -08:00 |
|
syy-hw
|
611a4fd08b
|
[router] bucket policy (#11719)
|
2025-11-10 02:02:53 -08:00 |
|
Keyang Ru
|
5c9273c032
|
[router] Support structured model output for openai and grpc router (#12431)
|
2025-11-07 10:16:45 -08:00 |
|
Chang Su
|
4fe53e5888
|
[router][grpc] Support streaming parsing with Tool Choice in chat completions API (#12677)
|
2025-11-05 12:12:21 -08:00 |
|
Chang Su
|
9f5e701879
|
[router][grpc] Implement tool_choice support for Responses API (#12668)
|
2025-11-04 21:43:42 -08:00 |
|
fzyzcjy
|
d84790db39
|
Support aggregating engine metrics in sgl-router (#11456)
|
2025-11-04 01:59:50 -08:00 |
|
Chang Su
|
83804bc626
|
[router][grpc] Restructure modules and code clean up (#12598)
|
2025-11-03 23:59:27 -08:00 |
|
rongfu.leng
|
2cf3d0f89f
|
[router] use safety_identifier replace user on chat history storage (#12185)
|
2025-10-30 08:47:22 -07:00 |
|
Simo Lin
|
03b3e89aea
|
[router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-10-29 18:52:56 -07:00 |
|
Chang Su
|
b48354c537
|
[router][grpc] Fix inconsistent behavior of conversation_id not found (#12299)
|
2025-10-28 16:24:43 -07:00 |
|
Simo Lin
|
d85d6dba3b
|
[router] configure workflow retries and timeout based on routerConfig (#12252)
|
2025-10-28 00:41:20 -07:00 |
|
Simo Lin
|
c5642a7a7a
|
[router] use mcp struct from sdk and clean up code across codebase (#12249)
|
2025-10-28 00:33:10 -07:00 |
|
Simo Lin
|
212f5e4822
|
[router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097)
|
2025-10-25 21:26:28 -07:00 |
|
Chang Su
|
4463e90dd2
|
[router][grpc] Remove gpt_oss parsers and remove _parser suffix in tool parser files (#12091)
|
2025-10-24 15:14:41 -07:00 |
|
Simo Lin
|
5983e5bd1b
|
[router] migrate app context to builder pattern 1/n (#12086)
|
2025-10-24 13:35:22 -07:00 |
|
Simo Lin
|
770d63123c
|
[router] fix ut router config init to use build pattern (#12084)
|
2025-10-24 11:16:31 -07:00 |
|
Keyang Ru
|
d7f0d88fa2
|
[router] implement response api get input item function and refactor input/output store (#11924)
|
2025-10-24 10:44:21 -07:00 |
|
Simo Lin
|
6d6e24bcc4
|
[router] Add builder pattern for RouterConfig with zero duplication (#12030)
|
2025-10-23 16:46:10 -07:00 |
|
Arthur Cheng
|
53c2934dce
|
[Router] Consolidate ConnectionMode enum to core module (#11937)
|
2025-10-23 05:15:49 -07:00 |
|
Simo Lin
|
5dccf69713
|
[router] create worker removal step and clean up worker manager (#11921)
|
2025-10-22 13:26:06 -07:00 |
|
Keyang Ru
|
77258ce039
|
[router] Support multiple worker URLs for OpenAI router (#11723)
|
2025-10-22 09:27:58 -07:00 |
|
Tien Nguyen
|
28ddfb37d7
|
fix(sql-router): fix conflict port in test (#11826)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-10-20 18:06:34 -07:00 |
|
Simo Lin
|
ddcba74b4d
|
[router] Worker Management Workflow Engine (#11868)
|
2025-10-20 17:00:22 -07:00 |
|
ybyang
|
d513ee93ef
|
[2/2] [feature] support openai like classification api in router (#11670)
|
2025-10-18 19:31:08 -07:00 |
|
Simo Lin
|
a7ae61ed77
|
[router] Add Configurable L0 and L1 Tokenizer Caching (#11688)
|
2025-10-18 18:33:53 -07:00 |
|
Keyang Ru
|
7780230a15
|
Revert "[router] fix get_models endpoint for openai router (#11687)" (#11740)
|
2025-10-16 18:36:53 -07:00 |
|
Chang Su
|
dc01313da1
|
[router] Add rustfmt and set group imports by default (#11732)
|
2025-10-16 17:33:29 -07:00 |
|
Keyang Ru
|
7a7f99beb7
|
[router] add spec.rs to enables tests under spec folder (#11734)
|
2025-10-16 16:07:26 -07:00 |
|
Chang Su
|
c7962868c1
|
[router] Fix tool_choice normalization in ChatCompletionRequest and fix ut (#11731)
|
2025-10-16 14:20:13 -07:00 |
|
Keyang Ru
|
4c9bcb9d56
|
[Router] Refactor protocol definitions: split spec.rs into modular files (#11677)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-10-16 13:44:44 -07:00 |
|
Keyang Ru
|
0975ba99bc
|
[router] fix get_models endpoint for openai router (#11687)
|
2025-10-16 09:00:08 -07:00 |
|
Keyang Ru
|
d2478cd4ff
|
[router] Fix response api related spec (#11621)
|
2025-10-15 09:59:38 -07:00 |
|
Simo Lin
|
3962e39d7c
|
[router] cleanup app context and move to startup (#11617)
|
2025-10-14 10:19:28 -07:00 |
|
Simo Lin
|
0b9915c132
|
[router] update generate spec to align with sgl io struct (#11591)
|
2025-10-14 02:51:33 -04:00 |
|
Chang Su
|
27ef1459e6
|
[router][protocols] Add Axum validate extractor and use it for /v1/chat/completions endpoint (#11588)
|
2025-10-13 22:51:15 -07:00 |
|
Simo Lin
|
728af88781
|
[router] allow user to specify chat template path (#11549)
|
2025-10-13 10:47:57 -07:00 |
|
Keyang Ru
|
63e84352b7
|
[router] openai router: support grok model (#11511)
|
2025-10-12 22:44:43 -04:00 |
|
Keyang Ru
|
eb7d9261c0
|
[router] conversation item API: create, retrieve and delete (#11369)
|
2025-10-09 17:43:16 -04:00 |
|
Chang Su
|
ab926dd697
|
[router][grpc] Fix streaming bugs: empty tool names, state pollution, and panics (#11373)
|
2025-10-09 06:53:23 -04:00 |
|
Chang Su
|
a0557642ea
|
[router][lint] Add unused_qualifications to cargo lint warnings (#11366)
|
2025-10-08 22:17:11 -07:00 |
|
Keyang Ru
|
84768d1017
|
[router] Refactor OpenAI router: split monolithic file and move location (#11359)
|
2025-10-09 00:46:39 -04:00 |
|
Chang Su
|
fccac7d126
|
[router][grpc] Add dependencies in Cargo.toml to support chat template rendering (#11342)
|
2025-10-08 15:38:37 -07:00 |
|
Keyang Ru
|
7ac6b900f4
|
[router] Support history management using conversation (#11339)
|
2025-10-08 15:24:02 -07:00 |
|
Keyang Ru
|
4ed67c27e3
|
[router] support Openai router conversation API CRUD (#11297)
|
2025-10-07 15:31:35 -07:00 |
|