Commit Graph
12 Commits
Author SHA1 Message Date
Keyang Ru 3f2d0cefcd [router] Add MCP Tool Handler (#9615) 2025-08-27 19:12:39 -07:00
Keyang Ru 5ef545e678 [router] Move all protocols to spec.rs file (#9519) 2025-08-22 14:18:47 -07:00
Keyang RuandYineng Zhang 3828db4309 [router] Add IGW (Inference Gateway) Feature Flag (#9371)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-08-20 17:38:57 -07:00
Keyang Ru f515449582 Fix gpt-oss response api streaming issue (#9368) 2025-08-19 20:19:42 -07:00
Keyang Ru 5ae5ecaa15 [router] Implement OpenAI Responses API specification (#9367) 2025-08-19 20:14:47 -07:00
Keyang Ru c5057262fa [Router] Add validation module for API parameters (#9335) 2025-08-19 13:25:53 -07:00
Keyang Ru ce67b2d586 [router]restructure protocol modules for better organization (#9321) 2025-08-19 01:07:58 +00:00
Keyang Ru 886454e8e7 [MISC] use dynamic choices for tool-call-parser argument (#9316) 2025-08-18 13:02:10 -07:00
Keyang Ruandkey4ng 4093d460ce [CI] migrate router to BM.A10.4 runner (#8992)
Co-authored-by: key4ng <rukeyang@gamil.com>
2025-08-11 22:41:18 -07:00
Keyang Ruandkey4ng 7c9697178e [CI]Add genai-bench Performance Validation for PD Router (#8477)
Co-authored-by: key4ng <rukeyang@gamil.com>
2025-07-28 16:58:23 -07:00
Keyang Ru 29bd4c8135 [CI] Add CI Testing for Prefill-Decode Disaggregation with Router (#7540) 2025-06-27 00:18:56 -07:00
Keyang Ru 5e7fdc79fa [OAI Server Refactor] [ChatCompletions & Completions] Support Return Hidden State (#7329)
Signed-off-by: keru <rukeyang@gmail.com>
2025-06-20 19:18:53 -07:00