Commit Graph
13 Commits
Author SHA1 Message Date
Keyang RuandChang Su 4c9bcb9d56 [Router] Refactor protocol definitions: split spec.rs into modular files (#11677)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-16 13:44:44 -07:00
Chang Su ab926dd697 [router][grpc] Fix streaming bugs: empty tool names, state pollution, and panics (#11373) 2025-10-09 06:53:23 -04:00
Chang Su fccac7d126 [router][grpc] Add dependencies in Cargo.toml to support chat template rendering (#11342) 2025-10-08 15:38:37 -07:00
Chang Su 466992b2d0 [router][tool call] Clean up redundant detect_format and has_tool_markers (#11270) 2025-10-06 14:04:02 -07:00
Chang Su 963175d5c0 [router][grpc] Support streaming for v1/chat/completions (#11179) 2025-10-02 14:35:16 -07:00
Chang Su b658be6f6a [router][grpc] Support tool call parser in streaming (#11160) 2025-10-02 03:18:50 -07:00
Chang Su 4eeaff74a0 [router][tool call] Separate JsonParser and LlamaParser (#11073) 2025-09-29 10:26:37 -07:00
Chang Su af4ab65606 [router][tool call] Improve normal content extraction and error handling (non-stream) (#11050) 2025-09-29 00:19:30 -07:00
Chang Su dba751a896 [router][tool call] Support normal content extraction before tool call (streaming) (#11038) 2025-09-28 19:46:06 -07:00
Chang Su c1c8dd1dd0 [router][tool parser] Modify tool parser to return both normal text and tool calls (non-stream) (#10995) 2025-09-27 18:10:17 -04:00
Simo Lin 07c9d8fba2 [router] add llama3.2 multi json streaming parser (#9735) 2025-08-28 05:57:13 -07:00
Simo Lin e1f7cf57dc [router] additional llama32 parser unit test and multi json support (#9732) 2025-08-27 20:34:11 -07:00
Simo Lin 9768c50d90 [router] restructure tool parser module folder (#9693) 2025-08-27 06:05:53 -07:00