Commit Graph

13 Commits

Author SHA1 Message Date
Simo Lin
f44c4b3715 [model-gateway] Add classify pipeline stages and protocol types (#16094)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-12-29 10:23:36 -08:00
fzyzcjy
6ef543f99d Use X-SMG-Routing-Key header instead of json body and add tests (#15826) 2025-12-25 09:58:14 -08:00
fzyzcjy
45adad37d0 Add manual routing policy for router (#15586) 2025-12-25 11:27:36 +08:00
Simo Lin
846953d9f1 [model-gateway] Add tokenize/detokenize HTTP endpoints and tokenizer management (#15702) 2025-12-23 17:32:07 -08:00
ratish
5f3a47d8a7 [model-gateway]: add gRPC router embeddings endpoint implementation (#15273) 2025-12-23 09:12:22 -08:00
Simo Lin
e1dcd0df3e [model-gateway] minor code clean up (#15578) 2025-12-21 11:00:32 -10:00
Haoran Wang
ef001fb811 [model-gateway] /parse/easoning and parse/function_call for sgl-model-gateway (#15568) 2025-12-21 07:39:24 -10:00
Simo Lin
fd37cc5d38 [model-gateway] Refactor worker steps and add update workflow (#15085) 2025-12-13 15:00:16 -08:00
Jimmy
2c4d376d23 [SMG][DS32][fix] support dsv32, add role developer (#14307) 2025-12-11 08:09:09 -08:00
Simo Lin
2543666c8e [model-gateway] add anthropic message api spec (#14834) 2025-12-10 08:26:51 -08:00
Simo Lin
8550822d6b [model-gateway] Optimize memory usage in HTTP router (#14667) 2025-12-08 13:10:31 -08:00
Simo Lin
d69ecc19b8 [model-gateway] reducing cpu overhead in various of places (#14658) 2025-12-08 09:44:40 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00