 Simo Lin
|
a4ffd665c0
|
[model-gateway] fix WASM memory limit per module (#14600)
|
2025-12-07 19:15:19 -08:00 |
|
|
Simo Lin
|
aff1238ef2
|
[model-gateway] reorganize metrics, logging, and otel to its own module (#14590)
|
2025-12-07 16:50:39 -08:00 |
|
|
Simo Lin
|
5e2cda6158
|
[model-gateway] Fixed WASM Security Vulnerability - Execution Timeout (#14588)
|
2025-12-07 16:05:53 -08:00 |
|
|
Simo Lin
|
b0bbc7f53d
|
[model-gateway] extra accumulator and tool handler in oai router (#14587)
|
2025-12-07 15:52:12 -08:00 |
|
|
Simo Lin
|
d30d6b368f
|
[bug] fix notebook to include new keys from model_info (#14528)
|
2025-12-05 20:44:03 -08:00 |
|
|
Simo Lin
|
959a17466d
|
[model-gateway] fix code owner for wasm (#14516)
|
2025-12-05 13:48:25 -08:00 |
|
|
Simo Lin
|
b72f0268c7
|
[model-gateway] fix left over sgl-router names in wasm (#14514)
|
2025-12-05 13:16:58 -08:00 |
|
|
Simo Lin
|
09376fd738
|
[model-gateway] fix logs in smg workflow (#14513)
|
2025-12-05 12:50:50 -08:00 |
|
|
Simo Lin
|
aed835e32d
|
[model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512)
|
2025-12-05 12:41:48 -08:00 |
|
|
Simo Lin
|
49dfa1d891
|
[model-gateway] change sgl-router to sgl-model-gateway (#14312)
|
2025-12-05 12:04:48 -08:00 |
|
|
Simo Lin
|
cf9a774cf8
|
[model-gateway] fix server info comment (#14508)
|
2025-12-05 10:09:58 -08:00 |
|
|
Simo Linandkey4ng
|
1569fc7f49
|
[model-gateway] reorganized conversation handler (#14507)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-05 09:31:27 -08:00 |
|
|
Simo Linandkey4ng
|
05284378d6
|
[model-gateway] move conversation to first class routing (#14506)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-05 08:44:13 -08:00 |
|
|
Simo Lin
|
7235a7fbe9
|
[misc] add model arch and type to server info and use it for harmony (#14456)
|
2025-12-05 06:51:00 -08:00 |
|
|
Simo LinandChang Su
|
c1006fd8a1
|
[model-gateway] grpc to leverage event type (#14450)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-04 14:30:19 -08:00 |
|
|
Simo LinandChang Su
|
29c6c2ea9d
|
[model-gateway] add mistral 3 image processor (#14445)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-04 13:16:04 -08:00 |
|
|
Simo Linandkey4ng
|
eb85fa6daf
|
[model-gateway] move all responses api event from oai to proto (#14446)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 13:11:03 -08:00 |
|
|
Simo Linandkey4ng
|
d8faf2f361
|
[model-gateway] move oai header util to router header util (#14441)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 11:02:50 -08:00 |
|
|
Simo Linandkey4ng
|
7f3308bc68
|
[model-gateway] extract conversation out of oai router (#14440)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 10:16:14 -08:00 |
|
|
Simo Lin
|
fdc2ef58db
|
[model-gateway] add llama4 vision image processor (#14438)
|
2025-12-04 09:52:36 -08:00 |
|
|
Simo Linandkey4ng
|
b01fc161eb
|
[model-gateway] introduce request ctx for oai router (#14434)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 08:31:44 -08:00 |
|
|
Simo Lin
|
11d33c0e8f
|
[model-gateway] add phi4 vision image processor (#14430)
|
2025-12-04 07:40:33 -08:00 |
|
|
Simo Lin
|
fa78c44a3d
|
[model-gateway] introduce provider in openai router (#14394)
|
2025-12-03 22:47:20 -08:00 |
|
|
Simo Lin
|
654a78f9c8
|
[model-gateway] add phi3 vision image processor (#14381)
|
2025-12-03 22:32:40 -08:00 |
|
|
Simo Lin
|
d42c167bfd
|
[model-gateway] add qwen3_vl model image processor (#14377)
|
2025-12-03 17:16:37 -08:00 |
|
|
Simo Lin
|
388151053d
|
[model-gateway] use worker crate in openai router (#14330)
|
2025-12-03 13:36:32 -08:00 |
|
|
Simo Lin
|
8ab5d8b40d
|
[model-gateway] add qwen2.5_vl model image processor (#14375)
|
2025-12-03 12:51:30 -08:00 |
|
|
Simo Lin
|
03575ce38d
|
[model-gateway] add qwen2_vl model image processor and tests (#14374)
|
2025-12-03 12:34:06 -08:00 |
|
|
Simo Lin
|
abf6272bdd
|
[model-gateway] add llava model image processor and tests (#14371)
|
2025-12-03 11:18:00 -08:00 |
|
|
Simo Lin
|
58ac3f317b
|
[model-gateway] add image processor and transformer structure (#14344)
|
2025-12-03 00:04:06 -08:00 |
|
|
Simo Lin
|
d5ea8c7176
|
[model-gateway] multimodality initialization (#13350)
|
2025-12-02 19:41:40 -08:00 |
|
|
Simo Lin
|
5dad1ff1b6
|
[model-gateway] add workflow for external model providers (#14323)
|
2025-12-02 16:47:06 -08:00 |
|
|
Simo Lin
|
51a86ce69e
|
[model-gateway] change rust package name to sgl-model-gateway instead (#14283)
|
2025-12-02 00:06:54 -08:00 |
|
|
Simo Lin
|
383689e3ad
|
[model-gateway] fix version output (#14276)
|
2025-12-01 22:51:57 -08:00 |
|
|
Simo Lin
|
73df525382
|
[model-gateway] include smg version command in py binding (#14274)
|
2025-12-01 21:21:02 -08:00 |
|
|
Simo Lin
|
cd4151abc7
|
[model-gateway] add audio and moderation in model card (#14263)
|
2025-12-01 18:36:38 -08:00 |
|
|
Simo Lin
|
57f933fd7d
|
[model-gateway] Migrate Worker trait to model-aware methods (#14250)
|
2025-12-01 14:32:09 -08:00 |
|
|
Simo Lin
|
e7d6027e4a
|
[model-gateway] add ModelCard support to WorkerMetadata (#14243)
|
2025-12-01 13:04:09 -08:00 |
|
|
Simo Lin
|
9325f94534
|
[model-gateway] add ModelCard and ProviderType for model configuration (#14237)
|
2025-12-01 09:47:51 -08:00 |
|
|
Simo Lin
|
92ca629582
|
[model-gateway] add ModelType bitflags and Endpoint enum for worker (#14230)
|
2025-12-01 08:14:44 -08:00 |
|
|
Simo Lin
|
79b389da6b
|
[model-gateway] refactor oai router 1/n (#14228)
|
2025-12-01 07:16:35 -08:00 |
|
|
Simo Lin
|
e9e90460ed
|
[model-gateway] allow refill rate to be zero (#14030)
|
2025-11-26 17:15:27 -08:00 |
|
|
Simo Lin
|
69a03bc3f7
|
[ci] allow manual label to trigger ci in rust, change ci order (#14016)
|
2025-11-26 11:38:50 -08:00 |
|
|
Simo Lin
|
7e964b5198
|
[ci] mark skip as success instead of failure (#14014)
|
2025-11-26 10:39:38 -08:00 |
|
|
Simo Lin
|
a0d9f6cdd8
|
[model-gateway] fix xpu ci (#14012)
|
2025-11-26 10:33:59 -08:00 |
|
|
Simo Lin
|
4852aa054c
|
[misc] add llama3.1 chat template (#13935)
|
2025-11-25 09:31:54 -08:00 |
|
|
Simo Lin
|
9b4b344115
|
[model-gateway] add grpc server code owner (#13865)
|
2025-11-24 12:29:57 -08:00 |
|
|
Simo Lin
|
9054e844ea
|
remove package json which is not used (#13810)
|
2025-11-23 15:00:30 -08:00 |
|
|
Simo Lin
|
5354d7b7fd
|
[model-gateway] clean up router manager function order (#13776)
|
2025-11-22 16:16:20 -08:00 |
|
|
Simo Lin
|
e01486778a
|
[model-gateway] update smg code owner (#13777)
|
2025-11-22 15:50:53 -08:00 |
|
|
Simo Lin
|
3ae664d786
|
[model-gateway] add both python and rust cli alias (#13678)
|
2025-11-20 17:00:28 -08:00 |
|
|
Simo Lin
|
6b9459e86c
|
[docker] fix dockerfile naming for diffusion (#13534)
|
2025-11-18 12:18:32 -08:00 |
|
|
Simo Lin
|
9188feccca
|
[model-gateway] use worker startup time out for worker registration (#13473)
|
2025-11-17 19:28:21 -08:00 |
|
|
Simo Lin
|
25acbbc612
|
Remove verbs from GET endpoint paths to follow REST standards (#13273)
|
2025-11-17 12:34:36 -08:00 |
|
|
Simo Lin
|
b436113fc2
|
[model-gateway] Add Gateway Release Tooling (#13420)
|
2025-11-17 03:26:48 -08:00 |
|
|
Simo Lin
|
b24235b8bb
|
[model-gateway] update workflow names for gateway and exclude npu (#13415)
|
2025-11-17 02:04:07 -08:00 |
|
|
Simo Lin
|
efc5d8f5ed
|
[model-gateway] fix SDist step readme path (#13373)
|
2025-11-16 03:16:52 -08:00 |
|
|
Simo Lin
|
ef32a252d0
|
[model-gateway] fix model gateway pypi release workflow path (#13372)
|
2025-11-16 02:33:49 -08:00 |
|
|
Simo Lin
|
37c8761567
|
[model-gateway] remove grpc feature flag and mark as default (#13330)
|
2025-11-15 03:16:57 -08:00 |
|
|
Simo Lin
|
b732ffa404
|
[model-gateway] move python to binding folder (#13295)
|
2025-11-15 00:32:21 -08:00 |
|
|
Simo Lin
|
172c71a23d
|
[model-gateway] smg release 0.2.3 (#13312)
|
2025-11-14 19:04:20 -08:00 |
|
|
Simo Lin
|
385ff0e56f
|
[model-gateway] change mg labeler from router to model-gateway (#13265)
|
2025-11-13 23:29:09 -08:00 |
|
|
Simo Lin
|
4c1e909a80
|
[router] minmax-m2 xml tool parser (#13148)
|
2025-11-12 23:24:54 -08:00 |
|
|
Simo Lin
|
6d21392b0e
|
[router] remove worker url requirement (#13172)
|
2025-11-12 17:32:58 -08:00 |
|
|
Simo Lin
|
3cdec20c6b
|
[router] add minmax m2 reasoning parser (#13137)
|
2025-11-12 18:27:05 +09:00 |
|
|
Simo Lin
|
ae68158f2e
|
[router] move radix tree to policy crate and addreses some code styles (#13131)
|
2025-11-11 23:36:04 -08:00 |
|
|
Simo Lin
|
6237754842
|
[router] 0.2.2 release (#12399)
|
2025-10-30 14:40:13 -07:00 |
|
|
Simo Lin
|
700daa3463
|
[router] harmony responses api streaming support (#12395)
|
2025-10-30 07:30:48 -07:00 |
|
|
Simo LinandChang Su
|
03b3e89aea
|
[router] Harmony Pipeline: Chat Completion & Responses API with MCP Support (#12153)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-10-29 18:52:56 -07:00 |
|
|
Simo Lin
|
5259becd3c
|
[bug] fix router installation to include additional dependency (#12348)
|
2025-10-29 12:45:18 -07:00 |
|
|
Simo Lin
|
b53d9e11c6
|
[bug] fix router pypi license file (#12345)
|
2025-10-29 10:05:00 -07:00 |
|
|
Simo Lin
|
84a9d0eab2
|
[router] support arm, windows, mac, linux, reduce wheel size and number (#12285)
|
2025-10-28 12:18:51 -07:00 |
|
|
Simo Lin
|
25e73640f4
|
[router] upgrade grpc dependency and py 3.13 3.14 support (#12284)
|
2025-10-28 08:51:32 -07:00 |
|
|
Simo Lin
|
d85d6dba3b
|
[router] configure workflow retries and timeout based on routerConfig (#12252)
|
2025-10-28 00:41:20 -07:00 |
|
|
Simo Lin
|
c5642a7a7a
|
[router] use mcp struct from sdk and clean up code across codebase (#12249)
|
2025-10-28 00:33:10 -07:00 |
|
|
Simo Lin
|
83b2240074
|
[router] remove code duplication (#12245)
|
2025-10-27 23:01:44 -07:00 |
|
|
Simo Lin
|
b89111d69b
|
add gitignore for claude code and serena mcp (#12166)
|
2025-10-26 13:30:17 -07:00 |
|
|
Simo Lin
|
9e949e5877
|
[router] centralize mcp tool args handling (#12155)
|
2025-10-26 01:47:12 -07:00 |
|
|
Simo Lin
|
03e7d94916
|
[router] update smg code owners for each component (#12141)
|
2025-10-25 22:28:59 -07:00 |
|
|
Simo Lin
|
212f5e4822
|
[router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097)
|
2025-10-25 21:26:28 -07:00 |
|
|
Simo Lin
|
22cbc9c086
|
[bugs] docker file name should be <name>.Dockerfile so it can properly render (#11869)
|
2025-10-25 08:34:43 -07:00 |
|
|
Simo Lin
|
229f236da8
|
[router] migrate app context to builder pattern 2/n (#12089)
|
2025-10-24 15:04:32 -07:00 |
|
|
Simo Lin
|
5983e5bd1b
|
[router] migrate app context to builder pattern 1/n (#12086)
|
2025-10-24 13:35:22 -07:00 |
|
|
Simo Lin
|
770d63123c
|
[router] fix ut router config init to use build pattern (#12084)
|
2025-10-24 11:16:31 -07:00 |
|
|
Simo LinandChang Su
|
dbf17a8313
|
[router] Add mTLS Support for Router-to-Worker Communication (#12019)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-10-23 23:14:09 -07:00 |
|
|
Simo Lin
|
6d6e24bcc4
|
[router] Add builder pattern for RouterConfig with zero duplication (#12030)
|
2025-10-23 16:46:10 -07:00 |
|
|
Simo Lin
|
a4b637d87a
|
[router] change ci names and update log level in ci (#12021)
|
2025-10-23 10:36:19 -07:00 |
|
|
Simo Lin
|
5dccf69713
|
[router] create worker removal step and clean up worker manager (#11921)
|
2025-10-22 13:26:06 -07:00 |
|
|
Simo Lin
|
8a801ee38d
|
[router] release router 0.2.1 (#11885)
|
2025-10-20 21:08:45 -07:00 |
|
|
Simo Lin
|
1111030395
|
[router] clean up workflow logs to debug for implementation details logs (#11886)
|
2025-10-20 18:24:55 -07:00 |
|
|
Simo Lin
|
b4948512b8
|
[router] remove encoding header for oai router (#11881)
|
2025-10-20 17:39:00 -07:00 |
|
|
Simo Lin
|
ddcba74b4d
|
[router] Worker Management Workflow Engine (#11868)
|
2025-10-20 17:00:22 -07:00 |
|
|
Simo Lin
|
a7ae61ed77
|
[router] Add Configurable L0 and L1 Tokenizer Caching (#11688)
|
2025-10-18 18:33:53 -07:00 |
|
|
Simo Lin
|
a5978a20f0
|
[router] fix grpc client time out to 1h (#11768)
|
2025-10-17 10:26:12 -07:00 |
|
|
Simo Lin
|
e483c1eae5
|
[router] Fix UTF-8 Boundary Panic in Stop Sequence Decoder (#11766)
|
2025-10-17 10:21:00 -07:00 |
|
|
Simo Lin
|
4f24ab1718
|
[router][grpc] add dissag info to warm up in grpc server (#11727)
|
2025-10-16 14:19:55 -07:00 |
|
|
Simo Lin
|
64affab495
|
[router] fix p and d worker filtering and bootstrap port handling (#11729)
|
2025-10-16 14:19:39 -07:00 |
|
|
Simo Lin
|
f5d30dae89
|
[router] Refactor StopSequenceDecoder to Use Sequence for Incremental Decoding (#11676)
|
2025-10-15 16:31:03 -07:00 |
|
|
Simo Lin
|
74737b2863
|
[router] upgrade to 0.2.0 (#11642)
|
2025-10-14 22:10:30 -04:00 |
|
|
Simo Lin
|
40e0082d8d
|
[router] add worker self discovery for metadata (#11638)
|
2025-10-14 22:07:25 -04:00 |
|