fzyzcjy
|
9d3b411c56
|
Add code field and unify error responses for router (#15028)
|
2025-12-13 13:21:34 +08:00 |
|
fzyzcjy
|
05325db349
|
Super tiny remove unused log_request (#15035)
|
2025-12-13 13:21:24 +08:00 |
|
Simo Lin
|
9a56273ad2
|
[model-gateway] refactor: unify worker management into modular workflow structure (#15010)
|
2025-12-12 15:25:35 -08:00 |
|
fzyzcjy
|
ec242f516e
|
Super tiny extract route_typed_request_once (#14951)
|
2025-12-12 11:10:10 -08:00 |
|
Simo Lin
|
526fd0082f
|
[model-gateway] refactor: workflow engine cleanup and minor optimization (#15001)
|
2025-12-12 09:03:28 -08:00 |
|
Simo Lin
|
56d0ad47f4
|
[model-gateway] fix: handle workflow deadlock and optimize cycle detection (#15000)
|
2025-12-12 08:53:45 -08:00 |
|
Simo Lin
|
306e5b8d0b
|
[model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999)
|
2025-12-12 08:31:12 -08:00 |
|
Simo Lin
|
10c68f6236
|
[model-gateway] refactor: extract workflow engine to src/workflow module (#14996)
|
2025-12-12 06:29:12 -08:00 |
|
fzyzcjy
|
edb172e927
|
Super tiny refactor error.rs logic (#14949)
|
2025-12-12 14:48:18 +08:00 |
|
fzyzcjy
|
a7fa31ff17
|
Super tiny move error.rs (#14944)
|
2025-12-12 14:25:30 +08:00 |
|
fzyzcjy
|
bd91f8824a
|
Super tiny remove non-updated sgl_router_worker_load (#14888)
|
2025-12-12 13:19:30 +08:00 |
|
fzyzcjy
|
b47adb807e
|
Tiny add e2e http request arrival metric (#14893)
|
2025-12-12 13:18:23 +08:00 |
|
fzyzcjy
|
b2b5bdb06e
|
Tiny add router e2e duration histogram (#14892)
|
2025-12-12 13:18:13 +08:00 |
|
JinYan Su
|
22fe5da13e
|
Fix negative duration panic in token bucket wait time calculation (#14941)
Signed-off-by: xiaguan <751080330@qq.com>
|
2025-12-11 21:16:47 -08:00 |
|
Praneth Paruchuri
|
1834401e7c
|
[model-gateway] optimize worker selection (#14894)
|
2025-12-11 21:15:12 -08:00 |
|
fzyzcjy
|
e4873d0439
|
Super tiny remove sgl_router_active_workers (#14891)
|
2025-12-11 20:00:55 -08:00 |
|
Jimmy
|
2c4d376d23
|
[SMG][DS32][fix] support dsv32, add role developer (#14307)
|
2025-12-11 08:09:09 -08:00 |
|
Simo Lin
|
6f99dc97f7
|
[model-gateway] fix imports and delete unused code (#14911)
|
2025-12-11 07:42:47 -08:00 |
|
Simo Lin
|
cd1c1fa5bc
|
[model-gateway] fix annotation error and code formating (#14910)
|
2025-12-11 07:06:32 -08:00 |
|
Simo Lin
|
5b0872d2d7
|
[model-gateway] code clean up on oai router in responses (#14852)
|
2025-12-11 06:55:09 -08:00 |
|
fzyzcjy
|
ba88f1cace
|
Tiny clean router load report logic (#14889)
|
2025-12-11 06:50:32 -08:00 |
|
fzyzcjy
|
60560c07a2
|
[model-gateway] refactor cleanup WorkflowContext.get_or_err (#14890)
|
2025-12-11 06:48:30 -08:00 |
|
Simo Lin
|
bcc5483ed7
|
[model-gateway] fix import order in oai conversation (#14851)
|
2025-12-10 15:36:42 -08:00 |
|
Simo Lin
|
ccf2602773
|
[model-gateway] code clean up on oai router (#14850)
|
2025-12-10 15:34:27 -08:00 |
|
Simo Lin
|
c032b559a8
|
[model-gateway] adds default implementations to RouterTrait in mod.rs (#14841)
|
2025-12-10 11:46:35 -08:00 |
|
Praneth Paruchuri
|
e99ee0c695
|
[model-gateway] Fix incompatible metric comparison in PowerOfTwo policy (#14823)
|
2025-12-10 11:15:38 -08:00 |
|
fzyzcjy
|
3d82c0f17f
|
[model-gateway] support engine response http status statistics in router (#14712)
|
2025-12-10 08:30:53 -08:00 |
|
fzyzcjy
|
617e9b3bf8
|
[model-gateway] support customizing Prometheus duration buckets (#14716)
|
2025-12-10 08:30:03 -08:00 |
|
Simo Lin
|
2543666c8e
|
[model-gateway] add anthropic message api spec (#14834)
|
2025-12-10 08:26:51 -08:00 |
|
fzyzcjy
|
6634f67bd5
|
Fix router keep nonzero metrics after worker is deleted (#14819)
|
2025-12-10 22:29:30 +08:00 |
|
Wenyi Xu
|
d7f6320bb8
|
[model-gateway] Dynamically Populate Tool Call Parser Choices (#14807)
|
2025-12-10 06:04:22 -08:00 |
|
ybyang
|
766476f52a
|
[SMG-GO] implement a Go SGLang Model Gateway - OpenAI Compatible API Server (#14770)
|
2025-12-10 06:03:28 -08:00 |
|
Simo Lin
|
390406c46c
|
[model-gateway] release gateway 0.2.4 (#14763)
|
2025-12-09 16:34:29 -08:00 |
|
Simo Lin
|
9ad02b799d
|
[Perf] Optimize radix tree for cache-aware load balancin (#14758)
|
2025-12-09 15:35:29 -08:00 |
|
Simo Lin
|
73df7a4e8d
|
[SMG] perf: optimize tokenizer for reduced CPU and memory overhead (#14752)
|
2025-12-09 11:41:13 -08:00 |
|
Simo Lin
|
8b98bb768c
|
[model-gateway] optimize core modules (#14751)
|
2025-12-09 10:54:07 -08:00 |
|
fzyzcjy
|
817daba062
|
Tiny extract select_worker_min_load (#14648)
|
2025-12-08 21:22:10 -08:00 |
|
Simo Lin
|
af60cad05d
|
[ci][smg] fix docker release ci and add it to pr test (#14683)
|
2025-12-08 20:56:38 -08:00 |
|
fzyzcjy
|
af20657cd4
|
Tiny support sgl-router http response status code metrics (#14689)
|
2025-12-08 19:54:35 -08:00 |
|
Jimmy
|
6f657070ef
|
[SMG]feat: implement TokenGuardBody for managing token return (#14653)
|
2025-12-08 16:44:46 -08:00 |
|
Simo Lin
|
edde5e5d40
|
[model-gateway] add OTEL integration to grpc router (#14671)
|
2025-12-08 14:45:05 -08:00 |
|
fzyzcjy
|
2e3946d889
|
Fix cache-aware router should pick min load instead of min tenant size (#14650)
|
2025-12-08 13:33:34 -08:00 |
|
Simo Lin
|
8550822d6b
|
[model-gateway] Optimize memory usage in HTTP router (#14667)
|
2025-12-08 13:10:31 -08:00 |
|
Simo Lin
|
7bf16c6339
|
[model-gateway] fix WASM arbitrary file read security vol (#14664)
|
2025-12-08 12:11:16 -08:00 |
|
Simo Lin
|
39f9a9c2a5
|
[model-gateway] reduce cpu overhead in grpc router (#14663)
|
2025-12-08 11:54:56 -08:00 |
|
Simo Lin
|
d69ecc19b8
|
[model-gateway] reducing cpu overhead in various of places (#14658)
|
2025-12-08 09:44:40 -08:00 |
|
fzyzcjy
|
cb4cdb43a4
|
Fix dp-aware incompatible with service-discovery (#14629)
|
2025-12-08 06:39:27 -08:00 |
|
fzyzcjy
|
a2ca9bd4f1
|
Super tiny fix unused code in router (#14618)
|
2025-12-07 23:12:09 -08:00 |
|
Simo Lin
|
2970f22917
|
[model-gateway] fix WASM unbounded request/response body read vuln (#14612)
|
2025-12-07 20:47:25 -08:00 |
|
fzyzcjy
|
c08b780fe0
|
Super tiny remove unused select_worker_pair (#14609)
|
2025-12-07 20:32:38 -08:00 |
|