Liangsheng Yin
|
f0458e0b49
|
[Utils] Move network/socket utilities from common.py to network.py (#20646)
|
2026-03-15 20:35:24 -07:00 |
|
Simo Lin
|
a16f03c1e3
|
Revert "feat: add banner to sgl-model-gateway (#20471)" (#20536)
|
2026-03-13 09:20:32 -07:00 |
|
Simo Lin
|
b227e53ebf
|
feat: add banner to sgl-model-gateway (#20471)
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-03-12 14:25:27 -07:00 |
|
Feng Su
|
8a411a9a2a
|
[Tracing] Remove the deprecated tracing code from mini_lb (#19409)
|
2026-03-07 11:19:23 +08:00 |
|
Jonathan Lee
|
e58391dd7d
|
Add --json-log flag to enable structured JSON logging (#19968)
Co-authored-by: github_username <github_email>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-05 11:24:12 -08:00 |
|
Duyi-Wang
|
98e433e305
|
[PD-Disagg][Fix] Remove 'test_external_dp_routing' from Rust Router constructor parameters. (#19492)
|
2026-02-27 02:40:01 -08:00 |
|
Liangsheng Yin
|
539f772f54
|
[PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268)
Co-authored-by: Ratish P <114130421+ratish1@users.noreply.github.com>
|
2026-02-24 19:58:01 -08:00 |
|
Blake Ledden
|
f759960ac2
|
feat: expose consistent_hashing policy in Python router CLI args (#17972)
|
2026-02-16 00:33:24 +08:00 |
|
Simo Lin
|
3f44268fe5
|
[smg] release 0.3.2 (#17168)
|
2026-01-15 11:22:18 -08:00 |
|
Ziwen Zhao
|
cf25852a1d
|
[model-gateway] add --disable-health-check option to skip worker health probes (#17002)
|
2026-01-13 17:28:32 -08:00 |
|
Tony Lu
|
5938c3b06a
|
[model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108)
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
|
2026-01-13 17:03:39 -08:00 |
|
fzyzcjy
|
ff3ddb9d9b
|
Support min num routing keys in key-based load balancing policy (#16564)
|
2026-01-12 21:38:03 -08:00 |
|
fzyzcjy
|
9d3018f484
|
Support min load besides random routing key assignment policy in ManualPolicy (#16767)
|
2026-01-12 18:31:18 -08:00 |
|
Wenyi Xu
|
3c16c58619
|
[model-gateway] Add Redis support as a history backend (#16300)
|
2026-01-11 01:03:00 -08:00 |
|
Simo Lin
|
7460240737
|
[model-gateway] release 0.3.1 (#16254)
|
2026-01-08 17:49:37 -08:00 |
|
Simo Lin
|
0ff3747ca1
|
[model-gateway]: move unit tests to bindings/python/tests/ (#16430)
|
2026-01-04 18:10:35 -08:00 |
|
Chang Su
|
d8ac5eecf7
|
[model-gateway] bug fix on module name (#16332)
|
2026-01-02 21:56:18 -08:00 |
|
fzyzcjy
|
00562ee14a
|
Support cache eviction for Manual Policy (#16263)
|
2026-01-02 08:52:01 +08:00 |
|
Simo Lin
|
3645ed0f73
|
[model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)
|
2025-12-27 05:58:05 -05:00 |
|
Simo Lin
|
171912a9e3
|
[model-gateway] Add consistent hashing for ManualPolicy routing (#15907)
|
2025-12-26 22:53:03 -08:00 |
|
Simo Lin
|
4edee6954a
|
[model-gateway] add JWT/OIDC authentication for control plane APIs (#15850)
|
2025-12-26 18:30:00 -08:00 |
|
fzyzcjy
|
45adad37d0
|
Add manual routing policy for router (#15586)
|
2025-12-25 11:27:36 +08:00 |
|
Simo Lin
|
50cad014dc
|
[model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491)
|
2025-12-19 12:35:50 -08:00 |
|
ratish
|
0e4108ba29
|
feat(gateway): Add server-side TLS support (#15052)
|
2025-12-14 15:37:55 -08:00 |
|
fzyzcjy
|
617e9b3bf8
|
[model-gateway] support customizing Prometheus duration buckets (#14716)
|
2025-12-10 08:30:03 -08:00 |
|
Wenyi Xu
|
d7f6320bb8
|
[model-gateway] Dynamically Populate Tool Call Parser Choices (#14807)
|
2025-12-10 06:04:22 -08:00 |
|
Simo Lin
|
aff1238ef2
|
[model-gateway] reorganize metrics, logging, and otel to its own module (#14590)
|
2025-12-07 16:50:39 -08:00 |
|
Feng Su
|
e12c6b320f
|
[model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897)
|
2025-12-06 05:59:04 -08:00 |
|
Simo Lin
|
49dfa1d891
|
[model-gateway] change sgl-router to sgl-model-gateway (#14312)
|
2025-12-05 12:04:48 -08:00 |
|