Commit Graph
15 Commits
Author SHA1 Message Date
Liangsheng Yin f0458e0b49 [Utils] Move network/socket utilities from common.py to network.py (#20646) 2026-03-15 20:35:24 -07:00
Simo Lin a16f03c1e3 Revert "feat: add banner to sgl-model-gateway (#20471)" (#20536) 2026-03-13 09:20:32 -07:00
Simo Lin b227e53ebf feat: add banner to sgl-model-gateway (#20471)
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
2026-03-12 14:25:27 -07:00
Feng Su 8a411a9a2a [Tracing] Remove the deprecated tracing code from mini_lb (#19409) 2026-03-07 11:19:23 +08:00
Jonathan Leegithub_username <github_email>Claude Opus 4.6
e58391dd7d Add --json-log flag to enable structured JSON logging (#19968)
Co-authored-by: github_username <github_email>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-05 11:24:12 -08:00
Duyi-Wang 98e433e305 [PD-Disagg][Fix] Remove 'test_external_dp_routing' from Rust Router constructor parameters. (#19492) 2026-02-27 02:40:01 -08:00
Liangsheng YinandRatish P 539f772f54 [PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268)
Co-authored-by: Ratish P <114130421+ratish1@users.noreply.github.com>
2026-02-24 19:58:01 -08:00
Blake Ledden f759960ac2 feat: expose consistent_hashing policy in Python router CLI args (#17972) 2026-02-16 00:33:24 +08:00
Simo Lin 3f44268fe5 [smg] release 0.3.2 (#17168) 2026-01-15 11:22:18 -08:00
Ziwen Zhao cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
fzyzcjy ff3ddb9d9b Support min num routing keys in key-based load balancing policy (#16564) 2026-01-12 21:38:03 -08:00
fzyzcjy 9d3018f484 Support min load besides random routing key assignment policy in ManualPolicy (#16767) 2026-01-12 18:31:18 -08:00
Wenyi Xu 3c16c58619 [model-gateway] Add Redis support as a history backend (#16300) 2026-01-11 01:03:00 -08:00
Simo Lin 7460240737 [model-gateway] release 0.3.1 (#16254) 2026-01-08 17:49:37 -08:00
Simo Lin 0ff3747ca1 [model-gateway]: move unit tests to bindings/python/tests/ (#16430) 2026-01-04 18:10:35 -08:00