Bingxu Chen
|
38473f8ee0
|
[AMD] Fix sgl-model-gateway Build Errors in ROCm Docker Release (#18836)
|
2026-02-14 00:07:26 -08:00 |
|
Simo Lin
|
2f283d8152
|
refactor: consolidate gRPC client into shared crate dependency (#18730)
|
2026-02-12 06:43:24 -08:00 |
|
Simo Lin
|
ac16d4450e
|
[smg][mesh] extract mesh to mesh crate to reduce compile time (#17907)
|
2026-01-28 17:58:42 -08:00 |
|
Praneth Paruchuri
|
897c35b457
|
[model-gateway] Optimize consistent hashing hot path to eliminate allocations (#17467)
|
2026-01-27 22:46:11 -08:00 |
|
Simo Lin
|
6756cf18c6
|
remove multimodal as this is completely dead code (#17750)
|
2026-01-26 00:07:40 -08:00 |
|
Simo Lin
|
d4adff31aa
|
update wasm endpoint (#17748)
|
2026-01-25 23:43:29 -08:00 |
|
Simo Lin
|
ed75136e85
|
remove self managed wasm as it has been replaced with official smg wa… (#17746)
|
2026-01-25 22:56:33 -08:00 |
|
Simo Lin
|
7890a96f97
|
remove self managed mcp as it has been replaced with official rmcp crate (#17740)
|
2026-01-25 22:17:06 -08:00 |
|
Simo Lin
|
46bc53a81b
|
[smg] import db crate to replace self managed one (#17727)
|
2026-01-25 16:54:52 -08:00 |
|
Simo Lin
|
52d0ca944b
|
[smg] import official wfaas crate to replace self managed one (#17724)
|
2026-01-25 15:20:58 -08:00 |
|
Simo Lin
|
bf139af37a
|
[smg] use already published auth crate for better compilation speed (#17723)
|
2026-01-25 14:52:42 -08:00 |
|
Praneth Paruchuri
|
fc7096f80b
|
[model-gateway] Optimize special token search using Aho-Corasick (#17387)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-25 13:54:15 -08:00 |
|
Simo Lin
|
f5ac1ca10b
|
[smg] use official tokenizer crate instead of manually built one (#17721)
|
2026-01-25 13:35:16 -08:00 |
|
Simo Lin
|
86c7bc6431
|
[smg] update crate for tools (#17717)
|
2026-01-25 12:56:42 -08:00 |
|
Simo Lin
|
8db2802b2d
|
update to use official openai protocol crate (#17710)
|
2026-01-25 06:35:59 -08:00 |
|
Simo Lin
|
6af22f8dbf
|
use published reasoning parser crate (#17709)
|
2026-01-25 06:15:03 -08:00 |
|
Simo Lin
|
3f44268fe5
|
[smg] release 0.3.2 (#17168)
|
2026-01-15 11:22:18 -08:00 |
|
Tony Lu
|
5938c3b06a
|
[model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108)
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
|
2026-01-13 17:03:39 -08:00 |
|
Wenyi Xu
|
3c16c58619
|
[model-gateway] Add Redis support as a history backend (#16300)
|
2026-01-11 01:03:00 -08:00 |
|
Praneth Paruchuri
|
bd1afeb568
|
[model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804)
|
2026-01-09 09:29:22 -08:00 |
|
Simo Lin
|
7460240737
|
[model-gateway] release 0.3.1 (#16254)
|
2026-01-08 17:49:37 -08:00 |
|
Praneth Paruchuri
|
b12258bfaa
|
[model-gateway] Optimize HTTP Router Fan-out: Replace Serial Execution with Concurrent Streams (#16042)
|
2026-01-04 23:38:45 -08:00 |
|
Chang Su
|
d8ac5eecf7
|
[model-gateway] bug fix on module name (#16332)
|
2026-01-02 21:56:18 -08:00 |
|
fzyzcjy
|
7ccaec6467
|
Add micro benchmarks for manual policy (#15991)
|
2025-12-28 17:11:56 +08:00 |
|
Simo Lin
|
3645ed0f73
|
[model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)
|
2025-12-27 05:58:05 -05:00 |
|
Simo Lin
|
4edee6954a
|
[model-gateway] add JWT/OIDC authentication for control plane APIs (#15850)
|
2025-12-26 18:30:00 -08:00 |
|
Simo Lin
|
5454d2a7ae
|
[model-gateway] release smg 0.3.0 (#15781)
|
2025-12-24 13:23:57 -08:00 |
|
Praneth Paruchuri
|
80ae2229d3
|
[model-gateway] Optimize router selection with lock-free snapshots (#15672)
|
2025-12-23 09:09:30 -08:00 |
|
Simo Lin
|
1e641ee4a7
|
[model-gateway] upgrade axum and axum server (#15146)
|
2025-12-14 20:54:01 -08:00 |
|
ratish
|
0e4108ba29
|
feat(gateway): Add server-side TLS support (#15052)
|
2025-12-14 15:37:55 -08:00 |
|
Praneth Paruchuri
|
1834401e7c
|
[model-gateway] optimize worker selection (#14894)
|
2025-12-11 21:15:12 -08:00 |
|
Simo Lin
|
390406c46c
|
[model-gateway] release gateway 0.2.4 (#14763)
|
2025-12-09 16:34:29 -08:00 |
|
Simo Lin
|
9ad02b799d
|
[Perf] Optimize radix tree for cache-aware load balancin (#14758)
|
2025-12-09 15:35:29 -08:00 |
|
Jimmy
|
6f657070ef
|
[SMG]feat: implement TokenGuardBody for managing token return (#14653)
|
2025-12-08 16:44:46 -08:00 |
|
Simo Lin
|
d69ecc19b8
|
[model-gateway] reducing cpu overhead in various of places (#14658)
|
2025-12-08 09:44:40 -08:00 |
|
Feng Su
|
e12c6b320f
|
[model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897)
|
2025-12-06 05:59:04 -08:00 |
|
Simo Lin
|
49dfa1d891
|
[model-gateway] change sgl-router to sgl-model-gateway (#14312)
|
2025-12-05 12:04:48 -08:00 |
|