Simo Lin
|
0236522214
|
refactor: remove crate re-export aliases from lib.rs (#18737)
|
2026-02-12 09:17:24 -08:00 |
|
Praneth Paruchuri
|
897c35b457
|
[model-gateway] Optimize consistent hashing hot path to eliminate allocations (#17467)
|
2026-01-27 22:46:11 -08:00 |
|
Simo Lin
|
52d0ca944b
|
[smg] import official wfaas crate to replace self managed one (#17724)
|
2026-01-25 15:20:58 -08:00 |
|
Praneth Paruchuri
|
fc7096f80b
|
[model-gateway] Optimize special token search using Aho-Corasick (#17387)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-25 13:54:15 -08:00 |
|
Simo Lin
|
f5ac1ca10b
|
[smg] use official tokenizer crate instead of manually built one (#17721)
|
2026-01-25 13:35:16 -08:00 |
|
fzyzcjy
|
9c2530642c
|
Change routing policy API to be async to support more policies (#17048)
|
2026-01-17 17:12:51 +08:00 |
|
Tony Lu
|
5938c3b06a
|
[model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108)
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
|
2026-01-13 17:03:39 -08:00 |
|
Praneth Paruchuri
|
bd1afeb568
|
[model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804)
|
2026-01-09 09:29:22 -08:00 |
|
Chang Su
|
d8ac5eecf7
|
[model-gateway] bug fix on module name (#16332)
|
2026-01-02 21:56:18 -08:00 |
|
Simo Lin
|
ac78f96ec5
|
[model-gateway] Optimize radix tree timestamp updates for multi-tenant scaling (#16093)
|
2025-12-29 10:08:19 -08:00 |
|
Simo Lin
|
7f5879985c
|
[model-gateway] Improve tree benchmark with realistic multi-tenant scenarios (#14838)
|
2025-12-29 08:37:24 -08:00 |
|
Simo Lin
|
c31f62722c
|
[model-gateway] fix tokenizer to match transformers special token handling (#16087)
|
2025-12-29 08:13:03 -08:00 |
|
Simo Lin
|
c236a3fdf0
|
[model-gateway][CI] Display benchmark results in GitHub Actions summary (#16037)
|
2025-12-28 20:57:27 -08:00 |
|
fzyzcjy
|
7ccaec6467
|
Add micro benchmarks for manual policy (#15991)
|
2025-12-28 17:11:56 +08:00 |
|
fzyzcjy
|
6ef543f99d
|
Use X-SMG-Routing-Key header instead of json body and add tests (#15826)
|
2025-12-25 09:58:14 -08:00 |
|
fzyzcjy
|
45adad37d0
|
Add manual routing policy for router (#15586)
|
2025-12-25 11:27:36 +08:00 |
|
Haoran Wang
|
26704c23c0
|
[model-gateway]: Tool parser for glm47 (#15520)
|
2025-12-20 18:07:51 -10:00 |
|
Praneth Paruchuri
|
1834401e7c
|
[model-gateway] optimize worker selection (#14894)
|
2025-12-11 21:15:12 -08:00 |
|
Simo Lin
|
9ad02b799d
|
[Perf] Optimize radix tree for cache-aware load balancin (#14758)
|
2025-12-09 15:35:29 -08:00 |
|
Simo Lin
|
49dfa1d891
|
[model-gateway] change sgl-router to sgl-model-gateway (#14312)
|
2025-12-05 12:04:48 -08:00 |
|