Praneth Paruchuri
|
250477d2ac
|
[model-gateway] Optimize L1 cache insertion with incremental hashing and tokenization (#16259)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-01-13 06:24:25 -08:00 |
|
Praneth Paruchuri
|
af1232b2f2
|
[model-gateway] fix wasm example (#16924)
|
2026-01-13 06:21:47 -08:00 |
|
fzyzcjy
|
ff3ddb9d9b
|
Support min num routing keys in key-based load balancing policy (#16564)
|
2026-01-12 21:38:03 -08:00 |
|
fzyzcjy
|
9d3018f484
|
Support min load besides random routing key assignment policy in ManualPolicy (#16767)
|
2026-01-12 18:31:18 -08:00 |
|
fzyzcjy
|
1f0e3d7fd8
|
Support tracking worker routing key loads in gateway (#16765)
|
2026-01-13 08:07:17 +08:00 |
|
Simo Lin
|
c6a64e9f69
|
[smg] fix type complexity for workflow run_if (#16981)
|
2026-01-12 15:41:52 -08:00 |
|
Simo Lin
|
e0ac559ae1
|
feat(workflow): add scheduled/delayed steps and conditional branching (#16980)
|
2026-01-12 15:06:12 -08:00 |
|
Simo Lin
|
6620548fd8
|
[model-gateway] make StateStore trait async for external persistence (#16979)
|
2026-01-12 12:55:59 -08:00 |
|
Simo Lin
|
6e158e55b4
|
[model-gateway] improve workflow engine code quality (#16977)
|
2026-01-12 12:14:46 -08:00 |
|
Simo Lin
|
ed729d22b3
|
[model-gateway] refactor workflow engine from type erasure to typed engines (#16973)
|
2026-01-12 10:47:00 -08:00 |
|
Simo Lin
|
fa51b85466
|
[model-gateway] convert workflow system to type-safe workflow data (#16970)
|
2026-01-12 10:06:36 -08:00 |
|
Simo Lin
|
d0092decb1
|
[model-gateway] Fix workflow engine race conditions and add graceful shutdown (#16963)
|
2026-01-12 06:37:39 -08:00 |
|
Wenyi Xu
|
c54c70ab62
|
[model-gateway] Improve Health Check Logging (#16930)
|
2026-01-11 23:01:29 -08:00 |
|
fzyzcjy
|
38b30c7b56
|
Tiny refactor age computation in router (#16850)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-01-11 21:42:43 -08:00 |
|
fzyzcjy
|
a1c48943d7
|
Tiny fix NoAvailableWorkers being a RetryError (#16896)
|
2026-01-11 18:53:17 -08:00 |
|
ybyang
|
503c3d9566
|
[model-gateway]: add qwen coder tool parser support xml format for qwen3 coder and microthinker (#12909)
|
2026-01-11 16:09:41 -08:00 |
|
Wenyi Xu
|
3c16c58619
|
[model-gateway] Add Redis support as a history backend (#16300)
|
2026-01-11 01:03:00 -08:00 |
|
Simo Lin
|
7c25687c9b
|
fix(gateway): rewrite gauge_histogram.rs for zero-allocation hot path (#16878)
|
2026-01-10 18:15:21 -08:00 |
|
fzyzcjy
|
1f9d4795a9
|
Tiny add gauge histogram abstraction for engine and router (#16848)
|
2026-01-10 11:45:25 +08:00 |
|
Praneth Paruchuri
|
bd1afeb568
|
[model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804)
|
2026-01-09 09:29:22 -08:00 |
|
Simo Lin
|
7460240737
|
[model-gateway] release 0.3.1 (#16254)
|
2026-01-08 17:49:37 -08:00 |
|
fzyzcjy
|
9e3a032ad6
|
[smg] cleanup router RAII guards (#16560)
|
2026-01-08 16:39:53 -08:00 |
|
Simo Lin
|
1bc7aa5801
|
[smg] update gRPC proto to match upstream changes (#16764)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2026-01-08 16:33:09 -08:00 |
|
Simo Lin
|
8726d30cb2
|
[smg] Add Nemotron Nano V3 reasoning parser support (#16763)
|
2026-01-08 16:29:24 -08:00 |
|
Simo Lin
|
ee71e773e1
|
[smg] Work around sglang's notorious orphan process problem (#16756)
|
2026-01-08 14:41:03 -08:00 |
|
Simo Lin
|
cf24232100
|
fix(e2e): prevent potential hangs in model pool subprocess handling (#16752)
|
2026-01-08 12:35:56 -08:00 |
|
Simo Lin
|
9d03af916a
|
[smg][ci] delete old chat completion integration tests and workflow step (#16751)
|
2026-01-08 11:31:54 -08:00 |
|
Simo Lin
|
49305fa1c1
|
[smg][ci] migrate function calling tests to new infrastructure (#16748)
|
2026-01-08 11:08:01 -08:00 |
|
Simo Lin
|
fbc24886dd
|
[smg][ci] migrate validation tests to new infrastructure (#16746)
|
2026-01-08 09:26:31 -08:00 |
|
Simo Lin
|
8a45a9c6a9
|
[smg][ci] fix model pool GPU cleanup and add startup reliability improvements (#16745)
|
2026-01-08 08:55:18 -08:00 |
|
Simo Lin
|
aecd5f5f3e
|
[smg][ci] migrate reasoning_content tests to new infrastructure (#16741)
|
2026-01-08 08:25:39 -08:00 |
|
Simo Lin
|
c8dc4d2d1f
|
[smg][ci] migrate enable_thinking tests to new infrastructure (#16739)
|
2026-01-08 06:57:45 -08:00 |
|
Simo Lin
|
f52ae586b6
|
Remove migrated e2e_grpc/basic tests (#16738)
|
2026-01-08 06:30:45 -08:00 |
|
Simo Lin
|
2f8a36347c
|
[smg][ci] migrate chat completions tests to new infrastructure and build wheel once and share via artifact (#16709)
|
2026-01-08 06:29:23 -08:00 |
|
Simo Lin
|
4c46ecde80
|
[smg][ci] delete old responses api ci (#16695)
|
2026-01-07 18:24:12 -08:00 |
|
Simo Lin
|
a08dc5aa10
|
[smg][ci] rename 3rd models from cloud backend and delete dead code (#16692)
|
2026-01-07 18:19:44 -08:00 |
|
Simo Lin
|
109fe03ad1
|
[smg][ci] Migrate Response API e2e tests to shared infrastructure (#16680)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2026-01-07 17:40:03 -08:00 |
|
Simo Lin
|
6037267f5b
|
[smg][ci] Add thread safety to ModelPool and GPUAllocator (#16674)
|
2026-01-07 13:25:41 -08:00 |
|
Simo Lin
|
7385834c8d
|
Add reference counting to ModelInstance for parallel test safety (#16672)
|
2026-01-07 08:28:15 -08:00 |
|
Ziwen Zhao
|
b5a94f8a8e
|
[model-gateway] Fix IGW routing for external OpenAI workers (#16633)
|
2026-01-07 08:15:23 -08:00 |
|
Simo Lin
|
c356ed03dd
|
refactor(e2e): unify RouterInstance into Gateway class, split conftest.py into modular fixtures (#16671)
|
2026-01-07 07:50:28 -08:00 |
|
Simo Lin
|
55b7936582
|
refactor(e2e_test): fix smg ci e2e test code quality (#16664)
|
2026-01-07 06:59:49 -08:00 |
|
Simo Lin
|
8729ad5e6c
|
fix(e2e_test): remove dead code and fix type annotations (#16661)
|
2026-01-07 06:35:15 -08:00 |
|
Simo Lin
|
e432057381
|
[smg][ci] preserve model launch order with test collected (#16618)
|
2026-01-07 06:16:59 -08:00 |
|
fzyzcjy
|
3be1e734ee
|
[model-gateway] extract header extraction in policy and add (#16566)
|
2026-01-06 20:18:44 -08:00 |
|
Simo Lin
|
d8b8198192
|
[smg][ci]: migrate benchmarks to e2e_test/benchmarks/, use parent conftest (#16597)
|
2026-01-06 20:15:20 -08:00 |
|
Chang Su
|
fb5b71d015
|
[router][openai] Rename prepare_mcp_payload_for_streaming and patch_streaming_response_json (#16596)
|
2026-01-06 16:33:29 -08:00 |
|
Chang Su
|
05b54b6d7b
|
[router][grpc] Replace Vec<(String, String, String)> with ExtractedToolCall (#16598)
|
2026-01-06 16:32:59 -08:00 |
|
Chang Su
|
4f443f445a
|
[model-gateway][cleanup] Fix wrong comment in manager.rs (#16601)
|
2026-01-06 16:32:37 -08:00 |
|
Simo Lin
|
dce8b0606c
|
refactor(e2e): keep only benchmark tests in e2e_http, remove redundant tests (#16594)
|
2026-01-06 15:05:08 -08:00 |
|