Simo Lin
|
fa51b85466
|
[model-gateway] convert workflow system to type-safe workflow data (#16970)
|
2026-01-12 10:06:36 -08:00 |
|
Simo Lin
|
d0092decb1
|
[model-gateway] Fix workflow engine race conditions and add graceful shutdown (#16963)
|
2026-01-12 06:37:39 -08:00 |
|
Wenyi Xu
|
c54c70ab62
|
[model-gateway] Improve Health Check Logging (#16930)
|
2026-01-11 23:01:29 -08:00 |
|
fzyzcjy
|
38b30c7b56
|
Tiny refactor age computation in router (#16850)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2026-01-11 21:42:43 -08:00 |
|
fzyzcjy
|
a1c48943d7
|
Tiny fix NoAvailableWorkers being a RetryError (#16896)
|
2026-01-11 18:53:17 -08:00 |
|
ybyang
|
503c3d9566
|
[model-gateway]: add qwen coder tool parser support xml format for qwen3 coder and microthinker (#12909)
|
2026-01-11 16:09:41 -08:00 |
|
Wenyi Xu
|
3c16c58619
|
[model-gateway] Add Redis support as a history backend (#16300)
|
2026-01-11 01:03:00 -08:00 |
|
Simo Lin
|
7c25687c9b
|
fix(gateway): rewrite gauge_histogram.rs for zero-allocation hot path (#16878)
|
2026-01-10 18:15:21 -08:00 |
|
fzyzcjy
|
1f9d4795a9
|
Tiny add gauge histogram abstraction for engine and router (#16848)
|
2026-01-10 11:45:25 +08:00 |
|
Praneth Paruchuri
|
bd1afeb568
|
[model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804)
|
2026-01-09 09:29:22 -08:00 |
|
Simo Lin
|
7460240737
|
[model-gateway] release 0.3.1 (#16254)
|
2026-01-08 17:49:37 -08:00 |
|
fzyzcjy
|
9e3a032ad6
|
[smg] cleanup router RAII guards (#16560)
|
2026-01-08 16:39:53 -08:00 |
|
Simo Lin
|
1bc7aa5801
|
[smg] update gRPC proto to match upstream changes (#16764)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2026-01-08 16:33:09 -08:00 |
|
Simo Lin
|
8726d30cb2
|
[smg] Add Nemotron Nano V3 reasoning parser support (#16763)
|
2026-01-08 16:29:24 -08:00 |
|
Simo Lin
|
ee71e773e1
|
[smg] Work around sglang's notorious orphan process problem (#16756)
|
2026-01-08 14:41:03 -08:00 |
|
Simo Lin
|
cf24232100
|
fix(e2e): prevent potential hangs in model pool subprocess handling (#16752)
|
2026-01-08 12:35:56 -08:00 |
|
Simo Lin
|
9d03af916a
|
[smg][ci] delete old chat completion integration tests and workflow step (#16751)
|
2026-01-08 11:31:54 -08:00 |
|
Simo Lin
|
49305fa1c1
|
[smg][ci] migrate function calling tests to new infrastructure (#16748)
|
2026-01-08 11:08:01 -08:00 |
|
Simo Lin
|
fbc24886dd
|
[smg][ci] migrate validation tests to new infrastructure (#16746)
|
2026-01-08 09:26:31 -08:00 |
|
Simo Lin
|
8a45a9c6a9
|
[smg][ci] fix model pool GPU cleanup and add startup reliability improvements (#16745)
|
2026-01-08 08:55:18 -08:00 |
|
Simo Lin
|
aecd5f5f3e
|
[smg][ci] migrate reasoning_content tests to new infrastructure (#16741)
|
2026-01-08 08:25:39 -08:00 |
|
Simo Lin
|
c8dc4d2d1f
|
[smg][ci] migrate enable_thinking tests to new infrastructure (#16739)
|
2026-01-08 06:57:45 -08:00 |
|
Simo Lin
|
f52ae586b6
|
Remove migrated e2e_grpc/basic tests (#16738)
|
2026-01-08 06:30:45 -08:00 |
|
Simo Lin
|
2f8a36347c
|
[smg][ci] migrate chat completions tests to new infrastructure and build wheel once and share via artifact (#16709)
|
2026-01-08 06:29:23 -08:00 |
|
Simo Lin
|
4c46ecde80
|
[smg][ci] delete old responses api ci (#16695)
|
2026-01-07 18:24:12 -08:00 |
|
Simo Lin
|
a08dc5aa10
|
[smg][ci] rename 3rd models from cloud backend and delete dead code (#16692)
|
2026-01-07 18:19:44 -08:00 |
|
Simo Lin
|
109fe03ad1
|
[smg][ci] Migrate Response API e2e tests to shared infrastructure (#16680)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2026-01-07 17:40:03 -08:00 |
|
Simo Lin
|
6037267f5b
|
[smg][ci] Add thread safety to ModelPool and GPUAllocator (#16674)
|
2026-01-07 13:25:41 -08:00 |
|
Simo Lin
|
7385834c8d
|
Add reference counting to ModelInstance for parallel test safety (#16672)
|
2026-01-07 08:28:15 -08:00 |
|
Ziwen Zhao
|
b5a94f8a8e
|
[model-gateway] Fix IGW routing for external OpenAI workers (#16633)
|
2026-01-07 08:15:23 -08:00 |
|
Simo Lin
|
c356ed03dd
|
refactor(e2e): unify RouterInstance into Gateway class, split conftest.py into modular fixtures (#16671)
|
2026-01-07 07:50:28 -08:00 |
|
Simo Lin
|
55b7936582
|
refactor(e2e_test): fix smg ci e2e test code quality (#16664)
|
2026-01-07 06:59:49 -08:00 |
|
Simo Lin
|
8729ad5e6c
|
fix(e2e_test): remove dead code and fix type annotations (#16661)
|
2026-01-07 06:35:15 -08:00 |
|
Simo Lin
|
e432057381
|
[smg][ci] preserve model launch order with test collected (#16618)
|
2026-01-07 06:16:59 -08:00 |
|
fzyzcjy
|
3be1e734ee
|
[model-gateway] extract header extraction in policy and add (#16566)
|
2026-01-06 20:18:44 -08:00 |
|
Simo Lin
|
d8b8198192
|
[smg][ci]: migrate benchmarks to e2e_test/benchmarks/, use parent conftest (#16597)
|
2026-01-06 20:15:20 -08:00 |
|
Chang Su
|
fb5b71d015
|
[router][openai] Rename prepare_mcp_payload_for_streaming and patch_streaming_response_json (#16596)
|
2026-01-06 16:33:29 -08:00 |
|
Chang Su
|
05b54b6d7b
|
[router][grpc] Replace Vec<(String, String, String)> with ExtractedToolCall (#16598)
|
2026-01-06 16:32:59 -08:00 |
|
Chang Su
|
4f443f445a
|
[model-gateway][cleanup] Fix wrong comment in manager.rs (#16601)
|
2026-01-06 16:32:37 -08:00 |
|
Simo Lin
|
dce8b0606c
|
refactor(e2e): keep only benchmark tests in e2e_http, remove redundant tests (#16594)
|
2026-01-06 15:05:08 -08:00 |
|
Simo Lin
|
d415d22daa
|
refactor(e2e): remove old embedding tests migrated to e2e_test/embeddings (#16592)
|
2026-01-06 14:07:45 -08:00 |
|
Simo Lin
|
a49b9a6420
|
[model-gateway] add embedding tests (#16583)
|
2026-01-06 13:24:37 -08:00 |
|
Simo Lin
|
d57d8e7e5f
|
[smg] clean up logs in mcp (should be info instead warn) (#16591)
|
2026-01-06 12:44:32 -08:00 |
|
Simo Lin
|
a3656cbb96
|
[ci] fix url strips in smg ci (#16548)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2026-01-06 09:23:58 -08:00 |
|
Chang Su
|
21da2dc1ce
|
[grpc] Unify ResponsesContext and HarmonyResponsesContext (#16549)
|
2026-01-06 07:28:06 -08:00 |
|
Chang Su
|
9bf76c11a9
|
[responses API] Add list_tools_for_servers and threading server_keys in routers (#16540)
|
2026-01-05 22:42:22 -08:00 |
|
Chang Su
|
4cf2bbd084
|
[router] Remove deadcode and add note for unused API completeness methods (#16528)
|
2026-01-05 19:53:28 -08:00 |
|
Simo Lin
|
402a0bd6dc
|
[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)
|
2026-01-05 18:28:07 -08:00 |
|
Chang Su
|
b98bd9a5fb
|
[model-gateway] Tighten visibility in modules and remove unused re-exports (#16524)
|
2026-01-05 17:38:50 -08:00 |
|
Simo Lin
|
4221b7c573
|
[model-gateway] refactor e2e test infrastructure and add router CI (#16513)
|
2026-01-05 13:50:59 -08:00 |
|