Commit Graph

30 Commits

Author SHA1 Message Date
Ziwen Zhao
cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
Simo Lin
ee71e773e1 [smg] Work around sglang's notorious orphan process problem (#16756) 2026-01-08 14:41:03 -08:00
Simo Lin
cf24232100 fix(e2e): prevent potential hangs in model pool subprocess handling (#16752) 2026-01-08 12:35:56 -08:00
Simo Lin
9d03af916a [smg][ci] delete old chat completion integration tests and workflow step (#16751) 2026-01-08 11:31:54 -08:00
Simo Lin
49305fa1c1 [smg][ci] migrate function calling tests to new infrastructure (#16748) 2026-01-08 11:08:01 -08:00
Simo Lin
fbc24886dd [smg][ci] migrate validation tests to new infrastructure (#16746) 2026-01-08 09:26:31 -08:00
Simo Lin
8a45a9c6a9 [smg][ci] fix model pool GPU cleanup and add startup reliability improvements (#16745) 2026-01-08 08:55:18 -08:00
Simo Lin
aecd5f5f3e [smg][ci] migrate reasoning_content tests to new infrastructure (#16741) 2026-01-08 08:25:39 -08:00
Simo Lin
c8dc4d2d1f [smg][ci] migrate enable_thinking tests to new infrastructure (#16739) 2026-01-08 06:57:45 -08:00
Simo Lin
f52ae586b6 Remove migrated e2e_grpc/basic tests (#16738) 2026-01-08 06:30:45 -08:00
Simo Lin
2f8a36347c [smg][ci] migrate chat completions tests to new infrastructure and build wheel once and share via artifact (#16709) 2026-01-08 06:29:23 -08:00
Simo Lin
4c46ecde80 [smg][ci] delete old responses api ci (#16695) 2026-01-07 18:24:12 -08:00
Simo Lin
a08dc5aa10 [smg][ci] rename 3rd models from cloud backend and delete dead code (#16692) 2026-01-07 18:19:44 -08:00
Simo Lin
109fe03ad1 [smg][ci] Migrate Response API e2e tests to shared infrastructure (#16680)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: key4ng <rukeyang@gmail.com>
2026-01-07 17:40:03 -08:00
Simo Lin
6037267f5b [smg][ci] Add thread safety to ModelPool and GPUAllocator (#16674) 2026-01-07 13:25:41 -08:00
Simo Lin
7385834c8d Add reference counting to ModelInstance for parallel test safety (#16672) 2026-01-07 08:28:15 -08:00
Simo Lin
c356ed03dd refactor(e2e): unify RouterInstance into Gateway class, split conftest.py into modular fixtures (#16671) 2026-01-07 07:50:28 -08:00
Simo Lin
55b7936582 refactor(e2e_test): fix smg ci e2e test code quality (#16664) 2026-01-07 06:59:49 -08:00
Simo Lin
8729ad5e6c fix(e2e_test): remove dead code and fix type annotations (#16661) 2026-01-07 06:35:15 -08:00
Simo Lin
e432057381 [smg][ci] preserve model launch order with test collected (#16618) 2026-01-07 06:16:59 -08:00
Simo Lin
d8b8198192 [smg][ci]: migrate benchmarks to e2e_test/benchmarks/, use parent conftest (#16597) 2026-01-06 20:15:20 -08:00
Simo Lin
dce8b0606c refactor(e2e): keep only benchmark tests in e2e_http, remove redundant tests (#16594) 2026-01-06 15:05:08 -08:00
Simo Lin
d415d22daa refactor(e2e): remove old embedding tests migrated to e2e_test/embeddings (#16592) 2026-01-06 14:07:45 -08:00
Simo Lin
a49b9a6420 [model-gateway] add embedding tests (#16583) 2026-01-06 13:24:37 -08:00
Simo Lin
a3656cbb96 [ci] fix url strips in smg ci (#16548)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2026-01-06 09:23:58 -08:00
Simo Lin
402a0bd6dc [model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525) 2026-01-05 18:28:07 -08:00
Simo Lin
4221b7c573 [model-gateway] refactor e2e test infrastructure and add router CI (#16513) 2026-01-05 13:50:59 -08:00
Simo Lin
2b4d6d813b [model-gateway][e2e_test]: Create directory structure and backends config (#16469) 2026-01-05 08:01:53 -08:00
Simo Lin
7f6a678f8f [model-gateway] add GPU allocator and model pool infrastructure for parallel E2E tests (#16460) 2026-01-04 23:30:32 -08:00
Simo Lin
e6fe092dcc [model-gateway] rename py_test to e2e_test (#16454) 2026-01-04 22:24:34 -08:00