3 Commits

Author	SHA1	Message	Date
Simo Lin	402a0bd6dc	[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)	2026-01-05 18:28:07 -08:00
Simo Lin	4221b7c573	[model-gateway] refactor e2e test infrastructure and add router CI (#16513)	2026-01-05 13:50:59 -08:00
Simo Lin	7f6a678f8f	[model-gateway] add GPU allocator and model pool infrastructure for parallel E2E tests (#16460)	2026-01-04 23:30:32 -08:00