Simo Lin 402a0bd6dc [model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

..

benchmarks

[model-gateway][e2e_test]: Create directory structure and backends config (#16469)

2026-01-05 08:01:53 -08:00

chat_completions

[model-gateway][e2e_test]: Create directory structure and backends config (#16469)

2026-01-05 08:01:53 -08:00

e2e_grpc

…

e2e_http

…

e2e_response_api

…

embeddings

[model-gateway][e2e_test]: Create directory structure and backends config (#16469)

2026-01-05 08:01:53 -08:00

fixtures

[model-gateway] refactor e2e test infrastructure and add router CI (#16513)

2026-01-05 13:50:59 -08:00

infra

[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

router

[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

__init__.py

…

backends.py

[model-gateway] refactor e2e test infrastructure and add router CI (#16513)

2026-01-05 13:50:59 -08:00

conftest.py

[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

pyproject.toml

[model-gateway] refactor e2e test infrastructure and add router CI (#16513)

2026-01-05 13:50:59 -08:00

utils.py

[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00