Simo Lin 402a0bd6dc [model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

..

__init__.py

[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

constants.py

[model-gateway] refactor e2e test infrastructure and add router CI (#16513)

2026-01-05 13:50:59 -08:00

gateway.py

[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

gpu_allocator.py

[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

model_pool.py

[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

model_specs.py

…

process_utils.py

[model-gateway] refactor e2e test infrastructure and add router CI (#16513)

2026-01-05 13:50:59 -08:00

run_eval.py

[model-gateway] refactor e2e test infrastructure and add router CI (#16513)

2026-01-05 13:50:59 -08:00

simple_eval_common.py

[model-gateway] Add model scope support and LRU eviction for GPU-constrained environments (#16525)

2026-01-05 18:28:07 -08:00

simple_eval_mmlu.py

[model-gateway] refactor e2e test infrastructure and add router CI (#16513)

2026-01-05 13:50:59 -08:00