Ratish P f02d82211a [model-gateway]: move PD configuration conflict checks to model gateway (#16088)

2026-01-05 14:16:07 +08:00

..

steps

[model-gateway]: move PD configuration conflict checks to model gateway (#16088)

2026-01-05 14:16:07 +08:00

circuit_breaker.rs

[model-gateway] optimize worker registry and reduce lock contention in grpc client fetch (#15336)

2025-12-17 08:49:10 -10:00

error.rs

refactor(core): use thiserror for WorkerError (#16315)

2026-01-02 15:33:07 -08:00

job_queue.rs

[model-gateway] Add tokenize/detokenize HTTP endpoints and tokenizer management (#15702)

2025-12-23 17:32:07 -08:00

metrics_aggregator.rs

[model-gateway] code clean up in tokenizer register step workflow (#16316)

2026-01-02 16:05:10 -08:00

mod.rs

[model-gateway] Add consistent hashing for ManualPolicy routing (#15907)

2025-12-26 22:53:03 -08:00

model_card.rs

[model-gateway] bug fix on module name (#16332)

2026-01-02 21:56:18 -08:00

model_type.rs

…

retry.rs

refactor(core): use idiomatic .min() in calculate_delay (#16314)

2026-01-02 15:46:13 -08:00

token_bucket.rs

[model-gateway] improve lock contention and allocation in middleware (#16405)

2026-01-04 10:40:07 -08:00

worker_builder.rs

[model-gateway] add back router worker health metric and fix init state (#15622)

2025-12-23 18:50:38 -08:00

worker_manager.rs

[model-gateway] refactor WorkerManager with fan_out helper and thin handlers (#15583)

2025-12-21 15:29:37 -08:00

worker_registry.rs

refactor(core): remove get_by_model_fast alias in worker_registry (#16313)

2026-01-02 16:04:23 -08:00

worker_service.rs

[model-gateway] add WorkerService abstraction for worker business logic (#15580)

2025-12-21 14:35:35 -08:00

worker.rs

chore(core): remove unused serde_json import in worker.rs (#16312)

2026-01-02 15:31:41 -08:00