LLMClientRouter

Routes requests to available LLM clients.

Responsible for selecting which client should handle a request for a given model, based on factors like load distribution, availability, or health.

Properties

All clients that this router can use

Selects a client to handle the given model.