RoutingLLMPromptExecutor

Parameters

clientRouter

Router responsible for selecting appropriate clients for each request

fallback

Optional fallback configuration when no client is available for the requested model


Creates executor with a map of providers to their client lists. Uses RoundRobinRouter for load distribution.

Parameters

llmClients

Map of providers to lists of clients for each provider

fallback

Optional fallback configuration


constructor(vararg llmClients: LLMClient, fallback: RoutingLLMPromptExecutor.FallbackPromptExecutorSettings? = null)(source)

Creates executor with a list of clients. Clients are grouped by provider and routed using RoundRobinRouter.

Parameters

llmClients

Vararg clients to use

fallback

Optional fallback configuration