prompt-executor-model/ai.koog.prompt.executor.llms

Package-level declarations

Types

ExperimentalRoutingApi

annotation class ExperimentalRoutingApi

Marks an API as part of the experimental routing and load balancing layer for LLM clients.

LLMClientRouter

interface LLMClientRouter

Routes requests to available LLM clients.

MultiLLMPromptExecutor

open class MultiLLMPromptExecutor @JvmOverloads constructor(llmClients: Map<LLMProvider, LLMClient>, fallback: MultiLLMPromptExecutor.FallbackPromptExecutorSettings? = null) : PromptExecutor

MultiLLMPromptExecutor is a class responsible for executing prompts across multiple Large Language Models (LLMs). This implementation supports direct execution with specific LLM clients or utilizes a fallback strategy if no primary LLM client is available for the requested provider.

RoundRobinRouter

class RoundRobinRouter(clientsPerProvider: Map<LLMProvider, List<LLMClient>>) : LLMClientRouter

Distributes requests across clients in sequential rotation, ensuring even load distribution.

RoutingLLMPromptExecutor

open class RoutingLLMPromptExecutor @JvmOverloads constructor(clientRouter: LLMClientRouter, fallback: RoutingLLMPromptExecutor.FallbackPromptExecutorSettings? = null) : PromptExecutor

Executes prompts with load balancing across multiple LLM clients.

SingleLLMPromptExecutor

open class ~~SingleLLMPromptExecutor~~(llmClient: LLMClient) : PromptExecutor

Executes prompts using a direct client for communication with large language model (LLM) providers.