prompt-executor-bedrock-client/ai.koog.prompt.executor.clients.bedrock/BedrockLLMClient

BedrockLLMClient

class BedrockLLMClient @JvmOverloads constructor(bedrockClient: BedrockRuntimeClient, apiMethod: BedrockAPIMethod = BedrockAPIMethod.InvokeModel, moderationGuardrailsSettings: BedrockGuardrailsSettings? = null, fallbackModelFamily: BedrockModelFamilies? = null, clock: Clock = kotlin.time.Clock.System) : LLMClient, LLMEmbeddingProvider(source)

Creates a new Bedrock LLM client configured with the specified AWS credentials and settings.

Return

A configured LLMClient instance for Bedrock

Parameters

bedrockClient

The runtime client for interacting with Bedrock, highly configurable

apiMethod

The API method to use for interacting with Bedrock models that support messages, defaults to BedrockAPIMethod.InvokeModel.

moderationGuardrailsSettings

Optional settings of the AWS bedrock Guardrails (see AWS documentation ) that would be used for the LLMClient.moderate request

fallbackModelFamily

Optional fallback model family to use for unsupported models. If not provided, unsupported models will throw an exception.

clock

A clock used for time-based operations

Constructors

BedrockLLMClient

@JvmOverloads

constructor(bedrockClient: BedrockRuntimeClient, apiMethod: BedrockAPIMethod = BedrockAPIMethod.InvokeModel, moderationGuardrailsSettings: BedrockGuardrailsSettings? = null, fallbackModelFamily: BedrockModelFamilies? = null, clock: Clock = kotlin.time.Clock.System)

constructor(identityProvider: IdentityProvider, settings: BedrockClientSettings = BedrockClientSettings(), clock: Clock = kotlin.time.Clock.System)

Creates a new Bedrock LLM client configured with the specified identity provider and settings.

Properties

clientName

open val clientName: String

Functions

open override fun close()

embed

open suspend override fun embed(text: String, model: LLModel): List<Double>

execute

open suspend override fun execute(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor>): List<Message.Response>

executeMultipleChoices

open suspend fun executeMultipleChoices(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor>): List<LLMChoice>

executeStreaming

open override fun executeStreaming(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor>): Flow<StreamFrame>

llmProvider

open override fun llmProvider(): LLMProvider

models

open suspend fun models(): List<LLModel>

moderate

open suspend override fun moderate(prompt: Prompt, model: LLModel): ModerationResult

Moderates the provided prompt using AWS Bedrock Guardrails.