PromptExecutorAPI

Functions

expect abstract fun close()

abstract suspend fun execute(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor> = emptyList()): List<Message.Response>

Executes a given prompt using the specified LLM and tools, returning a list of responses from the model.

Receives multiple independent choices from the LLM. The method is implemented only for some specific providers which support multiple LLM choices.

Executes a given prompt using the specified LLM and returns a stream of output as a flow of StreamFrame objects.

Basic JSON schema generator required for the given model. Return BasicJsonSchemaGenerator by default.

Standard JSON schema generator required for the given model. Return StandardJsonSchemaGenerator by default.

open suspend fun models(): List<LLModel>

Retrieves a list of available models from all LLM clients managed by this executor.

abstract suspend fun moderate(prompt: Prompt, model: LLModel): ModerationResult

Moderates the content of a given message with attachments using a specified LLM.