LLMClientAPI

Properties

The name of the client.

expect abstract fun close()

abstract suspend fun execute(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor> = emptyList()): List<Message.Response>

Executes a prompt and returns a list of response messages.

Executes a prompt and returns a list of LLM choices.

Executes a prompt and returns a streaming flow of response chunks.

Basic JSON schema generator supported by the LLMClient. Return BasicJsonSchemaGenerator by default.

Standard JSON schema generator supported by the LLMClient. Return StandardJsonSchemaGenerator by default.

Retrieves the LLMProvider instance associated with this client.

open suspend fun models(): List<LLModel>

Retrieves a list of ids of available Large Language Models (LLMs) supported by the client.

abstract suspend fun moderate(prompt: Prompt, model: LLModel): ModerationResult

Analyzes the provided prompt for violations of content policies or other moderation criteria.