Package-level declarations

Types

Link copied to clipboard
data class ConnectionTimeoutConfig(val requestTimeoutMillis: Long = DEFAULT_TIMEOUT_MS, val connectTimeoutMillis: Long = DEFAULT_CONNECT_TIMEOUT_MS, val socketTimeoutMillis: Long = DEFAULT_TIMEOUT_MS)

ConnectionTimeoutConfig is a configuration class for specifying timeout values for network connections in milliseconds. It includes configurable timeouts for requests, connection establishment, and socket operations.

Link copied to clipboard
interface LLMClient

Common interface for direct communication with LLM providers. This interface defines methods for executing prompts and streaming responses.

Link copied to clipboard

Extension of the LLMClient interface which includes functionality for generating text embeddings in addition to executing prompts and streaming outputs.

Link copied to clipboard

Interface defining and managing configurations or metadata for supported Large Language Models (LLMs). This serves as a contract for providing LLM-specific definitions, capabilities, and configurations that are needed during interactions with LLM providers. Typically, implementations of this interface represent contextual information about various LLMs.

Functions

Link copied to clipboard

Retrieves all public properties of the specified object and nested objects that are of type LLModel and returns them as a list.

Link copied to clipboard

Retrieves a list of all LLModel instances defined within the current LLModelDefinitions.