LLMClient
Common interface for direct communication with LLM providers. This interface defines methods for executing prompts and streaming responses.
Implements AutoCloseable as LLM clients typically work with IO resources. Always close it when finished.
Common interface for direct communication with LLM providers. This interface defines methods for executing prompts and streaming responses.
Implements AutoCloseable as LLM clients typically work with IO resources. Always close it when finished.
Common interface for direct communication with LLM providers. This interface defines methods for executing prompts and streaming responses.
Implements AutoCloseable as LLM clients typically work with IO resources. Always close it when finished.
Inheritors
Common interface for direct communication with LLM providers. This interface defines methods for executing prompts and streaming responses.
Implements AutoCloseable as LLM clients typically work with IO resources. Always close it when finished.
Common interface for direct communication with LLM providers. This interface defines methods for executing prompts and streaming responses.
Implements AutoCloseable as LLM clients typically work with IO resources. Always close it when finished.
Common interface for direct communication with LLM providers. This interface defines methods for executing prompts and streaming responses.
Implements AutoCloseable as LLM clients typically work with IO resources. Always close it when finished.
Constructors
Properties
Functions
Executes a prompt and returns a list of response messages.
Executes a prompt and returns a list of response messages.
Executes a prompt and returns a list of response messages.
Executes a prompt and returns a list of response messages.
Executes a prompt and returns a list of response messages.
Executes a prompt and returns a list of response messages.
Executes a prompt and returns a list of LLM choices.
Executes a prompt and returns a list of LLM choices.
Executes a prompt and returns a list of LLM choices.
Executes a prompt and returns a list of LLM choices.
Executes a prompt and returns a list of LLM choices.
Executes a prompt and returns a list of LLM choices.
Executes a prompt and returns a streaming flow of response chunks.
Executes a prompt and returns a streaming flow of response chunks.
Executes a prompt and returns a streaming flow of response chunks.
Executes a prompt and returns a streaming flow of response chunks.
Executes a prompt and returns a streaming flow of response chunks.
Executes a prompt and returns a streaming flow of response chunks.
Executes a given prompt using the specified language model (LLM) and tools, providing the results as a synchronous stream of StreamFrame objects.
Basic JSON schema generator supported by the LLMClient. Return BasicJsonSchemaGenerator by default.
Basic JSON schema generator supported by the LLMClient. Return BasicJsonSchemaGenerator by default.
Basic JSON schema generator supported by the LLMClient. Return BasicJsonSchemaGenerator by default.
Basic JSON schema generator supported by the LLMClient. Return BasicJsonSchemaGenerator by default.
Basic JSON schema generator supported by the LLMClient. Return BasicJsonSchemaGenerator by default.
Basic JSON schema generator supported by the LLMClient. Return BasicJsonSchemaGenerator by default.
Standard JSON schema generator supported by the LLMClient. Return StandardJsonSchemaGenerator by default.
Standard JSON schema generator supported by the LLMClient. Return StandardJsonSchemaGenerator by default.
Standard JSON schema generator supported by the LLMClient. Return StandardJsonSchemaGenerator by default.
Standard JSON schema generator supported by the LLMClient. Return StandardJsonSchemaGenerator by default.
Standard JSON schema generator supported by the LLMClient. Return StandardJsonSchemaGenerator by default.
Standard JSON schema generator supported by the LLMClient. Return StandardJsonSchemaGenerator by default.
Retrieves the LLMProvider instance associated with this client.
Retrieves the LLMProvider instance associated with this client.
Retrieves the LLMProvider instance associated with this client.
Retrieves the LLMProvider instance associated with this client.
Retrieves the LLMProvider instance associated with this client.
Retrieves the LLMProvider instance associated with this client.
Retrieves a list of ids of available Large Language Models (LLMs) supported by the client.
Retrieves a list of ids of available Large Language Models (LLMs) supported by the client.
Retrieves a list of ids of available Large Language Models (LLMs) supported by the client.
Retrieves a list of ids of available Large Language Models (LLMs) supported by the client.
Retrieves a list of ids of available Large Language Models (LLMs) supported by the client.
Analyzes the provided prompt for violations of content policies or other moderation criteria.
Analyzes the provided prompt for violations of content policies or other moderation criteria.
Analyzes the provided prompt for violations of content policies or other moderation criteria.
Analyzes the provided prompt for violations of content policies or other moderation criteria.
Analyzes the provided prompt for violations of content policies or other moderation criteria.
Analyzes the provided prompt for violations of content policies or other moderation criteria.
Converts an instance of LLMClient into a retrying client with customizable retry behavior.