AIAgentLLMReadSession
Represents a session for interacting with a language model (LLM) in a read-only context within an AI agent setup.
JVM actual implementation of a read-only LLM session.
In addition to common suspend APIs, this class exposes Java-friendly wrappers that run session operations on the strategy dispatcher.
Represents a session for interacting with a language model (LLM) in a read-only context within an AI agent setup.
Constructors
Properties
Config of the agent running the session.
Config of the agent running the session.
Config of the agent running the session.
Represents the current prompt associated with the LLM session. The prompt contains the input messages, model configuration, and parameters.
Represents the current prompt associated with the LLM session. The prompt contains the input messages, model configuration, and parameters.
Represents the active response processor within the session.
Represents the active response processor within the session.
Represents the active response processor within the session.
Provides a list of available tools in the session.
Provides a list of available tools in the session.
Provides a list of available tools in the session.
Functions
Executes a request for the provided prompt and tools and returns all response messages.
Executes multiple tasks or requests associated with the given Prompt and ToolDescriptor list.
Executes a request for the provided prompt and tools and returns all response messages.
Executes a request for the provided prompt and tools and returns all response messages.
Executes a request for the provided prompt and tools and returns the first response.
Executes a single task or request associated with the given Prompt and ToolDescriptor list.
Executes a request for the provided prompt and tools and returns the first response.
Executes a request for the provided prompt and tools and returns the first response.
Executes a streaming request for the provided prompt and tools.
Executes a streaming request for the provided prompt and tools.
Executes a streaming request for the provided prompt and tools.
Parses a structured response from a language model message using the specified configuration.
Parses an assistant response into a strongly typed StructuredResponse according to the given configuration.
Parses a structured response from a language model message using the specified configuration.
Parses a structured response from a language model message using the specified configuration.
Sends a request to the underlying LLM and returns the first non-reasoning response.
Sends a request to the language model using the current session configuration and returns a single response.
Sends a request to the underlying LLM and returns the first non-reasoning response.
Sends a request to the underlying LLM and returns the first non-reasoning response.
Sends a request to the language model while enforcing the use of a specific tool.
Sends a request to the language model and forces it to use exactly one specific tool instance.
Sends a request to the language model and forces it to use exactly one specific tool, identified by a ToolDescriptor.
Sends a request to the language model while enforcing the use of a specific tool.
Sends a request to the language model while enforcing the use of a specific tool.
Sends a request to the language model and returns all response messages.
Sends a request to the language model and returns multiple responses.
Sends a request to the language model and returns all response messages.
Sends a request to the language model and returns all response messages.
Sends a request to the language model and returns all available response choices.
Sends a request to the language model and returns multiple choice alternatives.
Sends a request to the language model and returns all available response choices.
Sends a request to the language model and returns all available response choices.
Sends a request to the language model that enforces the usage of tools and retrieves all responses.
Sends a request to the language model that enforces the usage of tools and retrieves all responses.
Sends a request to the language model that enforces the usage of tools and retrieves all responses.
Sends a request to the language model without utilizing any tools and returns multiple responses.
Sends a request to the language model without utilizing any tools and returns multiple responses.
Sends a request to the language model without utilizing any tools and returns multiple responses.
Sends a request to the language model that enforces the usage of tools and retrieves the response.
Sends a request to the language model that is allowed to only perform tool calls without generating a regular text response.
Sends a request to the language model that enforces the usage of tools and retrieves the response.
Sends a request to the language model that enforces the usage of tools and retrieves the response.
Sends a streaming request to the underlying LLM and returns the streamed response.
Sends a request to the language model and returns a streaming response as a Flow of StreamFrame.
Sends a streaming request to the underlying LLM and returns the streamed response.
Sends a streaming request to the underlying LLM and returns the streamed response.
Sends a request to LLM and gets a structured response.
Requests a structured response from the language model using a reified serializer.
Sends a structured request to the language model using a StructuredRequestConfig.
Sends a structured request to the language model using an explicit serializer and example values.
Sends a request to LLM and gets a structured response.
Requests a structured response from the language model using a reified serializer.
Sends a request to LLM and gets a structured response.
Requests a structured response from the language model using a reified serializer.
Sends a request to the language model without utilizing any tools and returns the response.
Sends a request to the language model without utilizing any tools and returns a single response.
Sends a request to the language model without utilizing any tools and returns the response.
Sends a request to the language model without utilizing any tools and returns the response.
Sends a moderation request to the specified or default model.
Sends a moderation request to the moderation model.
Sends a moderation request to the specified or default model.
Sends a moderation request to the specified or default model.