AIAgentLLMReadSession
Represents a session for interacting with a language model (LLM) in a read-only context within an AI agent setup.
JVM actual implementation of a read-only LLM session.
In addition to common suspend APIs, this class exposes Java-friendly wrappers that run session operations on the strategy dispatcher.
Represents a session for interacting with a language model (LLM) in a read-only context within an AI agent setup.
Constructors
Properties
Config of the agent running the session.
Config of the agent running the session.
Config of the agent running the session.
Represents the current prompt associated with the LLM session. The prompt contains the input messages, model configuration, and parameters.
Represents the current prompt associated with the LLM session. The prompt contains the input messages, model configuration, and parameters.
Represents the active response processor within the session.
Represents the active response processor within the session.
Represents the active response processor within the session.
Provides a list of available tools in the session.
Provides a list of available tools in the session.
Provides a list of available tools in the session.
Functions
Parses a structured response from a language model message using the specified configuration.
Parses a structured response from a language model message using the specified configuration.
Parses a structured response from a language model message using the specified configuration.
Sends a request to the underlying LLM and returns the first non-reasoning response.
Sends a request to the underlying LLM and returns the first non-reasoning response.
Sends a request to the underlying LLM and returns the first non-reasoning response.
Sends a request to the language model while enforcing the use of a specific tool.
Sends a request to the language model while enforcing the use of a specific tool.
Sends a request to the language model while enforcing the use of a specific tool.
Sends a request to the language model and returns all available response choices.
Sends a request to the language model and returns all available response choices.
Sends a request to the language model and returns all available response choices.
Sends a request to the language model that enforces the usage of tools and retrieves all responses.
Sends a request to the language model that enforces the usage of tools and retrieves all responses.
Sends a request to the language model that enforces the usage of tools and retrieves all responses.
Sends a streaming request to the underlying LLM and returns the streamed response.
Sends a streaming request to the underlying LLM and returns the streamed response.
Sends a streaming request to the underlying LLM and returns the streamed response.
Sends a request to LLM and gets a structured response.
Requests a structured response from the language model using a reified serializer.
Sends a request to LLM and gets a structured response.
Requests a structured response from the language model using a reified serializer.
Sends a request to LLM and gets a structured response.
Requests a structured response from the language model using a reified serializer.
Sends a request to the language model without utilizing any tools and returns multiple responses.
Sends a request to the language model without utilizing any tools and returns multiple responses.
Sends a request to the language model without utilizing any tools and returns multiple responses.
Sends a moderation request to the specified or default model.
Sends a moderation request to the specified or default model.
Sends a moderation request to the specified or default model.