AIAgentLLMSession
Represents a session for an AI agent that interacts with an LLM (Language Learning Model). The session manages prompt execution, structured outputs, and tools integration.
This is a sealed class that provides common behavior and lifecycle management for derived types. It ensures that operations are only performed while the session is active and allows proper cleanup upon closure.
Inheritors
Properties
Represents the active response processor within the session. The processor defines the post-processing of messages returned from the LLM.
Provides a list of tools based on the current active state. This property holds a collection of ToolDescriptor instances, which describe the tools available for use.
Functions
Parses a structured response from the language model using the specified configuration.
Sends a request to the underlying LLM and returns the first response. This method ensures the session is active before executing the request.
Sends a request to the language model while enforcing the use of a specific tool, and returns the response.
Sends a request to the language model, potentially utilizing multiple tools, and returns a list of responses from the model.
Sends a request to the language model, potentially receiving multiple choices, and returns a list of choices from the model.
Sends a request to the language model that enforces the usage of tools and retrieves all responses.
Sends a request to the language model without utilizing any tools and returns multiple responses.
Sends a request to the language model that enforces the usage of tools and retrieves the response.
Sends a streaming request to the underlying LLM and returns the streamed response. This method ensures the session is active before executing the request.
Sends a request to LLM and gets a structured response.
Sends a request to the language model without utilizing any tools and returns the response.
Sends a moderation request to the specified or default large language model (LLM) for content moderation.