AIAgentLLMSessionAPI

Config of the agent running the session.

Represents the active language model used within the session.

Represents the current prompt associated with the LLM session. The prompt contains the input messages, model configuration, and parameters.

Represents the active response processor within the session. The processor defines the post-processing of messages returned from the LLM.

Provides a list of tools based on the current active state. This property holds a collection of ToolDescriptor instances, which describe the tools available for use.

Parses a structured response from the language model using the specified configuration.

Sends a request to the underlying LLM and returns the first response. This method ensures the session is active before executing the request.

Sends a request to the language model while enforcing the use of a specific tool, and returns the response.

Sends a request to the language model, potentially utilizing multiple tools, and returns a list of responses from the model.

Sends a request to the language model, potentially receiving multiple choices, and returns a list of choices from the model.

Sends a request to the language model that enforces the usage of tools and retrieves all responses.

Sends a request to the language model without utilizing any tools and returns multiple responses.

Sends a request to the language model that enforces the usage of tools and retrieves the response.

Sends a streaming request to the underlying LLM and returns the streamed response. This method ensures the session is active before executing the request.

Sends a request to LLM and gets a structured response.

Sends a request to the language model without utilizing any tools and returns the response.

Sends a moderation request to the specified or default large language model (LLM) for content moderation.