LLMParams

Represents a schema for the structured response.

Used to switch tool calling behavior of LLM

Additional properties that can be used to store custom parameters.

Maximum number of tokens to generate in the response.

Specifies the number of alternative completions to generate.

Defines the structure for the model's structured response format.

Reserved for speculative proposition of how result would look like, supported only by a number of models, but may greatly improve speed and accuracy of result. For example, in OpenAI that feature is called PredictedOutput

A parameter to control the randomness in the output. Higher values encourage more diverse results, while lower values produce deterministically focused outputs. The value is optional and defaults to null.

Used to switch tool calling behavior of LLM.

An optional identifier for the user making the request, which can be used for tracking purposes.

Retrieves the value of the temperature as a nullable Double. This function is typically used in destructuring declarations.

Provides the second component of the object, corresponding to maxTokens.

Retrieves the third component of the data structure, representing the number of choices.

Retrieves the fourth component of the data structure.

Provides the fifth component of the data structure, represented by the schema property.

Retrieves the sixth component of a destructured object, which represents a tool choice.

Retrieves the seventh component of the data class, typically used for destructuring declarations.

Creates a copy of this instance with the ability to modify any of its properties.

Combines the parameters of the current LLMParams instance with the provided default LLMParams to produce a new instance. Fields that are null in the current instance are replaced by the corresponding fields from the default instance.