LLMParams
Represents configuration parameters for controlling the behavior of a language model.
Constructors
Types
Properties
Additional properties that can be used to store custom parameters.
If true, requests the model to add reasoning blocks to the response. Defaults to null. When set to true, responses may include detailed reasoning steps. When false or null, responses are typically shorter and faster.
Specifies the number of alternative completions to generate.
Defines the structure for the model's structured response format.
Reserved for speculative proposition of how result would look like, supported only by a number of models, but may greatly improve speed and accuracy of result. For example, in OpenAI that feature is called PredictedOutput
A parameter to control the randomness in the output. Higher values encourage more diverse results, while lower values produce deterministically focused outputs. The value is optional and defaults to null.
Hard cap for reasoning tokens. Ignored by models that don't support budgets. This can be used to limit the amount of tokens used for reasoning when includeThoughts is enabled.
Used to switch tool calling behavior of LLM.
Functions
Retrieves the value of the temperature as a nullable Double. This function is typically used in destructuring declarations.
Provides the second component of the object, corresponding to maxTokens.
Retrieves the third component of the data structure, representing the number of choices.
Retrieves the fourth component of the data structure.
Provides the fifth component of the data structure, represented by the schema property.
Retrieves the sixth component of a destructured object, which represents a tool choice.
Retrieves the seventh component of the data class, typically used for destructuring declarations.
Retrieves the eighth component of the data class, typically used for destructuring declarations.
Provides the ninth component of a destructured object, specifically the thinking budget.
Creates a copy of this instance with the ability to modify any of its properties.