OpenAIBaseLLMRequest

Base interface for LLM OpenAI API requests. Contains properties that are common across all supported LLM providers.

Properties

Link copied to clipboard
abstract val model: String?

The model to use for generating a response.

Link copied to clipboard
abstract val stream: Boolean?

The stream output enabler.

Link copied to clipboard
abstract val temperature: Double?

The temperature parameter for controlling randomness in the output.

Link copied to clipboard
abstract val topLogprobs: Int?

The number of alternatives per position.

Link copied to clipboard
abstract val topP: Double?

The top probability threshold.