FitPrompt
constructor(promptTokenizer: PromptTokenizer? = null, contextChunkSize: Long = 2048, minimumChunkCount: Long? = null, maximumChunkCount: Long? = null)(source)
Parameters
promptTokenizer
The PromptTokenizer to use for computing the prompt length, or null to use the last reported token usage.
contextChunkSize
The granularity to use for computing the context window length. Defaults to 2048.
minimumChunkCount
The minimum number of context chunks in the context.
maximumChunkCount
The maximum number of context chunks in the context.
Example: contextChunkSize = 512, minimumChunkCount = 2, maximumChunkCount = 4, then minimumContextLength = 1024 and maximumContextLength = 2048