promptTokenizer
Parameters
promptTokenizer
The PromptTokenizer to use for computing the prompt length, or null to use the last reported token usage.
The PromptTokenizer to use for computing the prompt length, or null to use the last reported token usage.