tokenizer
Provides access to the PromptTokenizer instance provided by the MessageTokenizer.Feature and used within the AI agent's context.
Provides access to the PromptTokenizer instance provided by the MessageTokenizer.Feature and used within the AI agent's context.