MessageTokenizerConfig

Configuration class for message tokenization settings.

Constructors

Link copied to clipboard
constructor()

Properties

Link copied to clipboard

Indicates whether caching is enabled for tokenization processes.

Link copied to clipboard
Link copied to clipboard

The tokenizer property determines the strategy used for tokenizing text and estimating token counts within a message-processing feature.

Functions

Link copied to clipboard
Link copied to clipboard