install
Installs the MessageTokenizer feature into the given AI Agent pipeline.
Configures and initializes the appropriate tokenizer (caching or on-demand) based on the provided configuration, and registers the MessageTokenizer feature into the pipeline.
Parameters
config
The configuration used to customize the MessageTokenizer feature, including tokenizer settings and caching options.
pipeline
The AI Agent pipeline where the MessageTokenizer feature will be installed.