agents-features-tokenizer/ai.koog.agents.features.tokenizer.feature/CachingTokenizer/CachingTokenizer

CachingTokenizer

constructor(tokenizer: Tokenizer)(source)

Creates an instance of CachingTokenizer with a provided Tokenizer instance that performs the actual token counting.