NoTokenizer
A tokenizer implementation that always returns 0.
This is useful when token counting is not needed or when you want to save computational resources by skipping token counting.
A tokenizer implementation that always returns 0.
This is useful when token counting is not needed or when you want to save computational resources by skipping token counting.