tokenCountFor

open override fun tokenCountFor(message: Message): Int(source)

Computes the number of tokens in a given message.

The estimated number of tokens in the message content.

message

The message for which the token count needs to be calculated. The content of the message is analyzed to estimate the token count.

open override fun tokenCountFor(prompt: Prompt): Int(source)

Calculates the total number of tokens spent for the given prompt based on its messages.

The total number of tokens across all messages in the prompt.

prompt

The Prompt instance containing the list of messages for which the total token count will be calculated.