PromptTokensDetails

class PromptTokensDetails(val audioTokens: Int? = null, val cachedTokens: Int? = null)(source)

Constructors

Link copied to clipboard
constructor(audioTokens: Int? = null, cachedTokens: Int? = null)

Properties

Link copied to clipboard

Audio input tokens generated by the model.

Link copied to clipboard

Cached tokens present in the prompt.