LlamaStreamChunk

data class LlamaStreamChunk(val generation: String? = null, val promptTokenCount: Int? = null, val generationTokenCount: Int? = null, val stopReason: String? = null)(source)

Streaming chunk structure for Meta Llama models

Constructors

Link copied to clipboard
constructor(generation: String? = null, promptTokenCount: Int? = null, generationTokenCount: Int? = null, stopReason: String? = null)

Properties

Link copied to clipboard
@SerialName(value = "generation")
val generation: String? = null
Link copied to clipboard
@SerialName(value = "generation_token_count")
val generationTokenCount: Int? = null
Link copied to clipboard
@SerialName(value = "prompt_token_count")
val promptTokenCount: Int? = null
Link copied to clipboard
@SerialName(value = "stop_reason")
val stopReason: String? = null