Package-level declarations

Types

Link copied to clipboard
data class LlamaRequest(val prompt: String, val maxGenLen: Int = 2048, val temperature: Double? = null)

Request structure for Meta Llama models

Link copied to clipboard
data class LlamaResponse(val generation: String, val promptTokenCount: Int? = null, val generationTokenCount: Int? = null, val stopReason: String? = null)

Response structure for Meta Llama models

Link copied to clipboard
data class LlamaStreamChunk(val generation: String? = null)

Streaming chunk structure for Meta Llama models