Package-level declarations
Types
Link copied to clipboard
data class LlamaRequest(val prompt: String, val maxGenLen: Int = 2048, val temperature: Double? = null)
Request structure for Meta Llama models
Link copied to clipboard
data class LlamaResponse(val generation: String, val promptTokenCount: Int? = null, val generationTokenCount: Int? = null, val stopReason: String? = null)
Response structure for Meta Llama models
Link copied to clipboard
Streaming chunk structure for Meta Llama models