prompt-cache-model/ai.koog.prompt.cache.memory/InMemoryPromptCache

InMemoryPromptCache

class InMemoryPromptCache(maxEntries: Int?) : PromptCache(source)

In-memory implementation of PromptCache. This implementation stores cache entries in memory.

Constructors

Link copied to clipboard
constructor(maxEntries: Int?)

Types

Link copied to clipboard

Functions

Link copied to clipboard
open suspend override fun get(prompt: Prompt, tools: List<ToolDescriptor>): List<Message.Response>?

Get a cached response for a prompt with tools, or null if not cached.

Link copied to clipboard
open suspend override fun put(prompt: Prompt, tools: List<ToolDescriptor>, response: List<Message.Response>)

Put a response in the cache for a prompt with tools.