prompt-cache-model/ai.koog.prompt.cache.memory/InMemoryPromptCache

InMemoryPromptCache

class InMemoryPromptCache(maxEntries: Int?) : PromptCache(source)

In-memory implementation of PromptCache. This implementation stores cache entries in memory.

Constructors

InMemoryPromptCache

constructor(maxEntries: Int?)

Types

Companion

object Companion : PromptCache.Factory.Named

A companion object implementation of the PromptCache.Factory.Named specialized for an in-memory prompt cache. This factory is responsible for creating instances of InMemoryPromptCache based on a specific configuration string.

Functions

get

open suspend override fun get(request: PromptCache.Request): List<Message.Response>?

Get a cached response for a request, or null if not cached.

get

suspend fun PromptCache.get(prompt: Prompt, tools: List<ToolDescriptor>, clock: Clock = Clock.System): List<Message.Response>?

Get a cached response for a prompt with tools, or null if not cached.

put

open suspend override fun put(request: PromptCache.Request, response: List<Message.Response>)

Put a response in the cache for a request.

put

suspend fun PromptCache.put(prompt: Prompt, tools: List<ToolDescriptor>, response: List<Message.Response>)

Put a response in the cache for a prompt with tools.