FilePromptCache
File-based implementation of PromptCache. This implementation stores cache entries in files on the file system.
Parameters
storage
The directory where cache files will be stored
maxFiles
The maximum number of files to store in the cache (default: 3000). When this limit is reached, the least recently accessed files will be removed.
Types
Functions
Link copied to clipboard
Link copied to clipboard
open suspend override fun put(prompt: Prompt, tools: List<ToolDescriptor>, response: List<Message.Response>)