RedisPromptCache

class RedisPromptCache(client: RedisClient, prefix: String, ttl: Duration) : PromptCache(source)

Redis-based implementation of PromptCache. This implementation stores cache entries in a Redis database.

client

The Redis client to use for connecting to Redis

Constructors

constructor(client: RedisClient, prefix: String, ttl: Duration)

Java-compatible constructor that accepts java.time.Duration for the TTL parameter.

Companion object for the RedisPromptCache class, functioning as a factory for creating Redis-backed implementations of the PromptCache interface.

fun close()

Closes the Redis connection. This method should be called when the cache is no longer needed.

open suspend override fun get(request: PromptCache.Request): Message.Assistant?

open suspend override fun put(request: PromptCache.Request, response: Message.Assistant)