Cache that uses Redis as a backend. Allows to use an
async redis.asyncio.Redis client.
_RedisCacheBase| Name | Type | Description |
|---|---|---|
redis_* | Any | An instance of a Redis client class
( |
ttl | int | Default: NoneTime-to-live (TTL) for cached items in seconds. If provided, it sets the time duration for how long cached items will remain valid. If not provided, cached items will not have an automatic expiration. |
Look up based on prompt and llm_string.
Look up based on prompt and llm_string. Async version.
Update cache based on prompt and llm_string.
Update cache based on prompt and llm_string. Async version.
Clear cache. If asynchronous is True, flush asynchronously.
Clear cache. If asynchronous is True, flush asynchronously.
Async version.