Ask a question to get started
Enter to sendā¢Shift+Enter new line
MemcachedCache( self, client_: Any, )
BaseCache
client_
str
An instance of any of pymemcache's Clients (Client, PooledClient, HashClient)
Look up based on prompt and llm_string.
Update cache based on prompt and llm_string.
Clear the entire cache. Takes optional kwargs:
Cache that uses Memcached backend through pymemcache client lib