Ask a question to get started
Enter to sendā¢Shift+Enter new line
Base class for all caches. All caches should extend this class.
class BaseCache
Sets a custom key encoder function for the cache. This function should take a prompt and an LLM key and return a string that will be used as the cache key.