InMemoryCache(
self,
)Cache that stores things in memory.
Look up based on prompt and llm_string.
Update cache based on prompt and llm_string.
Clear cache.
Look up based on prompt and llm_string.
Update cache based on prompt and llm_string.
Clear cache.