Class InMemoryCache<T>

A cache for storing LLM generations that stores data in memory.

Type Parameters

T = Generation[]

Hierarchy (View Summary)

BaseCache<T>
- InMemoryCache

Index

Constructors

Properties

Methods

lookup makeDefaultKeyEncoder update global

Constructors

constructor

new InMemoryCache<T = Generation[]>(map?: Map<string, T>): InMemoryCache<T>
Type Parameters
- T = Generation[]
Parameters
- Optionalmap: Map<string, T>
Returns InMemoryCache<T>
Overrides BaseCache.constructor
- Defined in remotes/langchain-ai/langchainjs/v1/libs/langchain-core/src/caches/base.ts:61

Properties

`Protected`keyEncoder

keyEncoder: HashKeyEncoder = defaultHashKeyEncoder

Methods

lookup

lookup(prompt: string, llmKey: string): Promise<null | T>
Retrieves data from the cache using a prompt and an LLM key. If the data is not found, it returns null.
Parameters
- prompt: string
  The prompt used to find the data.
- llmKey: string
  The LLM key used to find the data.
Returns Promise<null | T>
The data corresponding to the prompt and LLM key, or null if not found.
Overrides BaseCache.lookup
- Defined in remotes/langchain-ai/langchainjs/v1/libs/langchain-core/src/caches/base.ts:73

makeDefaultKeyEncoder

makeDefaultKeyEncoder(keyEncoderFn: HashKeyEncoder): void
Sets a custom key encoder function for the cache. This function should take a prompt and an LLM key and return a string that will be used as the cache key.
Parameters
- keyEncoderFn: HashKeyEncoder
  The custom key encoder function.
Returns void
Inherited from BaseCache.makeDefaultKeyEncoder
- Defined in remotes/langchain-ai/langchainjs/v1/libs/langchain-core/src/caches/base.ts:44

update

update(prompt: string, llmKey: string, value: T): Promise<void>
Updates the cache with new data using a prompt and an LLM key.
Parameters
- prompt: string
  The prompt used to store the data.
- llmKey: string
  The LLM key used to store the data.
- value: T
  The data to be stored.
Returns Promise<void>
Overrides BaseCache.update
- Defined in remotes/langchain-ai/langchainjs/v1/libs/langchain-core/src/caches/base.ts:85

`Static`global

global(): InMemoryCache
Returns a global instance of InMemoryCache using a predefined global map as the initial cache.

Returns InMemoryCache
A global instance of InMemoryCache.
- Defined in remotes/langchain-ai/langchainjs/v1/libs/langchain-core/src/caches/base.ts:94