langchain.js
    Preparing search index...

    Class CloudflareKVCache

    Install and import from "@langchain/cloudflare" instead.

    Represents a specific implementation of a caching mechanism using Cloudflare KV as the underlying storage system. It extends the BaseCache class and overrides its methods to provide the Cloudflare KV-specific logic.

    // Example of using OpenAI with Cloudflare KV as cache in a Cloudflare Worker
    const cache = new CloudflareKVCache(env.KV_NAMESPACE);
    const model = new ChatAnthropic({
      cache,
    });
    const response = await model.invoke("How are you today?");
    return new Response(JSON.stringify(response), {
      headers: { "content-type": "application/json" },
    });

    Hierarchy (View Summary)

    Index

    Constructors

    constructor

    Methods

    lookup update

    Constructors

    • Parameters

      • binding: KVNamespace

      Returns CloudflareKVCache

    Methods

    • Retrieves data from the cache. It constructs a cache key from the given prompt and llmKey, and retrieves the corresponding value from the Cloudflare KV namespace.

      Parameters

      • prompt: string

        The prompt used to construct the cache key.

      • llmKey: string

        The LLM key used to construct the cache key.

      Returns Promise<null | Generation[]>

      An array of Generations if found, null otherwise.

    • Updates the cache with new data. It constructs a cache key from the given prompt and llmKey, and stores the value in the Cloudflare KV namespace.

      Parameters

      • prompt: string

        The prompt used to construct the cache key.

      • llmKey: string

        The LLM key used to construct the cache key.

      • value: Generation[]

        The value to be stored in the cache.

      Returns Promise<void>

    Settings

    Member Visibility

    On This Page

    Constructors
    Methods