Retrieves data from the cache. It constructs a cache key from the given
prompt and llmKey, and retrieves the corresponding value from the
Cloudflare KV namespace.
lookup(prompt: string, llmKey: string): Promise<Generation[] | null>| Name | Type | Description |
|---|---|---|
prompt* | string | The prompt used to construct the cache key. |
llmKey* | string | The LLM key used to construct the cache key. |