Updates the cache with new data. It constructs a cache key from the
given prompt and llmKey, and stores the value in the Cloudflare KV
namespace.
update(prompt: string, llmKey: string, value: Generation[]): Promise<void>| Name | Type | Description |
|---|---|---|
prompt* | string | The prompt used to construct the cache key. |
llmKey* | string | The LLM key used to construct the cache key. |
value* | Generation[] | The value to be stored in the cache. |