Update the cache with the given generations.
Note this overwrites any existing generations for the given prompt and LLM key.
update(prompt: string, llmKey: string, value: Generation[]): Promise<void>| Name | Type | Description |
|---|---|---|
prompt* | string | The prompt to update. |
llmKey* | string | The LLM key to update. |
value* | Generation[] | The generations to store. |