aupdate(
self,
prompt: str,
llm_string: str,
return_val: RETURN_VAL_TYPE
) -> None| Name | Type | Description |
|---|---|---|
prompt* | str | The prompt to cache. |
llm_string* | str | LLM identifier string. |
return_val* | RETURN_VAL_TYPE | The generations to cache. |
Update cache based on prompt and llm_string asynchronously.