agenerate_prompt(
self,
prompts: list[PromptValue],
stop: list[str] || Name | Type | Description |
|---|---|---|
prompts* | list[PromptValue] | List of A |
stop | list[str] | None | Default: NoneStop words to use when generating. Model output is cut off at the first occurrence of any of these substrings. |
callbacks | Callbacks | Default: None |
**kwargs | Any | Default: {} |
Asynchronously pass a sequence of prompts and return model generations.
This method should make use of batched calls for models that expose a batched API.
Use this method when you want to:
Callbacks to pass through.
Used for executing additional functionality, such as logging or streaming, throughout generation.
Arbitrary additional keyword arguments.
These are usually passed to the model provider API call.