Streams response chunks from the SageMaker endpoint.
_streamResponseChunks(
prompt: string,
options: Omit<BaseLLMCallOptions, "configurable" | "recursionLimit" | "runName" | "tags" | "metadata" | "callbacks" | "runId">,
runManager: CallbackManagerForLLMRun
): AsyncGenerator<GenerationChunk>| Name | Type | Description |
|---|---|---|
prompt* | string | The input prompt. |
options* | Omit<BaseLLMCallOptions, "configurable" | "recursionLimit" | "runName" | "tags" | "metadata" | "callbacks" | "runId"> | Parsed call options. |
runManager | CallbackManagerForLLMRun |