batch(
inputs: BaseLanguageModelInput[],
options: Partial<BaseChatModelCallOptions> | Partial| Name | Type | Description |
|---|---|---|
inputs* | BaseLanguageModelInput[] | Array of inputs to each batch call. |
options | Partial<BaseChatModelCallOptions> | Partial<BaseChatModelCallOptions>[] | Either a single call options object to apply to each batch call or an array for each call. |
batchOptions | RunnableBatchOptions & __type |
Default implementation of batch, which calls invoke N times. Subclasses should override this method if they can batch more efficiently.