_batchWithConfig<
T extends BaseLanguageModelInput
>(
func: (inputs: | Name | Type | Description |
|---|---|---|
func* | (inputs: T[], options?: Partial<ChatGroqCallOptions>[], runManagers?: CallbackManagerForChainRun | undefined[], batchOptions?: RunnableBatchOptions) => Promise<AIMessageChunk<MessageStructure<MessageToolSet>> | Error[]> | |
inputs* | T[] | |
options | Partial<Pick<ChatCompletionCreateParamsBase, "frequency_penalty" | "function_call" | "functions" | "logit_bias" | "logprobs" | "max_completion_tokens" | "max_tokens" | "n" | "parallel_tool_calls" | "presence_penalty" | "reasoning_format" | "response_format" | "seed" | "service_tier" | "stop" | "temperature" | "tool_choice" | "top_logprobs" | "top_p"> & BaseLanguageModelCallOptions & __type & __type | |
batchOptions | RunnableBatchOptions |
Internal method that handles batching and configuration for a runnable It takes a function, input values, and optional configuration, and returns a promise that resolves to the output values.
The function to be executed for each input value.