Optional
headers?: Record<string, string | null | undefined>Optional
promptIndex?: numberThe index of the prompt in the list of prompts.
Optional
stream_options?: { include_usage: boolean }Additional options to pass to streamed completions. If provided takes precedence over "streamUsage" set at initialization time.
Whether or not to include token usage in the stream.
If set to true
, this will include an additional
chunk at the end of the stream with the token usage.
Defaults to true
when streaming, false
otherwise.
Optional
tools?: ChatGroqToolType[]
Additional headers to pass to the API.