BedrockChatFields

Optional URL Encoded overide for URL model parameter in fetch. Necessary for invoking an Application Inference Profile. For example, "arn%3Aaws%3Abedrock%3Aus-east-1%3A1234567890%3Aapplication-inference-profile%2Fabcdefghi", will override this.model in final /invoke URL call. Must still provide model as normal modelId to benefit from all the metadata.

AWS Credentials. If no credentials are provided, the default credentials from @aws-sdk/credential-provider-node will be used.

Override the default endpoint hostname.

A custom fetch function for low-level access to AWS API. Defaults to fetch().

Required when Guardrail is in use.

Identifier for the guardrail configuration.

Version for the guardrail configuration.

The maximum number of concurrent calls that can be made. Defaults to Infinity, which means no limit.

The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.

Model name to use. Available options are: qwen-turbo, qwen-plus, qwen-max, or Other compatible models.

Additional kwargs to pass to the model.

Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.

Region for the Alibaba Tongyi API endpoint.

Available regions:

• 'china' (default): https://dashscope.aliyuncs.com/compatible-mode/v1
• 'singapore': https://dashscope-intl.aliyuncs.com/compatible-mode/v1
• 'us': https://dashscope-us.aliyuncs.com/compatible-mode/v1

Whether to stream the results or not. Defaults to false.

Amount of randomness injected into the response. Ranges from 0 to 1 (0 is not included). Use temp closer to 0 for analytical / multiple choice, and temp closer to 1 for creative and generative tasks. Defaults to 0.95.

Trace settings for the Bedrock Guardrails.

Whether to print out response text.