GradientLLMParams

Gradient Adapter ID for custom fine tuned models.

Gradient AI Access Token. Provide Access Token if you do not wish to automatically pull from env.

Parameters accepted by the Gradient npm package.

The maximum number of concurrent calls that can be made. Defaults to Infinity, which means no limit.

The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.

Gradient AI Model Slug.

Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.

Gradient Workspace Id. Provide workspace id if you do not wish to automatically pull from env.