interface WriterInputWriter API key
Generates this many completions server-side and returns the "best"."
Penalizes repeated tokens according to frequency.
Whether to return log probabilities.
The maximum number of concurrent calls that can be made.
Defaults to Infinity, which means no limit.
The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Maximum number of tokens to generate in the completion.
Minimum number of tokens to generate.
Model to use
Number of completions to generate.
Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
Writer organization ID
Penalizes repeated tokens regardless of frequency.
Sampling temperature to use
Total probability mass of tokens to consider at each step.
Interface for the input parameters specific to the Writer model.