Ask a question to get started
Enter to sendā¢Shift+Enter new line
max_tokens: int | None = Field(default=None, alias='max_tokens_to_sample')
Denotes the number of tokens to predict per generation.
If not specified, this is set dynamically using the model's max_output_tokens from its model profile.
max_output_tokens
See docs on model profiles for more information.
