Ask a question to get started
Enter to sendā¢Shift+Enter new line
truncation_length: Optional[int] = 2048
Truncate the prompt up to this length. The leftmost tokens are removed if the prompt exceeds this length. Most models require this to be at most 2048.
