Ask a question to get started
Enter to sendā¢Shift+Enter new line
last_n_tokens_size: Optional[int] = 64
The number of tokens to look back when applying the repeat_penalty.