Enter to sendยทShift+Enter new line
last_n_tokens_size: Optional[int] = 64
The number of tokens to look back when applying the repeat_penalty.