Ask a question to get started
Enter to sendā¢Shift+Enter new line
Float that penalizes new tokens based on their frequency in the generated text. Values > 1 encourage the model to use new tokens.
repetition_penalty: Optional[float] = 1.0