Ask a question to get started
Enter to sendā¢Shift+Enter new line
Used to control the nucleus sampling, where only the most probable tokens with a cumulative probability of top_p are considered for sampling, providing a way to fine-tune the randomness of predictions.
top_p: Optional[float] = None
