Enter to sendยทShift+Enter new line
top_p: Optional[float] = None
Decode using nucleus sampling: consider the smallest set of tokens whose probability sum is at least top_p. Must be in the closed interval [0.0, 1.0].