Used to dynamically adjust the number of choices for each predicted token based
on the cumulative probabilities. A value of 1 will always yield the same output.
A temperature less than 1 favors more correctness and is appropriate for
question answering or summarization. A value greater than 1 introduces more
randomness in the output.
top_p: float | None = None