Interface defining the input to the ZhipuAIChatInput class.
interface ChatZhipuAIParamsturn on sampling strategy when do_sample is true, do_sample is false, temperature、top_p will not take effect
Model name to use. Available options are: qwen-turbo, qwen-plus, qwen-max, or Other compatible models.
Model name to use. Available options are: qwen-turbo, qwen-plus, qwen-max, or Other compatible models.
Alias for model
Unique identifier for the request. Defaults to a random UUID.
Stop tokens to use for this call. If not provided, the default stop tokens for the model will be used.
Whether to stream the results or not. Defaults to false.
Amount of randomness injected into the response. Ranges from 0 to 1 (0 is not included). Use temp closer to 0 for analytical / multiple choice, and temp closer to 1 for creative and generative tasks. Defaults to 0.95.
Total probability mass of tokens to consider at each step. Range from 0 to 1.0. Defaults to 0.8.
API key to use when making requests. Defaults to the value of
ZHIPUAI_API_KEY environment variable.
Alias for apiKey