ChatPremAI

The ID of the session to use. It helps to track the chat history.

Model temperature. Value should be >= 0 and <= 1.0

top_p adjusts the number of choices for each predicted tokens based on cumulative probabilities. Value should be ranging between 0.0 and 1.0.

The maximum number of tokens to generate

Max number of retries to call the API

Acts like a default instruction that helps the LLM act or generate in a specific way.This is an Optional Parameter. By default the system prompt would be using Prem's Launchpad models system prompt. Changing the system prompt would override the default system prompt.

Add valid repository ids. This will be overriding existing connected repositories (if any) and will use RAG with the connected repos.

Whether to stream the responses or not.

Validate that the package is installed and that the API token is valid