Base OpenAI large language model class.
OctoAI LLM Endpoints - OpenAI compatible.
OctoAIEndpoint is a class to interact with OctoAI Compute Service large language model endpoints.
To use, you should have the environment variable OCTOAI_API_TOKEN set
with your API token, or pass it as a named parameter to the constructor.
