Wrapper around Anyscale Endpoint
Use tenacity to retry the async completion call.
Use tenacity to retry the completion call.
Return whether OpenAI API is v1 or more.
Update token usage.
Create the LLMResult from the choices and prompts.
Base OpenAI large language model class.
Anyscale large language models.
To use, you should have the environment variable ANYSCALE_API_KEYset with your
Anyscale Endpoint, or pass it as a named parameter to the constructor.
To use with Anyscale Private Endpoint, please also set ANYSCALE_BASE_URL.
