AzureMLBaseEndpoint

URL of pre-existing Endpoint. Should be passed to constructor or specified as env var AZUREML_ENDPOINT_URL.

Type of the endpoint being consumed. Possible values are serverless for pay-as-you-go and dedicated for dedicated endpoints.

Authentication Key for Endpoint. Should be passed to constructor or specified as env var AZUREML_ENDPOINT_API_KEY.

Deployment Name for Endpoint. NOT REQUIRED to call endpoint. Should be passed to constructor or specified as env var AZUREML_DEPLOYMENT_NAME.

Request timeout for calls to the endpoint

The content formatter that provides an input and output transform function to handle formats between the LLM and the endpoint

Keyword arguments to pass to the model.

Validate that content formatter is supported by endpoint type.

Validate that endpoint url is complete.

Validate that endpoint api type is compatible with the URL format.

Validate that api key and python package exists in environment.