AzureML Managed Endpoint client.
Azure ML endpoints API types. Use dedicated for models deployed in hosted
infrastructure (also known as Online Endpoints in Azure Machine Learning),
or serverless for models deployed as a service with a
pay-as-you-go billing or PTU.
Transform request and response of AzureML endpoint to match with required schema.
Content handler for GPT2
Deprecated: Kept for backwards compatibility
Content handler for LLMs from the OSS catalog.
Content handler for LLMs from the HuggingFace catalog.
Content handler for the Dolly-v2-12b model
Content formatter for models that use the OpenAI like API scheme.
Deprecated: Kept for backwards compatibility
Content formatter for Llama.
Azure ML Online Endpoint models.
Azure ML Online Endpoint models.