BaseOCIModelDeployment()Base class for LLM deployed on OCI Data Science Model Deployment.
ADS auth dictionary for OCI authentication:
https://accelerated-data-science.readthedocs.io/en/latest/user_guide/cli/authentication.html.
This can be generated by calling ads.common.auth.api_keys()
or ads.common.auth.resource_principal(). If this is not
provided then the ads.common.default_signer() will be used.
The uri of the endpoint from the deployed Model Deployment model.
Whether to stream the results or not.
Maximum number of retries to make when generating.
The headers to be added to the Model Deployment request.
Checks if oracle-ads is installed and get credentials/endpoint from environment.
Use tenacity to retry the completion call.
Use tenacity to retry the async completion call.
Return whether this model can be serialized by LangChain.