# OCIModelDeploymentTGI

> **Class** in `langchain_community`

📖 [View in docs](https://reference.langchain.com/python/langchain-community/llms/oci_data_science_model_deployment_endpoint/OCIModelDeploymentTGI)

OCI Data Science Model Deployment TGI Endpoint.

To use, you must provide the model HTTP endpoint from your deployed
model, e.g. https://modeldeployment.<region>.oci.customer-oci.com/<md_ocid>/predict.

To authenticate, `oracle-ads` has been used to automatically load
credentials: https://accelerated-data-science.readthedocs.io/en/latest/user_guide/cli/authentication.html

Make sure to have the required policies to access the OCI Data
Science Model Deployment endpoint. See:
https://docs.oracle.com/en-us/iaas/data-science/using/model-dep-policies-auth.htm#model_dep_policies_auth__predict-endpoint

## Signature

```python
OCIModelDeploymentTGI()
```

## Description

**Example:**

.. code-block:: python

from langchain_community.llms import OCIModelDeploymentTGI

llm = OCIModelDeploymentTGI(
    endpoint="https://modeldeployment.<region>.oci.customer-oci.com/<md_ocid>/predict",
    api="/v1/completions",
    streaming=True,
    temperature=0.2,
    seed=42,
    # other model parameters ...
)

## Extends

- `OCIModelDeploymentLLM`

## Properties

- `api`
- `frequency_penalty`
- `seed`
- `repetition_penalty`
- `suffix`
- `do_sample`
- `watermark`
- `return_full_text`

---

[View source on GitHub](https://github.com/langchain-ai/langchain-community/blob/4b280287bd55b99b44db2dd849f02d66c89534d5/libs/community/langchain_community/llms/oci_data_science_model_deployment_endpoint.py#L762)