# OctoAIEndpoint

> **Class** in `langchain_community`

📖 [View in docs](https://reference.langchain.com/python/langchain-community/llms/octoai_endpoint/OctoAIEndpoint)

OctoAI LLM Endpoints - OpenAI compatible.

OctoAIEndpoint is a class to interact with OctoAI Compute Service large
language model endpoints.

To use, you should have the environment variable ``OCTOAI_API_TOKEN`` set
with your API token, or pass it as a named parameter to the constructor.

## Signature

```python
OctoAIEndpoint()
```

## Description

**Example:**

.. code-block:: python

from langchain_community.llms.octoai_endpoint  import OctoAIEndpoint

llm = OctoAIEndpoint(
    model="llama-2-13b-chat-fp16",
    max_tokens=200,
    presence_penalty=0,
    temperature=0.1,
    top_p=0.9,
)

## Extends

- `BaseOpenAI`

## Properties

- `octoai_api_base`
- `octoai_api_token`
- `model_name`

## Methods

- [`is_lc_serializable()`](https://reference.langchain.com/python/langchain-community/llms/octoai_endpoint/OctoAIEndpoint/is_lc_serializable)
- [`validate_environment()`](https://reference.langchain.com/python/langchain-community/llms/octoai_endpoint/OctoAIEndpoint/validate_environment)

---

[View source on GitHub](https://github.com/langchain-ai/langchain-community/blob/a6a6079511ac8a5c1293337f88096b8641562e77/libs/community/langchain_community/llms/octoai_endpoint.py#L13)