Class representing the AI21 language model. It extends the LLM (Large Language Model) class, providing a standard interface for interacting with the AI21 language model.
Specific implementation of a Large Language Model (LLM) designed to interact with the Aleph Alpha API. It extends the base LLM class and includes a variety of parameters for customizing the behavior o
A type of Large Language Model (LLM) that interacts with the Bedrock
service. It extends the base LLM class and implements the
BaseBedrockInput interface. The class is designed to authenticate and
A type of Large Language Model (LLM) that interacts with the Bedrock
service. It extends the base LLM class and implements the
BaseBedrockInput interface. The class is designed to authenticate and
Wrapper around Fireworks API for large language models
Fireworks API is compatible to the OpenAI API with some limitations described in https://readme.fireworks.ai/docs/openai-compatibility.
To use,
The Friendli class is used to interact with Friendli inference Endpoint models. This requires your Friendli Token and Friendli Team which is autoloaded if not specified.
The GradientLLM class is used to interact with Gradient AI inference Endpoint models. This requires your Gradient AI Access Token which is autoloaded if not specified.
Class implementing the Large Language Model (LLM) interface using the Hugging Face Inference API for text generation.
Integration with an LLM.
To use this model you need to have the node-llama-cpp module installed.
This can be installed using npm install -S node-llama-cpp and the minimum
version supported in version 2.0.0.
This also r
The RaycastAI class, which extends the LLM class and implements the RaycastAIInput interface.
Class responsible for managing the interaction with the Replicate API. It handles the API key and model details, makes the actual API calls, and converts the API response into a format usable by the r
A handler class to transform input from LLM to a format that SageMaker endpoint expects. Similarily, the class also handles transforming output from the SageMaker endpoint to a format that LLM class e
The SageMakerEndpoint class is used to interact with SageMaker Inference Endpoint models. It uses the AWS client for authentication, which automatically loads credentials. If a specific credential pro
Class representing a Writer Large Language Model (LLM). It interacts with the Writer API to generate text completions.
Interface for AI21 input parameters.
Interface for the input parameters specific to the Aleph Alpha LLM.
The FriendliParams interface defines the input parameters for the Friendli class.
The GradientLLMParams interface defines the input parameters for the GradientLLM class.
Interface defining the parameters for configuring the Hugging Face model for text generation.
Call interface for second parameter of inbuild methods
Parameters for basic llm invoke
Parameters for basic llm invoke
Constructor input interfaces for each mode
Parameters for basic llm invoke
Note that the modelPath is the only required parameter. For testing you
can set this in the environment variable LLAMA_PATH.
The input parameters for the RaycastAI class, which extends the BaseLLMParams interface.
Interface defining the structure of the input data for the Replicate class. It includes details about the model to be used, any additional input parameters, and the API key for the Replicate service.
The SageMakerEndpointInput interface defines the input parameters for the SageMakerEndpoint class, which includes the endpoint name, client options for the SageMaker client, the content handler, and o
Note that the modelPath is the only required parameter. For testing you
can set this in the environment variable LLAMA_PATH.
Interface for the input parameters specific to the Writer model.
