Input to LLM class.
interface GoogleEmbeddingsInputBaseGoogleEmbeddingsParams<WebGoogleAuthOptions>Some APIs allow an API key instead
The version of the API functions. Part of the path.
Used to specify output embedding size. If set, output embeddings will be truncated to the size specified.
Hostname for the API call (if this is running on GCP)
Region where the LLM is stored (if this is running on GCP)
The maximum number of concurrent calls that can be made.
Defaults to Infinity, which means no limit.
The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.
Model to use
Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.
An alias for "dimensions"
What platform to run the service on. If not specified, the class should determine this from other means. Either way, the platform actually used will be in the "platform" getter.
For compatibility with Google's libraries, should this use Vertex? The "platformType" parmeter takes precedence.
Some APIs allow an API key instead
The version of the API functions. Part of the path.
Used to specify output embedding size.
Hostname for the API call (if this is running on GCP)
Region where the LLM is stored (if this is running on GCP)
The maximum number of concurrent calls that can be made.
The maximum number of retries that can be made for a single call,
Model to use
Custom handler to handle failed attempts. Takes the originally thrown
An alias for "dimensions"
What platform to run the service on.
For compatibility with Google's libraries, should this use Vertex?
Some APIs allow an API key instead
The version of the API functions. Part of the path.
Hostname for the API call (if this is running on GCP)
Region where the LLM is stored (if this is running on GCP)
What platform to run the service on.
For compatibility with Google's libraries, should this use Vertex?