Interface●Since v1.0

BaseLLMParams

Base interface for language model parameters. A subclass of BaseLanguageModel should have a constructor that takes in a parameter that extends this interface.

interface BaseLLMParams

Bases

BaseLanguageModelParams

Properties

property

cache: boolean | BaseCache<Generation[]>

property

callbacks: Callbacks

Callbacks for this call and any sub-calls (eg. a Chain calling an LLM). Tags are passed to all callbacks, metadata is passed to handle*Start callbacks.

property

maxConcurrency: number

Maximum number of parallel calls to make.

property

maxRetries: number

The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.

property

metadata: Record<string, unknown>

property

onFailedAttempt: FailedAttemptHandler

Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.

property

tags: string[]

property

verbose: boolean

deprecatedproperty

callbackManager: CallbackManager