langchain.js
    Preparing search index...

    The SageMakerEndpoint class is used to interact with SageMaker Inference Endpoint models. It uses the AWS client for authentication, which automatically loads credentials. If a specific credential profile is to be used, the name of the profile from the ~/.aws/credentials file must be passed. The credentials or roles used should have the required policies to access the SageMaker endpoint.

    Hierarchy (View Summary)

    Index

    Constructors

    Properties

    client: SageMakerRuntimeClient
    endpointKwargs?: Record<string, unknown>
    endpointName: string
    lc_serializable: boolean = true
    modelKwargs?: Record<string, unknown>
    streaming: boolean

    Accessors

    • get lc_secrets(): undefined | { [key: string]: string }

      Returns undefined | { [key: string]: string }

    Methods

    • Returns string

    • Streams response chunks from the SageMaker endpoint.

      Parameters

      • prompt: string

        The input prompt.

      • options: unknown

        Parsed call options.

      • OptionalrunManager: any

      Returns AsyncGenerator<GenerationChunk>

      An asynchronous generator yielding generation chunks.

    • Returns string