langchain.js
    Preparing search index...

    Class Friendli

    The Friendli class is used to interact with Friendli inference Endpoint models. This requires your Friendli Token and Friendli Team which is autoloaded if not specified.

    Hierarchy (View Summary)

    Index

    Constructors

    constructor

    Properties

    baseUrl frequencyPenalty? friendliTeam? friendliToken? lc_serializable maxTokens? model modelKwargs? stop? temperature? topP?

    Accessors

    lc_secrets

    Methods

    _llmType _streamResponseChunks lc_name

    Constructors

    • Parameters

      Returns Friendli

    Properties

    baseUrl: string = "https://inference.friendli.ai"
    frequencyPenalty?: number
    friendliTeam?: string
    friendliToken?: string
    lc_serializable: boolean = true
    maxTokens?: number
    model: string = "mixtral-8x7b-instruct-v0-1"
    modelKwargs?: Record<string, unknown>
    stop?: string[]
    temperature?: number
    topP?: number

    Accessors

    • get lc_secrets(): undefined | { [key: string]: string }

      Returns undefined | { [key: string]: string }

    Methods

    _llmType

    • _llmType(): string

      Returns string

    _streamResponseChunks

    • _streamResponseChunks(
          prompt: string,
          _options: unknown,
          runManager?: any,
      ): AsyncGenerator<GenerationChunk>

      Parameters

      • prompt: string
      • _options: unknown
      • OptionalrunManager: any

      Returns AsyncGenerator<GenerationChunk>

    • Returns string

    Settings

    Member Visibility

    On This Page

    Constructors
    Properties
    Accessors
    Methods