langchain.js
    Preparing search index...

    Interface LlamaCppCallOptions

    interface LlamaCppCallOptions {
        maxTokens?: number;
        onToken?: (tokens: number[]) => void;
    }

    Hierarchy (View Summary)

    Index

    Properties

    maxTokens? onToken?

    Properties

    maxTokens?: number

    The maximum number of tokens the response should contain.

    onToken?: (tokens: number[]) => void

    A function called when matching the provided token array

    Settings

    Member Visibility

    On This Page

    Properties