Function splitListOfDocs

splitListOfDocs(
    docs: Document[],
    lengthFunc: (...args: any[]) => any,
    tokenMax: number,
): Document[][]
Splits a list of documents into sublists based on a maximum token limit.
Parameters
- docs: Document[]
  The list of documents to be split.
- lengthFunc: (...args: any[]) => any
  A function that calculates the number of tokens in a list of documents.
- tokenMax: number
  The maximum number of tokens allowed in a sublist.
Returns Document[][]
- A list of document sublists, each sublist contains documents whose total number of tokens does not exceed the tokenMax.
Throws
- Throws an error if a single document has more tokens than the tokenMax.
- Defined in remotes/langchain-ai/langchainjs/v1/libs/langchain/src/chains/combine_documents/reduce.ts:14