Method●Since v1.0

handleLLMNewToken

Called when an LLM/ChatModel in streaming mode produces a new token

handleLLMNewToken(
  token: string,
  idx: NewTokenIndices,
  runId: string,
  _parentRunId: string,
  _tags: string[],
  fields: HandleLLMNewTokenCallbackFields
): Promise<Run>

Parameters

Name	Type	Description
`token`*	`string`
`idx`*	`NewTokenIndices`
`runId`*	`string`
`_parentRunId`	`string`
`_tags`	`string[]`
`fields`	`HandleLLMNewTokenCallbackFields`

View source on GitHub

handleLLMNewToken

Parameters

LangChain Assistant

Menu

handleLLMNewToken

Parameters