EvaluatorCallbackHandler

Whether to raise an error if an exception occurs.

Whether to run the callback inline.

Whether to ignore LLM callbacks.

Whether to ignore retry callbacks.

Whether to ignore chain callbacks.

Whether to ignore agent callbacks.

Whether to ignore retriever callbacks.

Whether to ignore chat model callbacks.

Ignore custom event.

Run on new output token.

Run when LLM ends running.

Run when LLM errors.

Run on each protocol event from stream_events(version="v3").

Run when chain ends running.

Run when chain errors.

Run on agent action.

Run on the agent end.

Run when the tool ends running.

Run when tool errors.

Run when Retriever errors.

Run when Retriever ends running.

Run when LLM starts running.

Run when a chat model starts running.

Run when the Retriever starts running.

Run when a chain starts running.

Run when the tool starts running.

Run on an arbitrary text.

Run on a retry event.

Override to define a handler for a custom event.