schema

Abstract base class for creating structured sequences of calls to components.

Chains should be used to encode a sequence of calls to components like models, document retrievers, other chains, etc., and provide a simple interface to this sequence.

The types of the evaluators.

A base class for evaluators that use an LLM.

String evaluator interface.

Grade, tag, or otherwise evaluate predictions relative to their inputs and/or reference labels.

Compare the output of two models (or two outputs of the same model).

Interface for evaluating agent trajectories.