Load evaluators specified by a list of evaluator types.
evaluators : Sequence[EvaluatorType] The list of evaluator types to load. llm : BaseLanguageModel, optional The language model to use for evaluation, if none is provided, a default ChatOpenAI gpt-4 model will be used. config : dict, optional A dictionary mapping evaluator types to additional keyword arguments, by default None **kwargs : Any Additional keyword arguments to pass to all evaluators.
List[Chain] The loaded evaluators.
from langchain_classic.evaluation import load_evaluators, EvaluatorType evaluators = [EvaluatorType.QA, EvaluatorType.CRITERIA] loaded_evaluators = load_evaluators(evaluators, criteria="helpfulness")
load_evaluators(
evaluators: Sequence[EvaluatorType],
*,
llm: BaseLanguageModel | None = None,
config: dict | None = None,
**kwargs: Any = {}
) -> list[Chain | StringEvaluator]