resolve_criteria

Resolve the criteria to evaluate.

Parameters

criteria : CRITERIA_TYPE The criteria to evaluate the runs against. It can be: - a mapping of a criterion name to its description - a single criterion name present in one of the default criteria - a single ConstitutionalPrinciple instance

Returns:

Dict[str, str] A dictionary mapping criterion names to descriptions.

Examples:

criterion = "relevance" CriteriaEvalChain.resolve_criteria(criteria) {'relevance': 'Is the submission referring to a real quote from the text?'}