Ask a question to get started
Enter to send•Shift+Enter new line
VertexStringEvaluator( self, metric: str, **kwargs = {}, )
_EvaluatorBase
StringEvaluator
The name of the evaluation.
Whether this evaluator requires a reference label.
Evaluate Chain or LLM output, based on optional input and label.
Asynchronously evaluate Chain or LLM output, based on optional input and label.
Evaluate the perplexity of a predicted string.