Ask a question to get started
Enter to sendā¢Shift+Enter new line
DynamicComparisonRunEvaluator( self, func: Callable[[Sequence[Run], Optional[Example]],
func
Callable
A function that takes a Run and an optional Example as
Run
Example
Check if the evaluator function is asynchronous.
Compare runs to score preferences.
Evaluate a run asynchronously using the wrapped async function.
This method directly invokes the wrapped async function with the provided arguments.
Compare predictions (as traces) from 2 or more runs.
