Class●Since v0.1

DynamicComparisonRunEvaluator

Compare predictions (as traces) from 2 or more runs.

DynamicComparisonRunEvaluator(
  self,
  func: Callable[[Sequence[Run], Optional[Example]], Union[_COMPARISON_OUTPUT, Awaitable[_COMPARISON_OUTPUT]]],
  afunc: Optional[Callable[[Sequence[Run], Optional[Example]], Awaitable[_COMPARISON_OUTPUT]]] = None
)

Parameters

Name	Type	Description
`func`*	`Callable`	A function that takes a `Run` and an optional `Example` as

Constructors

constructor

__init__

Name	Type
func	Callable[[Sequence[Run], Optional[Example]], Union[_COMPARISON_OUTPUT, Awaitable[_COMPARISON_OUTPUT]]]
afunc	Optional[Callable[[Sequence[Run], Optional[Example]], Awaitable[_COMPARISON_OUTPUT]]]