Ask a question to get started
Enter to send•Shift+Enter new line
Configuration for a score string evaluator.
This is like the criteria evaluator but it is configured by default to return a score on the scale from 1-10.
It is recommended to normalize these scores by setting normalize_by to 10.
normalize_by
ScoreString()
SingleKeyEvalConfig
The key from the model Run's outputs to use as the eval prediction.
The key from the model Run's inputs to use as the eval input.
Get the keyword arguments for the load_evaluator call.
load_evaluator
