Ask a question to get started
Enter to send•Shift+Enter new line
Configuration for a score string evaluator.
This is like the criteria evaluator but it is configured by default to return a score on the scale from 1-10.
It is recommended to normalize these scores by setting normalize_by to 10.
normalize_by
ScoreString()
SingleKeyEvalConfig
The key in the dataset run to use as the reference string.
The key from the traced run's outputs dictionary to use to
The key from the traced run's inputs dictionary to use to represent the
Get the keyword arguments for the load_evaluator call.
load_evaluator
