LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
  • Overview
  • Client
  • AsyncClient
  • Run Helpers
  • Run Trees
  • Evaluation
  • Schemas
  • Utilities
  • Wrappers
  • Anonymizer
  • Testing
  • Expect API
  • Middleware
  • Pytest Plugin
  • Deployment SDK
⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

OverviewClientAsyncClientRun HelpersRun TreesEvaluationSchemasUtilitiesWrappersAnonymizerTestingExpect APIMiddlewarePytest PluginDeployment SDK
Language
Theme
PythonlangsmithevaluationevaluatorRunEvaluator
Class●Since v0.0

RunEvaluator

Copy
RunEvaluator()

Attributes

Methods

View source on GitHub
attribute
feedback_keys: list[str]

Feedback keys this evaluator emits, when statically known.

Used to render per-evaluator experiment progress and to synthesize error feedback when the evaluator raises. Best-effort: empty when the keys can't be determined without running the evaluator. Subclasses that know their keys should override this. The default also resolves evaluators that wrap a single named inner evaluator exposed as .evaluator (e.g. the LangChain string-evaluator integration).

method
evaluate_run

Evaluate an example.

method
aevaluate_run

Evaluate an example asynchronously.

Evaluator interface class.