LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
  • Overview
  • Client
  • AsyncClient
  • Run Helpers
  • Run Trees
  • Evaluation
  • Schemas
  • Utilities
  • Wrappers
  • Anonymizer
  • Testing
  • Expect API
  • Middleware
  • Pytest Plugin
  • Deployment SDK
⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

OverviewClientAsyncClientRun HelpersRun TreesEvaluationSchemasUtilitiesWrappersAnonymizerTestingExpect APIMiddlewarePytest PluginDeployment SDK
Language
Theme
PythonlangsmithevaluationevaluatorRunEvaluatorfeedback_keys
Attribute●Since v0.8

feedback_keys

Copy
feedback_keys: list[str]
View source on GitHub

Feedback keys this evaluator emits, when statically known.

Used to render per-evaluator experiment progress and to synthesize error feedback when the evaluator raises. Best-effort: empty when the keys can't be determined without running the evaluator. Subclasses that know their keys should override this. The default also resolves evaluators that wrap a single named inner evaluator exposed as .evaluator (e.g. the LangChain string-evaluator integration).