LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
LangSmith
  • Client
  • Run Trees
  • Traceable
  • Evaluation
  • Schemas
  • Langchain
  • Jest
  • Vitest
  • Wrappers
  • Anonymizer
  • Jestlike
  • Vercel
  • Anthropic
  • Sandbox
⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

LangSmith
ClientRun TreesTraceableEvaluationSchemasLangchainJestVitestWrappersAnonymizerJestlikeVercelAnthropicSandbox
Language
Theme
JavaScriptlangsmith_openapi_clientresourcesEvaluator
Interface●Since v0.8

Evaluator

Run rules schema.

Copy
interface Evaluator

Properties

property
add_to_annotation_queue_id: string | null
property
add_to_annotation_queue_name: string | null
property
add_to_dataset_id: string | null
property
add_to_dataset_name: string | null
property
add_to_dataset_prefer_correction: boolean
property
alerts: EvaluatorPagerdutyAlert[] | null
property
alignment_annotation_queue_id: string | null
property
backfill_completed_at: string | null
property
backfill_error: string | null
property
backfill_from: string | null
property
backfill_id: string | null
property
backfill_progress: number | null
property
backfill_status: string | null
property
code_evaluators: CodeEvaluatorTopLevel[] | null
property
corrections_dataset_id: string | null
property
created_at: string
property
dataset_id: string | null
property
dataset_name: string | null
property
display_name: string
property
evaluator_id: string | null
property
evaluator_version: number
property
evaluators: EvaluatorTopLevel[] | null
property
extend_evaluator_trace_retention: boolean | null
property
extend_only: boolean
property
filter: string | null
property
group_by: "thread_id" | null

Include additional information about where the group_by param was set.

property
id: string
property
include_extended_stats: boolean
property
is_enabled: boolean
property
num_few_shot_examples: number | null
property
sampling_rate: number
property
session_name: string | null
property
spend_limit: SpendLimit | null
property
spend_usd: number | null
property
tenant_id: string
property
trace_count: number | null
property
trace_filter: string | null
property
transient: boolean
property
tree_filter: string | null
property
updated_at: string
property
use_corrections_dataset: boolean
property
webhooks: EvaluatorWebhook[] | null
deprecatedproperty
session_id: string | null
View source on GitHub