LangChain Reference home page

GitHub
Main Docs

Overview
Client
AsyncClient
Run Helpers
Run Trees
Evaluation
Schemas
Utilities
Wrappers
Anonymizer
Testing
Expect API
Middleware
Pytest Plugin
Deployment SDK
RemoteGraph

⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

Overview Client AsyncClient Run Helpers Run Trees Evaluation Schemas Utilities Wrappers Anonymizer Testing Expect API Middleware Pytest Plugin Deployment SDK RemoteGraph

Language

Theme

PythonlangsmithevaluationevaluatorDynamicComparisonRunEvaluatorcompare_runs

Method●Since v0.1

compare_runs

Copy

compare_runs(
  self,
  runs: Sequence[Run],
  example: Optional[Example] =

View source on GitHub

None

)

->

ComparisonEvaluationResult

Parameters

Name	Type	Description
`runs`*	`Sequence[Run]`
`example`	`Optional[Example]`	Default:`None`

Compare runs to score preferences.

A list of runs to compare.

An optional example to be used in the evaluation.