LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
LangSmith
  • Client
  • Run Trees
  • Traceable
  • Evaluation
  • Schemas
  • Langchain
  • Jest
  • Vitest
  • Wrappers
  • Anonymizer
  • Traceable
  • Jestlike
  • Vercel
  • Anthropic
  • Sandbox
⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

LangSmith
ClientRun TreesTraceableEvaluationSchemasLangchainJestVitestWrappersAnonymizerTraceableJestlikeVercelAnthropicSandbox
Language
Theme
JavaScriptlangsmithevaluationEvaluateOptions
Interface●Since v0.1

EvaluateOptions

Copy
interface EvaluateOptions

Bases

BaseEvaluateOptions

Properties

property
client: Client

The LangSmith client to use.

property
data: DataT

The dataset to evaluate on. Can be a dataset name, a list of examples, or a generator of examples.

property
description: string
property
evaluationConcurrency: number

The maximum number of concurrent evaluators to run. If not provided, defaults to maxConcurrency when set.

property
evaluators: EvaluatorT[]

A list of evaluators to run on each example.

property
experimentPrefix: string

A prefix to provide for your experiment name.

property
includeAttachments: boolean

Whether to use attachments for the experiment.

property
maxConcurrency: number

The maximum concurrency to use for predictions/evaluations when a more specific concurrency option is not provided.

property
metadata: KVMap

Additional metadata associated with the example.

property
numRepetitions: number

The number of repetitions to perform. Each example will be run this many times.

property
summaryEvaluators: SummaryEvaluatorT[]

A list of summary evaluators to run on the entire dataset.

property
targetConcurrency: number

The maximum number of concurrent predictions to run. If not provided, defaults to maxConcurrency when set.

View source on GitHub