LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
LangSmith
  • Client
  • Run Trees
  • Traceable
  • Evaluation
  • Schemas
  • Langchain
  • Jest
  • Vitest
  • Wrappers
  • Anonymizer
  • Jestlike
  • Vercel
  • Anthropic
  • Sandbox
⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

LangSmith
ClientRun TreesTraceableEvaluationSchemasLangchainJestVitestWrappersAnonymizerJestlikeVercelAnthropicSandbox
Language
Theme
JavaScriptlangsmith_openapi_clientLangsmithOnlineEvaluators
Class●Since v0.8

OnlineEvaluators

Copy
class OnlineEvaluators

Bases

APIResource

Constructors

constructor
constructor→ OnlineEvaluators

Properties

property
_client: Langsmith

Methods

method
bulkDelete→ APIPromise<BulkDeleteEvaluatorsResponse>

Delete multiple evaluators by their IDs. Returns per-item success/failure.

method
create→ APIPromise<CreateOnlineEvaluatorResponse>

Create a new LLM or code evaluator for the current workspace.

method
delete→ APIPromise<void>

Delete an evaluator. When delete_run_rules is true, all run rules referencing this evaluator are deleted first (same tenant). Associated llm_evaluators and code_evaluators rows are removed by foreign-key cascade when the evaluator row is deleted.

method
list→ PagePromise<OnlineEvaluatorsOffsetPaginationOnlineEvaluators, OnlineEvaluator>

List evaluators for the current workspace, with optional filtering by type, name, tag, feedback key, or resource ID.

method
retrieve→ APIPromise<OnlineEvaluator>

Retrieve a single evaluator by its ID.

method
spend→ APIPromise<GetOnlineEvaluatorSpendResponse>

Returns per-day LLM evaluator spend for the requested 7-day period, grouped by evaluator, resource, or run rule. Exactly one of group_by, evaluator_id, session_id, or dataset_id is required. resource_id, type, feedback_key, and tag_value_id may be supplied with group_by to narrow listing aggregations.

method
update→ APIPromise<UpdateOnlineEvaluatorResponse>

Update an existing evaluator's name, LLM configuration, or code configuration.

View source on GitHub