LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
LangSmith
  • Client
  • Run Trees
  • Traceable
  • Evaluation
  • Schemas
  • Langchain
  • Jest
  • Vitest
  • Wrappers
  • Anonymizer
  • Jestlike
  • Vercel
  • Anthropic
  • Sandbox
⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

LangSmith
ClientRun TreesTraceableEvaluationSchemasLangchainJestVitestWrappersAnonymizerJestlikeVercelAnthropicSandbox
Language
Theme
JavaScriptlangsmith_openapi_clientresourcesOnlineEvaluators
Class●Since v0.8

OnlineEvaluators

Copy
class OnlineEvaluators

Bases

APIResource

Constructors

constructor
constructor

Properties

property
_client: Langsmith

Methods

method
bulkDelete→ APIPromise<BulkDeleteEvaluatorsResponse>

Delete multiple evaluators by their IDs. Returns per-item success/failure.

method
create→ APIPromise<RunCreateResponse>

Add Runs To Annotation Queue

method
delete→ APIPromise<Rsp>
method
list→ APIPromise<RunListResponse>

Get Runs From Annotation Queue

method
retrieve→ APIPromise<DatasetShareSchema | null>

Get the state of sharing a dataset

method
spend→ APIPromise<GetOnlineEvaluatorSpendResponse>

Returns per-day LLM evaluator spend for the requested 7-day period, grouped by evaluator, resource, or run rule. Exactly one of group_by, evaluator_id, session_id, or dataset_id is required. resource_id, type, and feedback_key may be supplied with group_by to narrow listing aggregations.

method
update→ APIPromise<unknown>

Update Run In Annotation Queue

View source on GitHub