LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
  • Overview
  • Client
  • AsyncClient
  • Run Helpers
  • Run Trees
  • Evaluation
  • Schemas
  • Utilities
  • Wrappers
  • Anonymizer
  • Testing
  • Expect API
  • Middleware
  • Pytest Plugin
  • Deployment SDK
⌘I

Chat LangChain

What can I help with?

Enter to send·Shift+Enter new line

Menu

OverviewClientAsyncClientRun HelpersRun TreesEvaluationSchemasUtilitiesWrappersAnonymizerTestingExpect APIMiddlewarePytest PluginDeployment SDK
Language
Theme
PythonlangsmithresourcesevaluatorsEvaluatorsResource
Class●Since v0.14

EvaluatorsResource

Copy
EvaluatorsResource(
    self,
    client: Langsmith,
)

Bases

SyncAPIResource

Methods

View source on GitHub
method
with_raw_response
method
with_streaming_response
method
list
method
create_decision_model

This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content.

For more information, see https://www.github.com/langchain-ai/langsmith-python#accessing-raw-response-data-eg-headers

An alternative to .with_raw_response that doesn't eagerly read the response body.

For more information, see https://www.github.com/langchain-ai/langsmith-python#with_streaming_response

List all run rules.

Create a decision-model evaluator (Jev, SemIf or OpenAI Decisions) from its prompt and questions, and attach it to a project or dataset. Each question's key becomes a feedback key.