LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
  • Overview
  • Client
  • AsyncClient
  • Run Helpers
  • Run Trees
  • Evaluation
  • Schemas
  • Utilities
  • Wrappers
  • Anonymizer
  • Testing
  • Expect API
  • Middleware
  • Pytest Plugin
  • Deployment SDK
⌘I

Chat LangChain

What can I help with?

Enter to send·Shift+Enter new line

Menu

OverviewClientAsyncClientRun HelpersRun TreesEvaluationSchemasUtilitiesWrappersAnonymizerTestingExpect APIMiddlewarePytest PluginDeployment SDK
Language
Theme
PythonlangsmithschemasAnnotationQueueRubricItem
Class●Since v0.14

AnnotationQueueRubricItem

Copy
AnnotationQueueRubricItem()

Bases

TypedDict

Constructors

Attributes

View source on GitHub
constructor
__init__
NameType
feedback_keystr
descriptionOptional[str]
value_descriptionsOptional[dict[str, str]]
score_descriptionsOptional[dict[str, str]]
is_requiredOptional[bool]
required_ifOptional[RubricItemConditions]
visible_ifOptional[RubricItemConditions]
is_assertionOptional[bool]
regex_validatorOptional[str]
feedback_config_idOptional[UUID]
feedback_configOptional[FeedbackConfigSchema]
attribute
feedback_key: str

The feedback key to include in this queue's rubric.

attribute
description: Optional[str]

Instructions for annotators on how to evaluate this item.

attribute
value_descriptions: Optional[dict[str, str]]

Display text for categorical feedback values.

attribute
score_descriptions: Optional[dict[str, str]]

Display text for score ranges.

attribute
is_required: Optional[bool]

Whether feedback for this rubric item is required whenever it is shown.

attribute
required_if: Optional[RubricItemConditions]

Required only while these rules on earlier items hold. On update, omit to keep the current conditions, or pass None to clear them.

attribute
visible_if: Optional[RubricItemConditions]

Shown only while these rules on earlier items hold. On update, omit to keep the current conditions, or pass None to clear them.

attribute
is_assertion: Optional[bool]

Whether this rubric item is an assertion (used in curation mode).

attribute
regex_validator: Optional[str]

Regex a freeform feedback value must match (searched, not anchored) to be accepted. At most 500 characters.

attribute
feedback_config_id: Optional[UUID]

The feedback config this item uses, for keys with more than one. On create or update, the key's enforced config wins over this, and an item that already has a config keeps it.

attribute
feedback_config: Optional[FeedbackConfigSchema]

Read-only. The config this item uses, or the key's first config when the item has none yet. None when the config is deleted. Creates and updates ignore it; set feedback_config_id to choose the config.

Represents a rubric item assigned to an annotation queue.

Links a feedback config to a queue with optional per-queue customization. A rubric item read from one queue can be passed as-is to another queue's rubric_items to copy it, keeping the same feedback config.