LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
  • Overview
  • Client
  • AsyncClient
  • Run Helpers
  • Run Trees
  • Evaluation
  • Schemas
  • Utilities
  • Wrappers
  • Anonymizer
  • Testing
  • Expect API
  • Middleware
  • Pytest Plugin
  • Deployment SDK
⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

OverviewClientAsyncClientRun HelpersRun TreesEvaluationSchemasUtilitiesWrappersAnonymizerTestingExpect APIMiddlewarePytest PluginDeployment SDK
Language
Theme
PythonlangsmithclientClientcreate_annotation_queue
Methodā—Since v0.0

create_annotation_queue

Copy
create_annotation_queue(
  self,
  *,
  name: str,
  description: Optional[str] = 
View source on GitHub
None
,
queue_id
:
Optional
[
ID_TYPE
]
=
None
,
rubric_instructions
:
Optional
[
str
]
=
None
,
rubric_items
:
Optional
[
list
[
ls_schemas
.
AnnotationQueueRubricItem
]
]
=
None
)
->
ls_schemas
.
AnnotationQueueWithDetails

Parameters

NameTypeDescription
name*str

The name of the annotation queue.

descriptionOptional[str]
Default:None

The description of the annotation queue.

queue_idOptional[Union[UUID, str]]
Default:None
rubric_instructionsOptional[str]
Default:None
rubric_itemsOptional[list[AnnotationQueueRubricItem]]
Default:None

Create an annotation queue on the LangSmith API.

The ID of the annotation queue.

The rubric instructions for the annotation queue.

The feedback configs to assign to this queue's rubric. Each item specifies a feedback_key and optional per-queue customization like description and value_descriptions.