# langsmith

> Python package

📖 [View in docs](https://reference.langchain.com/python/langsmith)

## Classes

- [`CacheEntry`](https://reference.langchain.com/python/langsmith/prompt_cache/CacheEntry)
- [`CacheMetrics`](https://reference.langchain.com/python/langsmith/prompt_cache/CacheMetrics)
- [`PromptCache`](https://reference.langchain.com/python/langsmith/prompt_cache/PromptCache)
- [`AsyncPromptCache`](https://reference.langchain.com/python/langsmith/prompt_cache/AsyncPromptCache)
- [`Cache`](https://reference.langchain.com/python/langsmith/prompt_cache/Cache)
- [`AsyncCache`](https://reference.langchain.com/python/langsmith/prompt_cache/AsyncCache)
- [`AsyncClient`](https://reference.langchain.com/python/langsmith/async_client/AsyncClient)
- [`_NULL_SENTRY`](https://reference.langchain.com/python/langsmith/_expect/_NULL_SENTRY)
- [`_Matcher`](https://reference.langchain.com/python/langsmith/_expect/_Matcher)
- [`_Expect`](https://reference.langchain.com/python/langsmith/_expect/_Expect)
- [`LangSmithError`](https://reference.langchain.com/python/langsmith/utils/LangSmithError)
- [`LangSmithAPIError`](https://reference.langchain.com/python/langsmith/utils/LangSmithAPIError)
- [`LangSmithRequestTimeout`](https://reference.langchain.com/python/langsmith/utils/LangSmithRequestTimeout)
- [`LangSmithUserError`](https://reference.langchain.com/python/langsmith/utils/LangSmithUserError)
- [`LangSmithRateLimitError`](https://reference.langchain.com/python/langsmith/utils/LangSmithRateLimitError)
- [`LangSmithAuthError`](https://reference.langchain.com/python/langsmith/utils/LangSmithAuthError)
- [`LangSmithNotFoundError`](https://reference.langchain.com/python/langsmith/utils/LangSmithNotFoundError)
- [`LangSmithConflictError`](https://reference.langchain.com/python/langsmith/utils/LangSmithConflictError)
- [`LangSmithConnectionError`](https://reference.langchain.com/python/langsmith/utils/LangSmithConnectionError)
- [`LangSmithExceptionGroup`](https://reference.langchain.com/python/langsmith/utils/LangSmithExceptionGroup)
- [`LangSmithWarning`](https://reference.langchain.com/python/langsmith/utils/LangSmithWarning)
- [`LangSmithMissingAPIKeyWarning`](https://reference.langchain.com/python/langsmith/utils/LangSmithMissingAPIKeyWarning)
- [`FilterPoolFullWarning`](https://reference.langchain.com/python/langsmith/utils/FilterPoolFullWarning)
- [`FilterLangSmithRetry`](https://reference.langchain.com/python/langsmith/utils/FilterLangSmithRetry)
- [`LangSmithRetry`](https://reference.langchain.com/python/langsmith/utils/LangSmithRetry)
- [`ContextThreadPoolExecutor`](https://reference.langchain.com/python/langsmith/utils/ContextThreadPoolExecutor)
- [`LangSmithPlugin`](https://reference.langchain.com/python/langsmith/pytest_plugin/LangSmithPlugin)
- [`ZoneInfo`](https://reference.langchain.com/python/langsmith/client/ZoneInfo)
- [`TracerProvider`](https://reference.langchain.com/python/langsmith/client/TracerProvider)
- [`ListThreadsItem`](https://reference.langchain.com/python/langsmith/client/ListThreadsItem)
- [`Client`](https://reference.langchain.com/python/langsmith/client/Client)
- [`LangSmithExtra`](https://reference.langchain.com/python/langsmith/run_helpers/LangSmithExtra)
- [`SupportsLangsmithExtra`](https://reference.langchain.com/python/langsmith/run_helpers/SupportsLangsmithExtra)
- [`trace`](https://reference.langchain.com/python/langsmith/run_helpers/trace)
- [`TracingMiddleware`](https://reference.langchain.com/python/langsmith/middleware/TracingMiddleware)
- [`Attachment`](https://reference.langchain.com/python/langsmith/schemas/Attachment)
- [`BinaryIOLike`](https://reference.langchain.com/python/langsmith/schemas/BinaryIOLike)
- [`ExampleBase`](https://reference.langchain.com/python/langsmith/schemas/ExampleBase)
- [`ExampleCreate`](https://reference.langchain.com/python/langsmith/schemas/ExampleCreate)
- [`ExampleUpsertWithAttachments`](https://reference.langchain.com/python/langsmith/schemas/ExampleUpsertWithAttachments)
- [`AttachmentInfo`](https://reference.langchain.com/python/langsmith/schemas/AttachmentInfo)
- [`Example`](https://reference.langchain.com/python/langsmith/schemas/Example)
- [`AttachmentsOperations`](https://reference.langchain.com/python/langsmith/schemas/AttachmentsOperations)
- [`ExampleUpdate`](https://reference.langchain.com/python/langsmith/schemas/ExampleUpdate)
- [`DataType`](https://reference.langchain.com/python/langsmith/schemas/DataType)
- [`DatasetBase`](https://reference.langchain.com/python/langsmith/schemas/DatasetBase)
- [`DatasetTransformation`](https://reference.langchain.com/python/langsmith/schemas/DatasetTransformation)
- [`Dataset`](https://reference.langchain.com/python/langsmith/schemas/Dataset)
- [`DatasetVersion`](https://reference.langchain.com/python/langsmith/schemas/DatasetVersion)
- [`RunBase`](https://reference.langchain.com/python/langsmith/schemas/RunBase)
- [`Run`](https://reference.langchain.com/python/langsmith/schemas/Run)
- [`RunTypeEnum`](https://reference.langchain.com/python/langsmith/schemas/RunTypeEnum)
- [`RunLikeDict`](https://reference.langchain.com/python/langsmith/schemas/RunLikeDict)
- [`RunWithAnnotationQueueInfo`](https://reference.langchain.com/python/langsmith/schemas/RunWithAnnotationQueueInfo)
- [`FeedbackSourceBase`](https://reference.langchain.com/python/langsmith/schemas/FeedbackSourceBase)
- [`APIFeedbackSource`](https://reference.langchain.com/python/langsmith/schemas/APIFeedbackSource)
- [`ModelFeedbackSource`](https://reference.langchain.com/python/langsmith/schemas/ModelFeedbackSource)
- [`FeedbackSourceType`](https://reference.langchain.com/python/langsmith/schemas/FeedbackSourceType)
- [`FeedbackBase`](https://reference.langchain.com/python/langsmith/schemas/FeedbackBase)
- [`FeedbackCategory`](https://reference.langchain.com/python/langsmith/schemas/FeedbackCategory)
- [`FeedbackConfig`](https://reference.langchain.com/python/langsmith/schemas/FeedbackConfig)
- [`FeedbackCreate`](https://reference.langchain.com/python/langsmith/schemas/FeedbackCreate)
- [`Feedback`](https://reference.langchain.com/python/langsmith/schemas/Feedback)
- [`TracerSession`](https://reference.langchain.com/python/langsmith/schemas/TracerSession)
- [`TracerSessionResult`](https://reference.langchain.com/python/langsmith/schemas/TracerSessionResult)
- [`BaseMessageLike`](https://reference.langchain.com/python/langsmith/schemas/BaseMessageLike)
- [`DatasetShareSchema`](https://reference.langchain.com/python/langsmith/schemas/DatasetShareSchema)
- [`AnnotationQueueRubricItem`](https://reference.langchain.com/python/langsmith/schemas/AnnotationQueueRubricItem)
- [`AnnotationQueue`](https://reference.langchain.com/python/langsmith/schemas/AnnotationQueue)
- [`AnnotationQueueWithDetails`](https://reference.langchain.com/python/langsmith/schemas/AnnotationQueueWithDetails)
- [`BatchIngestConfig`](https://reference.langchain.com/python/langsmith/schemas/BatchIngestConfig)
- [`LangSmithInfo`](https://reference.langchain.com/python/langsmith/schemas/LangSmithInfo)
- [`LangSmithSettings`](https://reference.langchain.com/python/langsmith/schemas/LangSmithSettings)
- [`FeedbackIngestToken`](https://reference.langchain.com/python/langsmith/schemas/FeedbackIngestToken)
- [`RunEvent`](https://reference.langchain.com/python/langsmith/schemas/RunEvent)
- [`TimeDeltaInput`](https://reference.langchain.com/python/langsmith/schemas/TimeDeltaInput)
- [`DatasetDiffInfo`](https://reference.langchain.com/python/langsmith/schemas/DatasetDiffInfo)
- [`ComparativeExperiment`](https://reference.langchain.com/python/langsmith/schemas/ComparativeExperiment)
- [`PromptCommit`](https://reference.langchain.com/python/langsmith/schemas/PromptCommit)
- [`ListedPromptCommit`](https://reference.langchain.com/python/langsmith/schemas/ListedPromptCommit)
- [`Prompt`](https://reference.langchain.com/python/langsmith/schemas/Prompt)
- [`ListPromptsResponse`](https://reference.langchain.com/python/langsmith/schemas/ListPromptsResponse)
- [`PromptSortField`](https://reference.langchain.com/python/langsmith/schemas/PromptSortField)
- [`InputTokenDetails`](https://reference.langchain.com/python/langsmith/schemas/InputTokenDetails)
- [`OutputTokenDetails`](https://reference.langchain.com/python/langsmith/schemas/OutputTokenDetails)
- [`InputCostDetails`](https://reference.langchain.com/python/langsmith/schemas/InputCostDetails)
- [`OutputCostDetails`](https://reference.langchain.com/python/langsmith/schemas/OutputCostDetails)
- [`UsageMetadata`](https://reference.langchain.com/python/langsmith/schemas/UsageMetadata)
- [`ExtractedUsageMetadata`](https://reference.langchain.com/python/langsmith/schemas/ExtractedUsageMetadata)
- [`UpsertExamplesResponse`](https://reference.langchain.com/python/langsmith/schemas/UpsertExamplesResponse)
- [`ExampleWithRuns`](https://reference.langchain.com/python/langsmith/schemas/ExampleWithRuns)
- [`ExperimentRunStats`](https://reference.langchain.com/python/langsmith/schemas/ExperimentRunStats)
- [`ExperimentResults`](https://reference.langchain.com/python/langsmith/schemas/ExperimentResults)
- [`InsightsReport`](https://reference.langchain.com/python/langsmith/schemas/InsightsReport)
- [`InsightsHighlightedTrace`](https://reference.langchain.com/python/langsmith/schemas/InsightsHighlightedTrace)
- [`InsightsSummaryReport`](https://reference.langchain.com/python/langsmith/schemas/InsightsSummaryReport)
- [`InsightsCluster`](https://reference.langchain.com/python/langsmith/schemas/InsightsCluster)
- [`InsightsReportResult`](https://reference.langchain.com/python/langsmith/schemas/InsightsReportResult)
- [`FeedbackFormulaWeightedVariable`](https://reference.langchain.com/python/langsmith/schemas/FeedbackFormulaWeightedVariable)
- [`FeedbackFormulaCreate`](https://reference.langchain.com/python/langsmith/schemas/FeedbackFormulaCreate)
- [`FeedbackFormulaUpdate`](https://reference.langchain.com/python/langsmith/schemas/FeedbackFormulaUpdate)
- [`FeedbackFormula`](https://reference.langchain.com/python/langsmith/schemas/FeedbackFormula)
- [`FeedbackConfigSchema`](https://reference.langchain.com/python/langsmith/schemas/FeedbackConfigSchema)
- [`StringNode`](https://reference.langchain.com/python/langsmith/anonymizer/StringNode)
- [`StringNodeProcessor`](https://reference.langchain.com/python/langsmith/anonymizer/StringNodeProcessor)
- [`ReplacerOptions`](https://reference.langchain.com/python/langsmith/anonymizer/ReplacerOptions)
- [`StringNodeRule`](https://reference.langchain.com/python/langsmith/anonymizer/StringNodeRule)
- [`RuleNodeProcessor`](https://reference.langchain.com/python/langsmith/anonymizer/RuleNodeProcessor)
- [`CallableNodeProcessor`](https://reference.langchain.com/python/langsmith/anonymizer/CallableNodeProcessor)
- [`ApiKeyAuth`](https://reference.langchain.com/python/langsmith/run_trees/ApiKeyAuth)
- [`ServiceAuth`](https://reference.langchain.com/python/langsmith/run_trees/ServiceAuth)
- [`AuthHeaders`](https://reference.langchain.com/python/langsmith/run_trees/AuthHeaders)
- [`WriteReplica`](https://reference.langchain.com/python/langsmith/run_trees/WriteReplica)
- [`RunTree`](https://reference.langchain.com/python/langsmith/run_trees/RunTree)
- [`ReplicaAuth`](https://reference.langchain.com/python/langsmith/run_trees/ReplicaAuth)
- [`SandboxClientError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxClientError)
- [`SandboxAPIError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxAPIError)
- [`SandboxAuthenticationError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxAuthenticationError)
- [`SandboxConnectionError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxConnectionError)
- [`SandboxServerReloadError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxServerReloadError)
- [`ResourceNotFoundError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceNotFoundError)
- [`ResourceTimeoutError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceTimeoutError)
- [`ResourceInUseError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceInUseError)
- [`ResourceAlreadyExistsError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceAlreadyExistsError)
- [`ResourceNameConflictError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceNameConflictError)
- [`ValidationError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ValidationError)
- [`QuotaExceededError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/QuotaExceededError)
- [`ResourceCreationError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceCreationError)
- [`DataplaneNotConfiguredError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/DataplaneNotConfiguredError)
- [`SandboxNotReadyError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxNotReadyError)
- [`SandboxOperationError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxOperationError)
- [`CommandTimeoutError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/CommandTimeoutError)
- [`TunnelError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/TunnelError)
- [`TunnelPortNotAllowedError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/TunnelPortNotAllowedError)
- [`TunnelConnectionRefusedError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/TunnelConnectionRefusedError)
- [`TunnelUnsupportedVersionError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/TunnelUnsupportedVersionError)
- [`Sandbox`](https://reference.langchain.com/python/langsmith/sandbox/_sandbox/Sandbox)
- [`ExecutionResult`](https://reference.langchain.com/python/langsmith/sandbox/_models/ExecutionResult)
- [`ResourceSpec`](https://reference.langchain.com/python/langsmith/sandbox/_models/ResourceSpec)
- [`Volume`](https://reference.langchain.com/python/langsmith/sandbox/_models/Volume)
- [`VolumeMountSpec`](https://reference.langchain.com/python/langsmith/sandbox/_models/VolumeMountSpec)
- [`SandboxTemplate`](https://reference.langchain.com/python/langsmith/sandbox/_models/SandboxTemplate)
- [`ResourceStatus`](https://reference.langchain.com/python/langsmith/sandbox/_models/ResourceStatus)
- [`Pool`](https://reference.langchain.com/python/langsmith/sandbox/_models/Pool)
- [`Snapshot`](https://reference.langchain.com/python/langsmith/sandbox/_models/Snapshot)
- [`ServiceURL`](https://reference.langchain.com/python/langsmith/sandbox/_models/ServiceURL)
- [`AsyncServiceURL`](https://reference.langchain.com/python/langsmith/sandbox/_models/AsyncServiceURL)
- [`OutputChunk`](https://reference.langchain.com/python/langsmith/sandbox/_models/OutputChunk)
- [`CommandHandle`](https://reference.langchain.com/python/langsmith/sandbox/_models/CommandHandle)
- [`AsyncCommandHandle`](https://reference.langchain.com/python/langsmith/sandbox/_models/AsyncCommandHandle)
- [`AsyncSandboxClient`](https://reference.langchain.com/python/langsmith/sandbox/_async_client/AsyncSandboxClient)
- [`YamuxStream`](https://reference.langchain.com/python/langsmith/sandbox/_yamux/YamuxStream)
- [`YamuxSession`](https://reference.langchain.com/python/langsmith/sandbox/_yamux/YamuxSession)
- [`RetryTransport`](https://reference.langchain.com/python/langsmith/sandbox/_transport/RetryTransport)
- [`AsyncRetryTransport`](https://reference.langchain.com/python/langsmith/sandbox/_transport/AsyncRetryTransport)
- [`Tunnel`](https://reference.langchain.com/python/langsmith/sandbox/_tunnel/Tunnel)
- [`AsyncTunnel`](https://reference.langchain.com/python/langsmith/sandbox/_tunnel/AsyncTunnel)
- [`SandboxClient`](https://reference.langchain.com/python/langsmith/sandbox/_client/SandboxClient)
- [`AsyncSandbox`](https://reference.langchain.com/python/langsmith/sandbox/_async_sandbox/AsyncSandbox)
- [`GitInfo`](https://reference.langchain.com/python/langsmith/env/_git/GitInfo)
- [`CategoricalScoreConfig`](https://reference.langchain.com/python/langsmith/evaluation/llm_evaluator/CategoricalScoreConfig)
- [`ContinuousScoreConfig`](https://reference.langchain.com/python/langsmith/evaluation/llm_evaluator/ContinuousScoreConfig)
- [`LLMEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/llm_evaluator/LLMEvaluator)
- [`Category`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/Category)
- [`FeedbackConfig`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/FeedbackConfig)
- [`EvaluationResult`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/EvaluationResult)
- [`EvaluationResults`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/EvaluationResults)
- [`RunEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/RunEvaluator)
- [`ComparisonEvaluationResult`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/ComparisonEvaluationResult)
- [`DynamicRunEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/DynamicRunEvaluator)
- [`DynamicComparisonRunEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/DynamicComparisonRunEvaluator)
- [`AsyncExperimentResults`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/AsyncExperimentResults)
- [`StringEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/string_evaluator/StringEvaluator)
- [`ExperimentResultRow`](https://reference.langchain.com/python/langsmith/evaluation/_runner/ExperimentResultRow)
- [`ExperimentResults`](https://reference.langchain.com/python/langsmith/evaluation/_runner/ExperimentResults)
- [`ComparativeExperimentResults`](https://reference.langchain.com/python/langsmith/evaluation/_runner/ComparativeExperimentResults)
- [`TracingExtra`](https://reference.langchain.com/python/langsmith/wrappers/_anthropic/TracingExtra)
- [`TracingExtra`](https://reference.langchain.com/python/langsmith/wrappers/_gemini/TracingExtra)
- [`TracingExtra`](https://reference.langchain.com/python/langsmith/wrappers/_openai/TracingExtra)

## Functions

- [`configure_global_prompt_cache()`](https://reference.langchain.com/python/langsmith/prompt_cache/configure_global_prompt_cache)
- [`configure_global_async_prompt_cache()`](https://reference.langchain.com/python/langsmith/prompt_cache/configure_global_async_prompt_cache)
- [`get_invalid_prompt_identifier_msg()`](https://reference.langchain.com/python/langsmith/utils/get_invalid_prompt_identifier_msg)
- [`tracing_is_enabled()`](https://reference.langchain.com/python/langsmith/utils/tracing_is_enabled)
- [`test_tracking_is_disabled()`](https://reference.langchain.com/python/langsmith/utils/test_tracking_is_disabled)
- [`xor_args()`](https://reference.langchain.com/python/langsmith/utils/xor_args)
- [`raise_for_status_with_text()`](https://reference.langchain.com/python/langsmith/utils/raise_for_status_with_text)
- [`get_enum_value()`](https://reference.langchain.com/python/langsmith/utils/get_enum_value)
- [`log_once()`](https://reference.langchain.com/python/langsmith/utils/log_once)
- [`get_messages_from_inputs()`](https://reference.langchain.com/python/langsmith/utils/get_messages_from_inputs)
- [`get_message_generation_from_outputs()`](https://reference.langchain.com/python/langsmith/utils/get_message_generation_from_outputs)
- [`get_prompt_from_inputs()`](https://reference.langchain.com/python/langsmith/utils/get_prompt_from_inputs)
- [`get_llm_generation_from_outputs()`](https://reference.langchain.com/python/langsmith/utils/get_llm_generation_from_outputs)
- [`get_docker_compose_command()`](https://reference.langchain.com/python/langsmith/utils/get_docker_compose_command)
- [`convert_langchain_message()`](https://reference.langchain.com/python/langsmith/utils/convert_langchain_message)
- [`is_base_message_like()`](https://reference.langchain.com/python/langsmith/utils/is_base_message_like)
- [`is_env_var_truish()`](https://reference.langchain.com/python/langsmith/utils/is_env_var_truish)
- [`get_env_var()`](https://reference.langchain.com/python/langsmith/utils/get_env_var)
- [`get_tracer_project()`](https://reference.langchain.com/python/langsmith/utils/get_tracer_project)
- [`filter_logs()`](https://reference.langchain.com/python/langsmith/utils/filter_logs)
- [`get_cache_dir()`](https://reference.langchain.com/python/langsmith/utils/get_cache_dir)
- [`filter_request_headers()`](https://reference.langchain.com/python/langsmith/utils/filter_request_headers)
- [`with_cache()`](https://reference.langchain.com/python/langsmith/utils/with_cache)
- [`with_optional_cache()`](https://reference.langchain.com/python/langsmith/utils/with_optional_cache)
- [`deepish_copy()`](https://reference.langchain.com/python/langsmith/utils/deepish_copy)
- [`is_version_greater_or_equal()`](https://reference.langchain.com/python/langsmith/utils/is_version_greater_or_equal)
- [`parse_prompt_identifier()`](https://reference.langchain.com/python/langsmith/utils/parse_prompt_identifier)
- [`get_api_url()`](https://reference.langchain.com/python/langsmith/utils/get_api_url)
- [`get_api_key()`](https://reference.langchain.com/python/langsmith/utils/get_api_key)
- [`get_workspace_id()`](https://reference.langchain.com/python/langsmith/utils/get_workspace_id)
- [`get_host_url()`](https://reference.langchain.com/python/langsmith/utils/get_host_url)
- [`is_truish()`](https://reference.langchain.com/python/langsmith/utils/is_truish)
- [`pytest_addoption()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_addoption)
- [`pytest_cmdline_preparse()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_cmdline_preparse)
- [`pytest_load_initial_conftests()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_load_initial_conftests)
- [`pytest_runtest_call()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_runtest_call)
- [`pytest_report_teststatus()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_report_teststatus)
- [`pytest_configure()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_configure)
- [`close_session()`](https://reference.langchain.com/python/langsmith/client/close_session)
- [`convert_prompt_to_openai_format()`](https://reference.langchain.com/python/langsmith/client/convert_prompt_to_openai_format)
- [`convert_prompt_to_anthropic_format()`](https://reference.langchain.com/python/langsmith/client/convert_prompt_to_anthropic_format)
- [`dump_model()`](https://reference.langchain.com/python/langsmith/client/dump_model)
- [`prep_obj_for_push()`](https://reference.langchain.com/python/langsmith/client/prep_obj_for_push)
- [`get_current_run_tree()`](https://reference.langchain.com/python/langsmith/run_helpers/get_current_run_tree)
- [`set_tracing_parent()`](https://reference.langchain.com/python/langsmith/run_helpers/set_tracing_parent)
- [`set_run_metadata()`](https://reference.langchain.com/python/langsmith/run_helpers/set_run_metadata)
- [`get_tracing_context()`](https://reference.langchain.com/python/langsmith/run_helpers/get_tracing_context)
- [`tracing_context()`](https://reference.langchain.com/python/langsmith/run_helpers/tracing_context)
- [`is_traceable_function()`](https://reference.langchain.com/python/langsmith/run_helpers/is_traceable_function)
- [`ensure_traceable()`](https://reference.langchain.com/python/langsmith/run_helpers/ensure_traceable)
- [`is_async()`](https://reference.langchain.com/python/langsmith/run_helpers/is_async)
- [`traceable()`](https://reference.langchain.com/python/langsmith/run_helpers/traceable)
- [`as_runnable()`](https://reference.langchain.com/python/langsmith/run_helpers/as_runnable)
- [`uuid7()`](https://reference.langchain.com/python/langsmith/uuid/uuid7)
- [`uuid7_from_datetime()`](https://reference.langchain.com/python/langsmith/uuid/uuid7_from_datetime)
- [`create_anonymizer()`](https://reference.langchain.com/python/langsmith/anonymizer/create_anonymizer)
- [`get_cached_client()`](https://reference.langchain.com/python/langsmith/run_trees/get_cached_client)
- [`configure()`](https://reference.langchain.com/python/langsmith/run_trees/configure)
- [`validate_extracted_usage_metadata()`](https://reference.langchain.com/python/langsmith/run_trees/validate_extracted_usage_metadata)
- [`merge_headers()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/merge_headers)
- [`validate_service_params()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/validate_service_params)
- [`validate_ttl()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/validate_ttl)
- [`parse_error_response()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/parse_error_response)
- [`parse_error_response_simple()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/parse_error_response_simple)
- [`parse_validation_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/parse_validation_error)
- [`extract_quota_type()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/extract_quota_type)
- [`raise_creation_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/raise_creation_error)
- [`handle_sandbox_creation_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/handle_sandbox_creation_error)
- [`handle_volume_creation_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/handle_volume_creation_error)
- [`handle_pool_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/handle_pool_error)
- [`handle_client_http_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/handle_client_http_error)
- [`handle_sandbox_http_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/handle_sandbox_http_error)
- [`run_ws_stream()`](https://reference.langchain.com/python/langsmith/sandbox/_ws_execute/run_ws_stream)
- [`reconnect_ws_stream()`](https://reference.langchain.com/python/langsmith/sandbox/_ws_execute/reconnect_ws_stream)
- [`run_ws_stream_async()`](https://reference.langchain.com/python/langsmith/sandbox/_ws_execute/run_ws_stream_async)
- [`reconnect_ws_stream_async()`](https://reference.langchain.com/python/langsmith/sandbox/_ws_execute/reconnect_ws_stream_async)
- [`exec_git()`](https://reference.langchain.com/python/langsmith/env/_git/exec_git)
- [`get_git_info()`](https://reference.langchain.com/python/langsmith/env/_git/get_git_info)
- [`get_runtime_and_metrics()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_runtime_and_metrics)
- [`get_system_metrics()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_system_metrics)
- [`get_runtime_environment()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_runtime_environment)
- [`get_langchain_environment()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_langchain_environment)
- [`get_langchain_core_version()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_langchain_core_version)
- [`get_docker_version()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_docker_version)
- [`get_docker_compose_version()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_docker_compose_version)
- [`get_docker_environment()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_docker_environment)
- [`get_langchain_env_vars()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_langchain_env_vars)
- [`get_langchain_env_var_metadata()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_langchain_env_var_metadata)
- [`get_release_shas()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_release_shas)
- [`random_name()`](https://reference.langchain.com/python/langsmith/evaluation/_name_generation/random_name)
- [`process_inputs()`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/DynamicRunEvaluator/__init__/process_inputs)
- [`run_evaluator()`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/run_evaluator)
- [`process_inputs()`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/DynamicComparisonRunEvaluator/__init__/process_inputs)
- [`comparison_evaluator()`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/comparison_evaluator)
- [`aevaluate()`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/aevaluate)
- [`aevaluate_existing()`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/aevaluate_existing)
- [`async_chain_from_iterable()`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/async_chain_from_iterable)
- [`async_iter_from_list()`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/async_iter_from_list)
- [`evaluate()`](https://reference.langchain.com/python/langsmith/evaluation/_runner/evaluate)
- [`evaluate_existing()`](https://reference.langchain.com/python/langsmith/evaluation/_runner/evaluate_existing)
- [`evaluate_comparative()`](https://reference.langchain.com/python/langsmith/evaluation/_runner/evaluate_comparative)
- [`wrap_anthropic()`](https://reference.langchain.com/python/langsmith/wrappers/_anthropic/wrap_anthropic)
- [`wrap_gemini()`](https://reference.langchain.com/python/langsmith/wrappers/_gemini/wrap_gemini)
- [`wrap_openai()`](https://reference.langchain.com/python/langsmith/wrappers/_openai/wrap_openai)

## Types

- [`ID_TYPE`](https://reference.langchain.com/python/langsmith/async_client/ID_TYPE)
- [`ID_TYPE`](https://reference.langchain.com/python/langsmith/client/ID_TYPE)
- [`SCORE_TYPE`](https://reference.langchain.com/python/langsmith/schemas/SCORE_TYPE)
- [`VALUE_TYPE`](https://reference.langchain.com/python/langsmith/schemas/VALUE_TYPE)
- [`ReplacerType`](https://reference.langchain.com/python/langsmith/anonymizer/ReplacerType)
- [`RequestHeaders`](https://reference.langchain.com/python/langsmith/sandbox/_sandbox/RequestHeaders)
- [`RequestHeaders`](https://reference.langchain.com/python/langsmith/sandbox/_async_client/RequestHeaders)
- [`RequestHeaders`](https://reference.langchain.com/python/langsmith/sandbox/_client/RequestHeaders)
- [`RequestHeaders`](https://reference.langchain.com/python/langsmith/sandbox/_async_sandbox/RequestHeaders)
- [`SUMMARY_EVALUATOR_T`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/SUMMARY_EVALUATOR_T)
- [`ATARGET_T`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/ATARGET_T)
- [`TARGET_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/TARGET_T)
- [`DATA_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/DATA_T)
- [`EVALUATOR_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/EVALUATOR_T)
- [`AEVALUATOR_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/AEVALUATOR_T)
- [`EXPERIMENT_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/EXPERIMENT_T)
