# langsmith > Python package 📖 [View in docs](https://reference.langchain.com/python/langsmith) ## Classes - [`Attachment`](https://reference.langchain.com/python/langsmith/schemas/Attachment) - [`BinaryIOLike`](https://reference.langchain.com/python/langsmith/schemas/BinaryIOLike) - [`ExampleBase`](https://reference.langchain.com/python/langsmith/schemas/ExampleBase) - [`ExampleCreate`](https://reference.langchain.com/python/langsmith/schemas/ExampleCreate) - [`ExampleUpsertWithAttachments`](https://reference.langchain.com/python/langsmith/schemas/ExampleUpsertWithAttachments) - [`AttachmentInfo`](https://reference.langchain.com/python/langsmith/schemas/AttachmentInfo) - [`Example`](https://reference.langchain.com/python/langsmith/schemas/Example) - [`AttachmentsOperations`](https://reference.langchain.com/python/langsmith/schemas/AttachmentsOperations) - [`ExampleUpdate`](https://reference.langchain.com/python/langsmith/schemas/ExampleUpdate) - [`DataType`](https://reference.langchain.com/python/langsmith/schemas/DataType) - [`DatasetBase`](https://reference.langchain.com/python/langsmith/schemas/DatasetBase) - [`DatasetTransformation`](https://reference.langchain.com/python/langsmith/schemas/DatasetTransformation) - [`Dataset`](https://reference.langchain.com/python/langsmith/schemas/Dataset) - [`DatasetVersion`](https://reference.langchain.com/python/langsmith/schemas/DatasetVersion) - [`RunBase`](https://reference.langchain.com/python/langsmith/schemas/RunBase) - [`Run`](https://reference.langchain.com/python/langsmith/schemas/Run) - [`RunTypeEnum`](https://reference.langchain.com/python/langsmith/schemas/RunTypeEnum) - [`RunLikeDict`](https://reference.langchain.com/python/langsmith/schemas/RunLikeDict) - [`RunWithAnnotationQueueInfo`](https://reference.langchain.com/python/langsmith/schemas/RunWithAnnotationQueueInfo) - [`FeedbackSourceBase`](https://reference.langchain.com/python/langsmith/schemas/FeedbackSourceBase) - [`APIFeedbackSource`](https://reference.langchain.com/python/langsmith/schemas/APIFeedbackSource) - [`ModelFeedbackSource`](https://reference.langchain.com/python/langsmith/schemas/ModelFeedbackSource) - [`FeedbackSourceType`](https://reference.langchain.com/python/langsmith/schemas/FeedbackSourceType) - [`FeedbackBase`](https://reference.langchain.com/python/langsmith/schemas/FeedbackBase) - [`FeedbackCategory`](https://reference.langchain.com/python/langsmith/schemas/FeedbackCategory) - [`FeedbackConfig`](https://reference.langchain.com/python/langsmith/schemas/FeedbackConfig) - [`FeedbackCreate`](https://reference.langchain.com/python/langsmith/schemas/FeedbackCreate) - [`Feedback`](https://reference.langchain.com/python/langsmith/schemas/Feedback) - [`TracerSession`](https://reference.langchain.com/python/langsmith/schemas/TracerSession) - [`TracerSessionResult`](https://reference.langchain.com/python/langsmith/schemas/TracerSessionResult) - [`BaseMessageLike`](https://reference.langchain.com/python/langsmith/schemas/BaseMessageLike) - [`DatasetShareSchema`](https://reference.langchain.com/python/langsmith/schemas/DatasetShareSchema) - [`AnnotationQueueRubricItem`](https://reference.langchain.com/python/langsmith/schemas/AnnotationQueueRubricItem) - [`AnnotationQueue`](https://reference.langchain.com/python/langsmith/schemas/AnnotationQueue) - [`AnnotationQueueWithDetails`](https://reference.langchain.com/python/langsmith/schemas/AnnotationQueueWithDetails) - [`BatchIngestConfig`](https://reference.langchain.com/python/langsmith/schemas/BatchIngestConfig) - [`LangSmithInfo`](https://reference.langchain.com/python/langsmith/schemas/LangSmithInfo) - [`LangSmithSettings`](https://reference.langchain.com/python/langsmith/schemas/LangSmithSettings) - [`FeedbackIngestToken`](https://reference.langchain.com/python/langsmith/schemas/FeedbackIngestToken) - [`RunEvent`](https://reference.langchain.com/python/langsmith/schemas/RunEvent) - [`TimeDeltaInput`](https://reference.langchain.com/python/langsmith/schemas/TimeDeltaInput) - [`DatasetDiffInfo`](https://reference.langchain.com/python/langsmith/schemas/DatasetDiffInfo) - [`ComparativeExperiment`](https://reference.langchain.com/python/langsmith/schemas/ComparativeExperiment) - [`PromptCommit`](https://reference.langchain.com/python/langsmith/schemas/PromptCommit) - [`ListedPromptCommit`](https://reference.langchain.com/python/langsmith/schemas/ListedPromptCommit) - [`Prompt`](https://reference.langchain.com/python/langsmith/schemas/Prompt) - [`ListPromptsResponse`](https://reference.langchain.com/python/langsmith/schemas/ListPromptsResponse) - [`PromptSortField`](https://reference.langchain.com/python/langsmith/schemas/PromptSortField) - [`FileEntry`](https://reference.langchain.com/python/langsmith/schemas/FileEntry) - [`AgentEntry`](https://reference.langchain.com/python/langsmith/schemas/AgentEntry) - [`SkillEntry`](https://reference.langchain.com/python/langsmith/schemas/SkillEntry) - [`AgentContext`](https://reference.langchain.com/python/langsmith/schemas/AgentContext) - [`SkillContext`](https://reference.langchain.com/python/langsmith/schemas/SkillContext) - [`DirectoryCommitInfo`](https://reference.langchain.com/python/langsmith/schemas/DirectoryCommitInfo) - [`DirectoryCommitResponse`](https://reference.langchain.com/python/langsmith/schemas/DirectoryCommitResponse) - [`InputTokenDetails`](https://reference.langchain.com/python/langsmith/schemas/InputTokenDetails) - [`OutputTokenDetails`](https://reference.langchain.com/python/langsmith/schemas/OutputTokenDetails) - [`InputCostDetails`](https://reference.langchain.com/python/langsmith/schemas/InputCostDetails) - [`OutputCostDetails`](https://reference.langchain.com/python/langsmith/schemas/OutputCostDetails) - [`UsageMetadata`](https://reference.langchain.com/python/langsmith/schemas/UsageMetadata) - [`ExtractedUsageMetadata`](https://reference.langchain.com/python/langsmith/schemas/ExtractedUsageMetadata) - [`UpsertExamplesResponse`](https://reference.langchain.com/python/langsmith/schemas/UpsertExamplesResponse) - [`ExampleWithRuns`](https://reference.langchain.com/python/langsmith/schemas/ExampleWithRuns) - [`ExperimentRunStats`](https://reference.langchain.com/python/langsmith/schemas/ExperimentRunStats) - [`ExperimentResults`](https://reference.langchain.com/python/langsmith/schemas/ExperimentResults) - [`InsightsReport`](https://reference.langchain.com/python/langsmith/schemas/InsightsReport) - [`InsightsHighlightedTrace`](https://reference.langchain.com/python/langsmith/schemas/InsightsHighlightedTrace) - [`InsightsSummaryReport`](https://reference.langchain.com/python/langsmith/schemas/InsightsSummaryReport) - [`InsightsCluster`](https://reference.langchain.com/python/langsmith/schemas/InsightsCluster) - [`InsightsReportResult`](https://reference.langchain.com/python/langsmith/schemas/InsightsReportResult) - [`FeedbackFormulaWeightedVariable`](https://reference.langchain.com/python/langsmith/schemas/FeedbackFormulaWeightedVariable) - [`FeedbackFormulaCreate`](https://reference.langchain.com/python/langsmith/schemas/FeedbackFormulaCreate) - [`FeedbackFormulaUpdate`](https://reference.langchain.com/python/langsmith/schemas/FeedbackFormulaUpdate) - [`FeedbackFormula`](https://reference.langchain.com/python/langsmith/schemas/FeedbackFormula) - [`FeedbackConfigSchema`](https://reference.langchain.com/python/langsmith/schemas/FeedbackConfigSchema) - [`AsyncClient`](https://reference.langchain.com/python/langsmith/async_client/AsyncClient) - [`RuntimeOverrides`](https://reference.langchain.com/python/langsmith/_runtime_overrides/RuntimeOverrides) - [`LangSmithPlugin`](https://reference.langchain.com/python/langsmith/pytest_plugin/LangSmithPlugin) - [`LangSmithError`](https://reference.langchain.com/python/langsmith/utils/LangSmithError) - [`LangSmithAPIError`](https://reference.langchain.com/python/langsmith/utils/LangSmithAPIError) - [`LangSmithRequestTimeout`](https://reference.langchain.com/python/langsmith/utils/LangSmithRequestTimeout) - [`LangSmithUserError`](https://reference.langchain.com/python/langsmith/utils/LangSmithUserError) - [`LangSmithRateLimitError`](https://reference.langchain.com/python/langsmith/utils/LangSmithRateLimitError) - [`LangSmithAuthError`](https://reference.langchain.com/python/langsmith/utils/LangSmithAuthError) - [`LangSmithNotFoundError`](https://reference.langchain.com/python/langsmith/utils/LangSmithNotFoundError) - [`LangSmithConflictError`](https://reference.langchain.com/python/langsmith/utils/LangSmithConflictError) - [`LangSmithConnectionError`](https://reference.langchain.com/python/langsmith/utils/LangSmithConnectionError) - [`LangSmithExceptionGroup`](https://reference.langchain.com/python/langsmith/utils/LangSmithExceptionGroup) - [`LangSmithWarning`](https://reference.langchain.com/python/langsmith/utils/LangSmithWarning) - [`LangSmithMissingAPIKeyWarning`](https://reference.langchain.com/python/langsmith/utils/LangSmithMissingAPIKeyWarning) - [`FilterPoolFullWarning`](https://reference.langchain.com/python/langsmith/utils/FilterPoolFullWarning) - [`FilterLangSmithRetry`](https://reference.langchain.com/python/langsmith/utils/FilterLangSmithRetry) - [`LangSmithRetry`](https://reference.langchain.com/python/langsmith/utils/LangSmithRetry) - [`ContextThreadPoolExecutor`](https://reference.langchain.com/python/langsmith/utils/ContextThreadPoolExecutor) - [`ZoneInfo`](https://reference.langchain.com/python/langsmith/client/ZoneInfo) - [`TracerProvider`](https://reference.langchain.com/python/langsmith/client/TracerProvider) - [`ListThreadsItem`](https://reference.langchain.com/python/langsmith/client/ListThreadsItem) - [`Client`](https://reference.langchain.com/python/langsmith/client/Client) - [`LangSmithExtra`](https://reference.langchain.com/python/langsmith/run_helpers/LangSmithExtra) - [`SupportsLangsmithExtra`](https://reference.langchain.com/python/langsmith/run_helpers/SupportsLangsmithExtra) - [`trace`](https://reference.langchain.com/python/langsmith/run_helpers/trace) - [`_NULL_SENTRY`](https://reference.langchain.com/python/langsmith/_expect/_NULL_SENTRY) - [`_Matcher`](https://reference.langchain.com/python/langsmith/_expect/_Matcher) - [`_Expect`](https://reference.langchain.com/python/langsmith/_expect/_Expect) - [`ApiKeyAuth`](https://reference.langchain.com/python/langsmith/run_trees/ApiKeyAuth) - [`ServiceAuth`](https://reference.langchain.com/python/langsmith/run_trees/ServiceAuth) - [`AuthHeaders`](https://reference.langchain.com/python/langsmith/run_trees/AuthHeaders) - [`WriteReplica`](https://reference.langchain.com/python/langsmith/run_trees/WriteReplica) - [`RunTree`](https://reference.langchain.com/python/langsmith/run_trees/RunTree) - [`ReplicaAuth`](https://reference.langchain.com/python/langsmith/run_trees/ReplicaAuth) - [`CacheEntry`](https://reference.langchain.com/python/langsmith/prompt_cache/CacheEntry) - [`CacheMetrics`](https://reference.langchain.com/python/langsmith/prompt_cache/CacheMetrics) - [`PromptCache`](https://reference.langchain.com/python/langsmith/prompt_cache/PromptCache) - [`AsyncPromptCache`](https://reference.langchain.com/python/langsmith/prompt_cache/AsyncPromptCache) - [`Cache`](https://reference.langchain.com/python/langsmith/prompt_cache/Cache) - [`AsyncCache`](https://reference.langchain.com/python/langsmith/prompt_cache/AsyncCache) - [`TracingMiddleware`](https://reference.langchain.com/python/langsmith/middleware/TracingMiddleware) - [`StringNode`](https://reference.langchain.com/python/langsmith/anonymizer/StringNode) - [`StringNodeProcessor`](https://reference.langchain.com/python/langsmith/anonymizer/StringNodeProcessor) - [`ReplacerOptions`](https://reference.langchain.com/python/langsmith/anonymizer/ReplacerOptions) - [`StringNodeRule`](https://reference.langchain.com/python/langsmith/anonymizer/StringNodeRule) - [`RuleNodeProcessor`](https://reference.langchain.com/python/langsmith/anonymizer/RuleNodeProcessor) - [`CallableNodeProcessor`](https://reference.langchain.com/python/langsmith/anonymizer/CallableNodeProcessor) - [`Tunnel`](https://reference.langchain.com/python/langsmith/sandbox/_tunnel/Tunnel) - [`AsyncTunnel`](https://reference.langchain.com/python/langsmith/sandbox/_tunnel/AsyncTunnel) - [`SandboxClient`](https://reference.langchain.com/python/langsmith/sandbox/_client/SandboxClient) - [`Sandbox`](https://reference.langchain.com/python/langsmith/sandbox/_sandbox/Sandbox) - [`SandboxProxySecret`](https://reference.langchain.com/python/langsmith/sandbox/_proxy_config/SandboxProxySecret) - [`YamuxStream`](https://reference.langchain.com/python/langsmith/sandbox/_yamux/YamuxStream) - [`YamuxSession`](https://reference.langchain.com/python/langsmith/sandbox/_yamux/YamuxSession) - [`RetryTransport`](https://reference.langchain.com/python/langsmith/sandbox/_transport/RetryTransport) - [`AsyncRetryTransport`](https://reference.langchain.com/python/langsmith/sandbox/_transport/AsyncRetryTransport) - [`AsyncSandbox`](https://reference.langchain.com/python/langsmith/sandbox/_async_sandbox/AsyncSandbox) - [`SandboxClientError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxClientError) - [`SandboxAPIError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxAPIError) - [`SandboxAuthenticationError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxAuthenticationError) - [`SandboxConnectionError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxConnectionError) - [`SandboxServerReloadError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxServerReloadError) - [`ResourceNotFoundError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceNotFoundError) - [`ResourceTimeoutError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceTimeoutError) - [`ResourceInUseError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceInUseError) - [`ResourceAlreadyExistsError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceAlreadyExistsError) - [`ResourceNameConflictError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceNameConflictError) - [`ValidationError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ValidationError) - [`QuotaExceededError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/QuotaExceededError) - [`ResourceCreationError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/ResourceCreationError) - [`DataplaneNotConfiguredError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/DataplaneNotConfiguredError) - [`SandboxNotReadyError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxNotReadyError) - [`SandboxOperationError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/SandboxOperationError) - [`CommandTimeoutError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/CommandTimeoutError) - [`TunnelError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/TunnelError) - [`TunnelPortNotAllowedError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/TunnelPortNotAllowedError) - [`TunnelConnectionRefusedError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/TunnelConnectionRefusedError) - [`TunnelUnsupportedVersionError`](https://reference.langchain.com/python/langsmith/sandbox/_exceptions/TunnelUnsupportedVersionError) - [`ExecutionResult`](https://reference.langchain.com/python/langsmith/sandbox/_models/ExecutionResult) - [`ResourceStatus`](https://reference.langchain.com/python/langsmith/sandbox/_models/ResourceStatus) - [`Snapshot`](https://reference.langchain.com/python/langsmith/sandbox/_models/Snapshot) - [`ServiceURL`](https://reference.langchain.com/python/langsmith/sandbox/_models/ServiceURL) - [`AsyncServiceURL`](https://reference.langchain.com/python/langsmith/sandbox/_models/AsyncServiceURL) - [`OutputChunk`](https://reference.langchain.com/python/langsmith/sandbox/_models/OutputChunk) - [`CommandHandle`](https://reference.langchain.com/python/langsmith/sandbox/_models/CommandHandle) - [`AsyncCommandHandle`](https://reference.langchain.com/python/langsmith/sandbox/_models/AsyncCommandHandle) - [`AsyncSandboxClient`](https://reference.langchain.com/python/langsmith/sandbox/_async_client/AsyncSandboxClient) - [`StringEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/string_evaluator/StringEvaluator) - [`Category`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/Category) - [`FeedbackConfig`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/FeedbackConfig) - [`EvaluationResult`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/EvaluationResult) - [`EvaluationResults`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/EvaluationResults) - [`RunEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/RunEvaluator) - [`ComparisonEvaluationResult`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/ComparisonEvaluationResult) - [`DynamicRunEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/DynamicRunEvaluator) - [`DynamicComparisonRunEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/DynamicComparisonRunEvaluator) - [`ExperimentResultRow`](https://reference.langchain.com/python/langsmith/evaluation/_runner/ExperimentResultRow) - [`ExperimentResults`](https://reference.langchain.com/python/langsmith/evaluation/_runner/ExperimentResults) - [`ComparativeExperimentResults`](https://reference.langchain.com/python/langsmith/evaluation/_runner/ComparativeExperimentResults) - [`CategoricalScoreConfig`](https://reference.langchain.com/python/langsmith/evaluation/llm_evaluator/CategoricalScoreConfig) - [`ContinuousScoreConfig`](https://reference.langchain.com/python/langsmith/evaluation/llm_evaluator/ContinuousScoreConfig) - [`LLMEvaluator`](https://reference.langchain.com/python/langsmith/evaluation/llm_evaluator/LLMEvaluator) - [`AsyncExperimentResults`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/AsyncExperimentResults) - [`TracingExtra`](https://reference.langchain.com/python/langsmith/wrappers/_anthropic/TracingExtra) - [`TracingExtra`](https://reference.langchain.com/python/langsmith/wrappers/_openai/TracingExtra) - [`TracingExtra`](https://reference.langchain.com/python/langsmith/wrappers/_gemini/TracingExtra) - [`InfoResource`](https://reference.langchain.com/python/langsmith/_openapi_client/resources/info/InfoResource) - [`AsyncInfoResource`](https://reference.langchain.com/python/langsmith/_openapi_client/resources/info/AsyncInfoResource) - [`InfoResourceWithRawResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/resources/info/InfoResourceWithRawResponse) - [`AsyncInfoResourceWithRawResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/resources/info/AsyncInfoResourceWithRawResponse) - [`InfoResourceWithStreamingResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/resources/info/InfoResourceWithStreamingResponse) - [`AsyncInfoResourceWithStreamingResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/resources/info/AsyncInfoResourceWithStreamingResponse) - [`Langsmith`](https://reference.langchain.com/python/langsmith/_openapi_client/_client/Langsmith) - [`AsyncLangsmith`](https://reference.langchain.com/python/langsmith/_openapi_client/_client/AsyncLangsmith) - [`LangsmithWithRawResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_client/LangsmithWithRawResponse) - [`AsyncLangsmithWithRawResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_client/AsyncLangsmithWithRawResponse) - [`LangsmithWithStreamedResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_client/LangsmithWithStreamedResponse) - [`AsyncLangsmithWithStreamedResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_client/AsyncLangsmithWithStreamedResponse) - [`SyncAPIResource`](https://reference.langchain.com/python/langsmith/_openapi_client/_resource/SyncAPIResource) - [`AsyncAPIResource`](https://reference.langchain.com/python/langsmith/_openapi_client/_resource/AsyncAPIResource) - [`SyncOffsetPaginationTopLevelArray`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/SyncOffsetPaginationTopLevelArray) - [`AsyncOffsetPaginationTopLevelArray`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/AsyncOffsetPaginationTopLevelArray) - [`SyncOffsetPaginationRepos`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/SyncOffsetPaginationRepos) - [`AsyncOffsetPaginationRepos`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/AsyncOffsetPaginationRepos) - [`SyncOffsetPaginationCommits`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/SyncOffsetPaginationCommits) - [`AsyncOffsetPaginationCommits`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/AsyncOffsetPaginationCommits) - [`SyncOffsetPaginationInsightsClusteringJobs`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/SyncOffsetPaginationInsightsClusteringJobs) - [`AsyncOffsetPaginationInsightsClusteringJobs`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/AsyncOffsetPaginationInsightsClusteringJobs) - [`CursorPaginationCursors`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/CursorPaginationCursors) - [`SyncCursorPagination`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/SyncCursorPagination) - [`AsyncCursorPagination`](https://reference.langchain.com/python/langsmith/_openapi_client/pagination/AsyncCursorPagination) - [`RequestOptions`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/RequestOptions) - [`NotGiven`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/NotGiven) - [`Omit`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/Omit) - [`ModelBuilderProtocol`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/ModelBuilderProtocol) - [`HeadersLikeProtocol`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/HeadersLikeProtocol) - [`InheritsGeneric`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/InheritsGeneric) - [`HttpxSendArgs`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/HttpxSendArgs) - [`SequenceNotStr`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/SequenceNotStr) - [`GenericModel`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/GenericModel) - [`typed_cached_property`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/typed_cached_property) - [`BaseAPIResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/BaseAPIResponse) - [`APIResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/APIResponse) - [`AsyncAPIResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/AsyncAPIResponse) - [`BinaryAPIResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/BinaryAPIResponse) - [`AsyncBinaryAPIResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/AsyncBinaryAPIResponse) - [`StreamedBinaryAPIResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/StreamedBinaryAPIResponse) - [`AsyncStreamedBinaryAPIResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/AsyncStreamedBinaryAPIResponse) - [`MissingStreamClassError`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/MissingStreamClassError) - [`StreamAlreadyConsumed`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/StreamAlreadyConsumed) - [`ResponseContextManager`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/ResponseContextManager) - [`AsyncResponseContextManager`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/AsyncResponseContextManager) - [`LangsmithError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/LangsmithError) - [`APIError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/APIError) - [`APIResponseValidationError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/APIResponseValidationError) - [`APIStatusError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/APIStatusError) - [`APIConnectionError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/APIConnectionError) - [`APITimeoutError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/APITimeoutError) - [`BadRequestError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/BadRequestError) - [`AuthenticationError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/AuthenticationError) - [`PermissionDeniedError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/PermissionDeniedError) - [`NotFoundError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/NotFoundError) - [`ConflictError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/ConflictError) - [`UnprocessableEntityError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/UnprocessableEntityError) - [`RateLimitError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/RateLimitError) - [`InternalServerError`](https://reference.langchain.com/python/langsmith/_openapi_client/_exceptions/InternalServerError) - [`BaseModel`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/BaseModel) - [`Config`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/BaseModel/Config) - [`CachedDiscriminatorType`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/CachedDiscriminatorType) - [`DiscriminatorDetails`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/DiscriminatorDetails) - [`GenericModel`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/GenericModel) - [`RootModel`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/RootModel) - [`FinalRequestOptionsInput`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/FinalRequestOptionsInput) - [`FinalRequestOptions`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/FinalRequestOptions) - [`Config`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/FinalRequestOptions/Config) - [`Stream`](https://reference.langchain.com/python/langsmith/_openapi_client/_streaming/Stream) - [`AsyncStream`](https://reference.langchain.com/python/langsmith/_openapi_client/_streaming/AsyncStream) - [`ServerSentEvent`](https://reference.langchain.com/python/langsmith/_openapi_client/_streaming/ServerSentEvent) - [`SSEDecoder`](https://reference.langchain.com/python/langsmith/_openapi_client/_streaming/SSEDecoder) - [`SSEBytesDecoder`](https://reference.langchain.com/python/langsmith/_openapi_client/_streaming/SSEBytesDecoder) - [`Querystring`](https://reference.langchain.com/python/langsmith/_openapi_client/_qs/Querystring) - [`Options`](https://reference.langchain.com/python/langsmith/_openapi_client/_qs/Options) - [`PageInfo`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/PageInfo) - [`BasePage`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/BasePage) - [`BaseSyncPage`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/BaseSyncPage) - [`AsyncPaginator`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/AsyncPaginator) - [`BaseAsyncPage`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/BaseAsyncPage) - [`BaseClient`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/BaseClient) - [`SyncHttpxClientWrapper`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/SyncHttpxClientWrapper) - [`SyncAPIClient`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/SyncAPIClient) - [`AsyncHttpxClientWrapper`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/AsyncHttpxClientWrapper) - [`AsyncAPIClient`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/AsyncAPIClient) - [`ForceMultipartDict`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/ForceMultipartDict) - [`OtherPlatform`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/OtherPlatform) - [`OtherArch`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/OtherArch) - [`BatchIngestConfig`](https://reference.langchain.com/python/langsmith/_openapi_client/types/info_list_response/BatchIngestConfig) - [`CustomerInfo`](https://reference.langchain.com/python/langsmith/_openapi_client/types/info_list_response/CustomerInfo) - [`InfoListResponse`](https://reference.langchain.com/python/langsmith/_openapi_client/types/info_list_response/InfoListResponse) - [`ResourcesProxy`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_resources_proxy/ResourcesProxy) - [`PropertyInfo`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_transform/PropertyInfo) - [`LazyProxy`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_proxy/LazyProxy) - [`GitInfo`](https://reference.langchain.com/python/langsmith/env/_git/GitInfo) ## Functions - [`set_runtime_overrides()`](https://reference.langchain.com/python/langsmith/_runtime_overrides/set_runtime_overrides) - [`get_runtime_overrides()`](https://reference.langchain.com/python/langsmith/_runtime_overrides/get_runtime_overrides) - [`pytest_addoption()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_addoption) - [`pytest_cmdline_preparse()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_cmdline_preparse) - [`pytest_load_initial_conftests()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_load_initial_conftests) - [`pytest_runtest_call()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_runtest_call) - [`pytest_report_teststatus()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_report_teststatus) - [`pytest_configure()`](https://reference.langchain.com/python/langsmith/pytest_plugin/pytest_configure) - [`get_invalid_prompt_identifier_msg()`](https://reference.langchain.com/python/langsmith/utils/get_invalid_prompt_identifier_msg) - [`tracing_is_enabled()`](https://reference.langchain.com/python/langsmith/utils/tracing_is_enabled) - [`test_tracking_is_disabled()`](https://reference.langchain.com/python/langsmith/utils/test_tracking_is_disabled) - [`xor_args()`](https://reference.langchain.com/python/langsmith/utils/xor_args) - [`raise_for_status_with_text()`](https://reference.langchain.com/python/langsmith/utils/raise_for_status_with_text) - [`get_enum_value()`](https://reference.langchain.com/python/langsmith/utils/get_enum_value) - [`log_once()`](https://reference.langchain.com/python/langsmith/utils/log_once) - [`get_messages_from_inputs()`](https://reference.langchain.com/python/langsmith/utils/get_messages_from_inputs) - [`get_message_generation_from_outputs()`](https://reference.langchain.com/python/langsmith/utils/get_message_generation_from_outputs) - [`get_prompt_from_inputs()`](https://reference.langchain.com/python/langsmith/utils/get_prompt_from_inputs) - [`get_llm_generation_from_outputs()`](https://reference.langchain.com/python/langsmith/utils/get_llm_generation_from_outputs) - [`get_docker_compose_command()`](https://reference.langchain.com/python/langsmith/utils/get_docker_compose_command) - [`convert_langchain_message()`](https://reference.langchain.com/python/langsmith/utils/convert_langchain_message) - [`is_base_message_like()`](https://reference.langchain.com/python/langsmith/utils/is_base_message_like) - [`is_env_var_truish()`](https://reference.langchain.com/python/langsmith/utils/is_env_var_truish) - [`get_env_var()`](https://reference.langchain.com/python/langsmith/utils/get_env_var) - [`get_tracer_project()`](https://reference.langchain.com/python/langsmith/utils/get_tracer_project) - [`filter_logs()`](https://reference.langchain.com/python/langsmith/utils/filter_logs) - [`get_cache_dir()`](https://reference.langchain.com/python/langsmith/utils/get_cache_dir) - [`filter_request_headers()`](https://reference.langchain.com/python/langsmith/utils/filter_request_headers) - [`with_cache()`](https://reference.langchain.com/python/langsmith/utils/with_cache) - [`with_optional_cache()`](https://reference.langchain.com/python/langsmith/utils/with_optional_cache) - [`deepish_copy()`](https://reference.langchain.com/python/langsmith/utils/deepish_copy) - [`is_version_greater_or_equal()`](https://reference.langchain.com/python/langsmith/utils/is_version_greater_or_equal) - [`parse_prompt_identifier()`](https://reference.langchain.com/python/langsmith/utils/parse_prompt_identifier) - [`parse_hub_identifier()`](https://reference.langchain.com/python/langsmith/utils/parse_hub_identifier) - [`get_api_url()`](https://reference.langchain.com/python/langsmith/utils/get_api_url) - [`get_api_key()`](https://reference.langchain.com/python/langsmith/utils/get_api_key) - [`get_workspace_id()`](https://reference.langchain.com/python/langsmith/utils/get_workspace_id) - [`get_host_url()`](https://reference.langchain.com/python/langsmith/utils/get_host_url) - [`is_truish()`](https://reference.langchain.com/python/langsmith/utils/is_truish) - [`close_session()`](https://reference.langchain.com/python/langsmith/client/close_session) - [`convert_prompt_to_openai_format()`](https://reference.langchain.com/python/langsmith/client/convert_prompt_to_openai_format) - [`convert_prompt_to_anthropic_format()`](https://reference.langchain.com/python/langsmith/client/convert_prompt_to_anthropic_format) - [`dump_model()`](https://reference.langchain.com/python/langsmith/client/dump_model) - [`prep_obj_for_push()`](https://reference.langchain.com/python/langsmith/client/prep_obj_for_push) - [`get_current_run_tree()`](https://reference.langchain.com/python/langsmith/run_helpers/get_current_run_tree) - [`set_tracing_parent()`](https://reference.langchain.com/python/langsmith/run_helpers/set_tracing_parent) - [`set_run_metadata()`](https://reference.langchain.com/python/langsmith/run_helpers/set_run_metadata) - [`get_tracing_context()`](https://reference.langchain.com/python/langsmith/run_helpers/get_tracing_context) - [`tracing_context()`](https://reference.langchain.com/python/langsmith/run_helpers/tracing_context) - [`is_traceable_function()`](https://reference.langchain.com/python/langsmith/run_helpers/is_traceable_function) - [`ensure_traceable()`](https://reference.langchain.com/python/langsmith/run_helpers/ensure_traceable) - [`is_async()`](https://reference.langchain.com/python/langsmith/run_helpers/is_async) - [`traceable()`](https://reference.langchain.com/python/langsmith/run_helpers/traceable) - [`as_runnable()`](https://reference.langchain.com/python/langsmith/run_helpers/as_runnable) - [`uuid7()`](https://reference.langchain.com/python/langsmith/uuid/uuid7) - [`uuid7_from_datetime()`](https://reference.langchain.com/python/langsmith/uuid/uuid7_from_datetime) - [`get_cached_client()`](https://reference.langchain.com/python/langsmith/run_trees/get_cached_client) - [`configure()`](https://reference.langchain.com/python/langsmith/run_trees/configure) - [`validate_extracted_usage_metadata()`](https://reference.langchain.com/python/langsmith/run_trees/validate_extracted_usage_metadata) - [`configure_global_prompt_cache()`](https://reference.langchain.com/python/langsmith/prompt_cache/configure_global_prompt_cache) - [`configure_global_async_prompt_cache()`](https://reference.langchain.com/python/langsmith/prompt_cache/configure_global_async_prompt_cache) - [`create_anonymizer()`](https://reference.langchain.com/python/langsmith/anonymizer/create_anonymizer) - [`workspace_secret()`](https://reference.langchain.com/python/langsmith/sandbox/_proxy_config/workspace_secret) - [`opaque_secret()`](https://reference.langchain.com/python/langsmith/sandbox/_proxy_config/opaque_secret) - [`aws_auth_proxy_config()`](https://reference.langchain.com/python/langsmith/sandbox/_proxy_config/aws_auth_proxy_config) - [`merge_headers()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/merge_headers) - [`validate_service_params()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/validate_service_params) - [`validate_ttl()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/validate_ttl) - [`parse_error_response()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/parse_error_response) - [`parse_error_response_simple()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/parse_error_response_simple) - [`parse_validation_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/parse_validation_error) - [`extract_quota_type()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/extract_quota_type) - [`raise_creation_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/raise_creation_error) - [`handle_sandbox_creation_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/handle_sandbox_creation_error) - [`handle_client_http_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/handle_client_http_error) - [`handle_sandbox_http_error()`](https://reference.langchain.com/python/langsmith/sandbox/_helpers/handle_sandbox_http_error) - [`run_ws_stream()`](https://reference.langchain.com/python/langsmith/sandbox/_ws_execute/run_ws_stream) - [`reconnect_ws_stream()`](https://reference.langchain.com/python/langsmith/sandbox/_ws_execute/reconnect_ws_stream) - [`run_ws_stream_async()`](https://reference.langchain.com/python/langsmith/sandbox/_ws_execute/run_ws_stream_async) - [`reconnect_ws_stream_async()`](https://reference.langchain.com/python/langsmith/sandbox/_ws_execute/reconnect_ws_stream_async) - [`process_inputs()`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/DynamicRunEvaluator/__init__/process_inputs) - [`run_evaluator()`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/run_evaluator) - [`process_inputs()`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/DynamicComparisonRunEvaluator/__init__/process_inputs) - [`comparison_evaluator()`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/comparison_evaluator) - [`evaluate()`](https://reference.langchain.com/python/langsmith/evaluation/_runner/evaluate) - [`evaluate_existing()`](https://reference.langchain.com/python/langsmith/evaluation/_runner/evaluate_existing) - [`evaluate_comparative()`](https://reference.langchain.com/python/langsmith/evaluation/_runner/evaluate_comparative) - [`random_name()`](https://reference.langchain.com/python/langsmith/evaluation/_name_generation/random_name) - [`aevaluate()`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/aevaluate) - [`aevaluate_existing()`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/aevaluate_existing) - [`async_chain_from_iterable()`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/async_chain_from_iterable) - [`async_iter_from_list()`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/async_iter_from_list) - [`wrap_anthropic()`](https://reference.langchain.com/python/langsmith/wrappers/_anthropic/wrap_anthropic) - [`wrap_openai()`](https://reference.langchain.com/python/langsmith/wrappers/_openai/wrap_openai) - [`wrap_gemini()`](https://reference.langchain.com/python/langsmith/wrappers/_gemini/wrap_gemini) - [`parse_obj()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/parse_obj) - [`field_is_required()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/field_is_required) - [`field_get_default()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/field_get_default) - [`field_outer_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/field_outer_type) - [`get_model_config()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/get_model_config) - [`get_model_fields()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/get_model_fields) - [`model_copy()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/model_copy) - [`model_json()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/model_json) - [`model_dump()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/model_dump) - [`model_parse()`](https://reference.langchain.com/python/langsmith/_openapi_client/_compat/model_parse) - [`to_streamed_response_wrapper()`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/to_streamed_response_wrapper) - [`async_to_streamed_response_wrapper()`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/async_to_streamed_response_wrapper) - [`to_custom_streamed_response_wrapper()`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/to_custom_streamed_response_wrapper) - [`async_to_custom_streamed_response_wrapper()`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/async_to_custom_streamed_response_wrapper) - [`to_raw_response_wrapper()`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/to_raw_response_wrapper) - [`async_to_raw_response_wrapper()`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/async_to_raw_response_wrapper) - [`to_custom_raw_response_wrapper()`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/to_custom_raw_response_wrapper) - [`async_to_custom_raw_response_wrapper()`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/async_to_custom_raw_response_wrapper) - [`extract_response_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_response/extract_response_type) - [`is_basemodel()`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/is_basemodel) - [`is_basemodel_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/is_basemodel_type) - [`build()`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/build) - [`construct_type_unchecked()`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/construct_type_unchecked) - [`construct_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/construct_type) - [`validate_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/validate_type) - [`set_pydantic_config()`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/set_pydantic_config) - [`is_stream_class_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_streaming/is_stream_class_type) - [`extract_stream_chunk_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_streaming/extract_stream_chunk_type) - [`make_request_options()`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/make_request_options) - [`get_platform()`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/get_platform) - [`platform_headers()`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/platform_headers) - [`get_python_runtime()`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/get_python_runtime) - [`get_python_version()`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/get_python_version) - [`get_architecture()`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/get_architecture) - [`is_base64_file_input()`](https://reference.langchain.com/python/langsmith/_openapi_client/_files/is_base64_file_input) - [`is_file_content()`](https://reference.langchain.com/python/langsmith/_openapi_client/_files/is_file_content) - [`assert_is_file_content()`](https://reference.langchain.com/python/langsmith/_openapi_client/_files/assert_is_file_content) - [`to_httpx_files()`](https://reference.langchain.com/python/langsmith/_openapi_client/_files/to_httpx_files) - [`read_file_content()`](https://reference.langchain.com/python/langsmith/_openapi_client/_files/read_file_content) - [`async_to_httpx_files()`](https://reference.langchain.com/python/langsmith/_openapi_client/_files/async_to_httpx_files) - [`async_read_file_content()`](https://reference.langchain.com/python/langsmith/_openapi_client/_files/async_read_file_content) - [`deepcopy_with_paths()`](https://reference.langchain.com/python/langsmith/_openapi_client/_files/deepcopy_with_paths) - [`function_has_argument()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_reflection/function_has_argument) - [`assert_signatures_in_sync()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_reflection/assert_signatures_in_sync) - [`openapi_dumps()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_json/openapi_dumps) - [`maybe_transform()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_transform/maybe_transform) - [`transform()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_transform/transform) - [`async_maybe_transform()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_transform/async_maybe_transform) - [`async_transform()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_transform/async_transform) - [`get_type_hints()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_transform/get_type_hints) - [`setup_logging()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_logs/setup_logging) - [`get_args()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_compat/get_args) - [`get_origin()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_compat/get_origin) - [`is_union()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_compat/is_union) - [`is_typeddict()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_compat/is_typeddict) - [`is_literal_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_compat/is_literal_type) - [`parse_date()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_compat/parse_date) - [`parse_datetime()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_compat/parse_datetime) - [`path_template()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_path/path_template) - [`to_thread()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_sync/to_thread) - [`asyncify()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_sync/asyncify) - [`is_annotated_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/is_annotated_type) - [`is_list_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/is_list_type) - [`is_sequence_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/is_sequence_type) - [`is_iterable_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/is_iterable_type) - [`is_union_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/is_union_type) - [`is_required_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/is_required_type) - [`is_typevar()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/is_typevar) - [`is_type_alias_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/is_type_alias_type) - [`strip_annotated_type()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/strip_annotated_type) - [`extract_type_arg()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/extract_type_arg) - [`extract_type_var_from_base()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_typing/extract_type_var_from_base) - [`parse_datetime()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_datetime_parse/parse_datetime) - [`parse_date()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_datetime_parse/parse_date) - [`flatten()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/flatten) - [`extract_files()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/extract_files) - [`is_given()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_given) - [`is_tuple()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_tuple) - [`is_tuple_t()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_tuple_t) - [`is_sequence()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_sequence) - [`is_sequence_t()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_sequence_t) - [`is_mapping()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_mapping) - [`is_mapping_t()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_mapping_t) - [`is_dict()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_dict) - [`is_list()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_list) - [`is_iterable()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/is_iterable) - [`human_join()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/human_join) - [`quote()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/quote) - [`required_args()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/required_args) - [`strip_not_given()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/strip_not_given) - [`coerce_integer()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/coerce_integer) - [`coerce_float()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/coerce_float) - [`coerce_boolean()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/coerce_boolean) - [`maybe_coerce_integer()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/maybe_coerce_integer) - [`maybe_coerce_float()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/maybe_coerce_float) - [`maybe_coerce_boolean()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/maybe_coerce_boolean) - [`removeprefix()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/removeprefix) - [`removesuffix()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/removesuffix) - [`file_from_path()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/file_from_path) - [`get_required_header()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/get_required_header) - [`get_async_library()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/get_async_library) - [`lru_cache()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/lru_cache) - [`json_safe()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_utils/json_safe) - [`consume_sync_iterator()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_streams/consume_sync_iterator) - [`consume_async_iterator()`](https://reference.langchain.com/python/langsmith/_openapi_client/_utils/_streams/consume_async_iterator) - [`exec_git()`](https://reference.langchain.com/python/langsmith/env/_git/exec_git) - [`get_git_info()`](https://reference.langchain.com/python/langsmith/env/_git/get_git_info) - [`get_runtime_and_metrics()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_runtime_and_metrics) - [`get_system_metrics()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_system_metrics) - [`get_runtime_environment()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_runtime_environment) - [`get_langchain_environment()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_langchain_environment) - [`get_langchain_core_version()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_langchain_core_version) - [`get_docker_version()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_docker_version) - [`get_docker_compose_version()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_docker_compose_version) - [`get_docker_environment()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_docker_environment) - [`get_langchain_env_vars()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_langchain_env_vars) - [`get_langchain_env_var_metadata()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_langchain_env_var_metadata) - [`get_release_shas()`](https://reference.langchain.com/python/langsmith/env/_runtime_env/get_release_shas) ## Types - [`SCORE_TYPE`](https://reference.langchain.com/python/langsmith/schemas/SCORE_TYPE) - [`VALUE_TYPE`](https://reference.langchain.com/python/langsmith/schemas/VALUE_TYPE) - [`ID_TYPE`](https://reference.langchain.com/python/langsmith/async_client/ID_TYPE) - [`ID_TYPE`](https://reference.langchain.com/python/langsmith/client/ID_TYPE) - [`ReplacerType`](https://reference.langchain.com/python/langsmith/anonymizer/ReplacerType) - [`RequestHeaders`](https://reference.langchain.com/python/langsmith/sandbox/_client/RequestHeaders) - [`RequestHeaders`](https://reference.langchain.com/python/langsmith/sandbox/_sandbox/RequestHeaders) - [`RequestHeaders`](https://reference.langchain.com/python/langsmith/sandbox/_async_sandbox/RequestHeaders) - [`RequestHeaders`](https://reference.langchain.com/python/langsmith/sandbox/_async_client/RequestHeaders) - [`SUMMARY_EVALUATOR_T`](https://reference.langchain.com/python/langsmith/evaluation/evaluator/SUMMARY_EVALUATOR_T) - [`TARGET_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/TARGET_T) - [`DATA_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/DATA_T) - [`EVALUATOR_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/EVALUATOR_T) - [`AEVALUATOR_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/AEVALUATOR_T) - [`EXPERIMENT_T`](https://reference.langchain.com/python/langsmith/evaluation/_runner/EXPERIMENT_T) - [`ATARGET_T`](https://reference.langchain.com/python/langsmith/evaluation/_arunner/ATARGET_T) - [`ProxiesTypes`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/ProxiesTypes) - [`Base64FileInput`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/Base64FileInput) - [`FileContent`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/FileContent) - [`BinaryTypes`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/BinaryTypes) - [`AsyncBinaryTypes`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/AsyncBinaryTypes) - [`FileTypes`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/FileTypes) - [`RequestFiles`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/RequestFiles) - [`HttpxFileContent`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/HttpxFileContent) - [`HttpxFileTypes`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/HttpxFileTypes) - [`HttpxRequestFiles`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/HttpxRequestFiles) - [`HeadersLike`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/HeadersLike) - [`StrBytesIntFloat`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/StrBytesIntFloat) - [`IncEx`](https://reference.langchain.com/python/langsmith/_openapi_client/_types/IncEx) - [`EagerIterable`](https://reference.langchain.com/python/langsmith/_openapi_client/_models/EagerIterable) - [`PrimitiveData`](https://reference.langchain.com/python/langsmith/_openapi_client/_qs/PrimitiveData) - [`Data`](https://reference.langchain.com/python/langsmith/_openapi_client/_qs/Data) - [`Platform`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/Platform) - [`Arch`](https://reference.langchain.com/python/langsmith/_openapi_client/_base_client/Arch)