Document Loaders

Security Note: This loader can be used to load all URLs specified in a sitemap. If a malicious actor gets access to the sitemap, they could force the server t

Class

TensorflowDatasetLoader

Load from TensorFlow Dataset.

Class

UnstructuredCHMLoader

Load CHM files using Unstructured.

CHM means Microsoft Compiled HTML Help.

Examples

from langchain_community.document_loaders import UnstructuredCHMLoader

loader = UnstructuredCHMLoade

Class

CHMParser

Microsoft Compiled HTML Help (CHM) Parser.

Class

UnstructuredOrgModeLoader

Load Org-Mode files using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Document

Class

HuggingFaceDatasetLoader

Load from Hugging Face Hub datasets.

Class

RoamLoader

Load Roam files from a directory.

Class

BaseDataFrameLoader

Class

DataFrameLoader

Load Pandas DataFrame.

Class

DropboxLoader

Load files from Dropbox.

In addition to common files such as text and PDF files, it also supports Dropbox Paper files.

Class

OneNoteLoader

Load pages from OneNote notebooks.

Class

TelegramChatFileLoader

Load from Telegram chat dump.

Class

TelegramChatApiLoader

Load Telegram chat json directory dump.

Class

LLMSherpaFileLoader

Load Documents using LLMSherpa.

LLMSherpaFileLoader use LayoutPDFReader, which is part of the LLMSherpa library. This tool is designed to parse PDFs while preserving their layout information, which

Class

PebbloSafeLoader

Pebblo Safe Loader class is a wrapper around document loaders enabling the data to be scrutinized.

Class

PebbloTextLoader

Loader for text data.

Since PebbloSafeLoader is a wrapper around document loaders, this loader is used to load text data directly into Documents.

Class

IFixitLoader

Load iFixit repair guides, device wikis and answers.

iFixit is the largest, open repair community on the web. The site contains nearly 100k repair manuals, 200k Questions & Answers on 42k devices,

Class

Docx2txtLoader

Load DOCX file using docx2txt and chunks at character level.

Defaults to check for local file, but if the file is a web path, it will download it to a temporary file, and use that, then clean up

Class

UnstructuredWordDocumentLoader

Load Microsoft Word file using Unstructured.

Works with both .docx and .doc files. You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will

Class

OBSDirectoryLoader

Load from Huawei OBS directory.

Class

SnowflakeLoader

Load from Snowflake API.

Each document represents one row of the result. The page_content_columns are written into the page_content of the document. The metadata_columns are written into the

Class

HuggingFaceModelLoader

Load model information from Hugging Face Hub, including README content.

This loader interfaces with the Hugging Face Models API to fetch and load model metadata and README files. The API allows you

Class

CassandraLoader

Class

MintbaseDocumentLoader

Load elements from a blockchain smart contract.

The supported blockchains are: Near mainnet, Near testnet.

If no BlockchainType is specified, the default is Near mainnet.

The Loader uses the Mintba

Class

UnstructuredRTFLoader

Load RTF files using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Document obje

Class

UnstructuredPDFLoader

Load PDF files using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Document obje

Class

BasePDFLoader

Base Loader class for PDF files.

If the file is a web path, it will download it to a temporary file, use it, then clean up the temporary file after completion.

Class

OnlinePDFLoader

Load online PDF.

Class

PyPDFLoader

Load and parse a PDF file using 'pypdf' library.

This class provides methods to load and parse PDF documents, supporting various configurations such as handling password-protected files, extrac

Class

PyPDFium2Loader

Load and parse a PDF file using the pypdfium2 library.

This class provides methods to load and parse PDF documents, supporting various configurations such as handling password-protected files

Class

PyPDFDirectoryLoader

Load and parse a directory of PDF files using 'pypdf' library.

This class provides methods to load and parse multiple PDF documents in a directory, supporting options for recursive search, handling p

Class

PDFMinerLoader

Load and parse a PDF file using 'pdfminer.six' library.

This class provides methods to load and parse PDF documents, supporting various configurations such as handling password-protected files,

Class

PDFMinerPDFasHTMLLoader

Load PDF files as HTML content using PDFMiner.

Class

PyMuPDFLoader

Load and parse a PDF file using 'PyMuPDF' library.

This class provides methods to load and parse PDF documents, supporting various configurations such as handling password-protected files, extr

Class

MathpixPDFLoader

Load PDF files using Mathpix service.

Class

PDFPlumberLoader

Load PDF files using pdfplumber.

Class

AmazonTextractPDFLoader

Load PDF files from a local file system, HTTP or S3.

To authenticate, the AWS client uses the following methods to automatically load credentials: https://boto3.amazonaws.com/v1/documentation/api/l

Class

DedocPDFLoader

DedocPDFLoader document loader integration to load PDF files using dedoc. The file loader can automatically detect the correctness of a textual layer in the PDF document. Note that __init__ me

Class

DocumentIntelligenceLoader

Load a PDF with Azure Document Intelligence

Class

ZeroxPDFLoader

Document loader utilizing Zerox library: https://github.com/getomni-ai/zerox

Zerox converts PDF document to series of images (page-wise) and uses vision-capable LLM model to generate Markdown represe

Class

YuqueLoader

Load documents from Yuque.

Class

OpenCityDataLoader

Load from Open City.

Class

XorbitsLoader

Load Xorbits DataFrame.

Class

LakeFSClient

Client for lakeFS.

Class

LakeFSLoader

Load from lakeFS.

Class

UnstructuredLakeFSLoader

Load from lakeFS as unstructured data.

Class

AthenaLoader

Load documents from AWS Athena.

Each document represents one row of the result.

By default, all columns are written into the page_content of the document and none into the metadata of the doc

Class

OneDriveLoader

Load documents from Microsoft OneDrive. Uses SharePointLoader under the hood.

Class

BaiduBOSFileLoader

Load from Baidu Cloud BOS file.

Class

UnstructuredEPubLoader

Load EPub files using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Document obj

Class

ChatGPTLoader

Load conversations from exported ChatGPT data.

Class

BrowserlessLoader

Load webpages with Browserless /content endpoint.

Class

AsyncChromiumLoader

Scrape HTML pages from URLs using a headless instance of the Chromium.

Class

AsyncHtmlLoader

Load HTML asynchronously.

Class

CoNLLULoader

Load CoNLL-U files.

Class

UnstructuredURLLoader

Load files from remote URLs using Unstructured.

Use the unstructured partition function to detect the MIME type and route the file to the appropriate partitioner.

You can run the loader in one of

Class

ImageCaptionLoader

Load image captions.

By default, the loader utilizes the pre-trained Salesforce BLIP image captioning model. https://huggingface.co/Salesforce/blip-image-captioning-base

Class

NotionDirectoryLoader

Load Notion directory dump.

Class

IuguLoader

Load from IUGU.

Class

AzureAIDataLoader

Load from Azure AI Data.

Class

FaunaLoader

Load from FaunaDB.

Class

MongodbLoader

Load MongoDB documents.

Class

WebBaseLoader

WebBaseLoader document loader integration

Class

DirectoryLoader

Load from a directory.

Class

ArcGISLoader

Load records from an ArcGIS FeatureLayer.

Class

QuipLoader

Load Quip pages.

Port of https://github.com/quip/quip-api/tree/master/samples/baqup

Class

ConcurrentLoader

Load and pars Documents concurrently.

Class

TranscriptFormat

Transcript format to use for the document loader.

Class

AssemblyAIAudioTranscriptLoader

Load AssemblyAI audio transcripts.

It uses the AssemblyAI API to transcribe audio files and loads the transcribed text into one or more Documents, depending on the specified format.

To use, you shou

Class

AssemblyAIAudioLoaderById

Load AssemblyAI audio transcripts.

It uses the AssemblyAI API to get an existing transcription and loads the transcribed text into one or more Documents, depending on the specified format.

Class

TomlLoader

Load TOML files.

It can load a single source file or several files in a single directory.

Class

AirtableLoader

Load the Airtable tables.

Class

CollegeConfidentialLoader

Load College Confidential webpages.

Class

PolarsDataFrameLoader

Load Polars DataFrame.

Class

GeoDataFrameLoader

Load geopandas Dataframe.

Class

GenericLoader

Generic Document Loader.

A generic document loader that allows combining an arbitrary blob loader with a blob parser.

Examples:

Parse a specific PDF file:

.. code-block:: python

    f

Class

SurrealDBLoader

Load SurrealDB documents.

Class

ArxivLoader

Load a query result from Arxiv. The loader converts the original PDF format into the text.

Class

BibtexLoader

Load a bibtex file.

Each document represents one entry from the bibtex file.

If a PDF file is present in the file bibtex field, the original PDF is loaded into the document text. If no such file

Class

GoogleApiClient

Generic Google API Client.

To use, you should have the google_auth_oauthlib,youtube_transcript_api,google python package installed. As the google api expects credentials you need to set up a goog

Class

TranscriptFormat

Output formats of transcripts from YoutubeLoader.

Class

YoutubeLoader

Load YouTube video transcripts.

Class

GoogleApiYoutubeLoader

Load all Videos from a YouTube Channel.

To use, you should have the googleapiclient,youtube_transcript_api python package installed. As the service needs a google_api_client, you first have to

Class

RSSFeedLoader

Load news articles from RSS feeds using Unstructured.

Class

CubeSemanticLoader

Load Cube semantic layer metadata.

Class

LarkSuiteDocLoader

Load from LarkSuite (FeiShu).

Class

LarkSuiteWikiLoader

Load from LarkSuite (FeiShu) wiki.

Class

JoplinLoader

Load notes from Joplin.

In order to use this loader, you need to have Joplin running with the Web Clipper enabled (look for "Web Clipper" in the app settings).

To get the access token, you need to

Class

MaxComputeLoader

Load from Alibaba Cloud MaxCompute table.

Class

TwitterTweetLoader

Load Twitter tweets.

Read tweets of the user's Twitter handle.

First you need to go to https://developer.twitter.com/en/docs/twitter-api /getting-started/getting-access-to-the-twitter-api to get

Class

DatadogLogsLoader

Load Datadog logs.

Logs are written into the page_content and into the metadata.

Class

CouchbaseLoader

Load documents from Couchbase.

Each document represents one row of the result. The page_content_fields are written into the page_contentof the document. The metadata_fields are written into t

Class

SpreedlyLoader

Load from Spreedly API.

Class

SQLDatabaseLoader

Load documents by querying database tables supported by SQLAlchemy.

For talking to the database, the document loader uses the SQLDatabase utility from the LangChain integration toolkit.

Each docum

Class

IMSDbLoader

Load IMSDb webpages.

Class

FigmaFileLoader

Load Figma file.

Class

O365BaseLoader

Base class for all loaders that uses O365 Package

Class

ContentFormat

Enumerator of the content formats of Confluence page.

Class

ConfluenceLoader

Load Confluence pages.

Port of https://llamahub.ai/l/confluence This currently supports username/api_key, Oauth2 login, personal access token or cookies authentication.

Specify a list page_ids and

Class

AirbyteCDKLoader

Load with an Airbyte source connector implemented using the CDK.

Class

CDKIntegration

A wrapper around the CDK integration.

Class

AirbyteHubspotLoader

Load from Hubspot using an Airbyte source connector.

Class

AirbyteStripeLoader

Load from Stripe using an Airbyte source connector.

Class

AirbyteTypeformLoader

Load from Typeform using an Airbyte source connector.

Class

AirbyteZendeskSupportLoader

Load from Zendesk Support using an Airbyte source connector.

Class

AirbyteShopifyLoader

Load from Shopify using an Airbyte source connector.

Class

AirbyteSalesforceLoader

Load from Salesforce using an Airbyte source connector.

Class

AirbyteGongLoader

Load from Gong using an Airbyte source connector.

Class

ReadTheDocsLoader

Load ReadTheDocs documentation directory.

Class

SlackDirectoryLoader

Load from a Slack directory dump.

Class

AZLyricsLoader

Load AZLyrics webpages.

Class

KineticaLoader

Load from Kinetica API.

Each document represents one row of the result. The page_content_columns are written into the page_content of the document. The metadata_columns are written into the `

Class

AzureAIDocumentIntelligenceLoader

Load a PDF with Azure Document Intelligence.

Class

ObsidianLoader

Load Obsidian files from directory.

Class

EverNoteLoader

Document loader for EverNote ENEX export files.

Loads EverNote notebook export files (.enex format) into LangChain Documents. Extracts plain text content from HTML and preserves note metadata inc

Class

PythonLoader

Load Python files, respecting any non-default encoding if specified.

Class

HNLoader

Load Hacker News data.

It loads data from either main page results or the comments page.

Class

UnstructuredMarkdownLoader

Load Markdown files using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Document

Class

WeatherDataLoader

Load weather data with Open Weather Map API.

Reads the forecast & current weather of any location using OpenWeatherMap's free API. Checkout 'https://openweathermap.org/appid' for more on how to gen

Class

FileEncoding

File encoding as the NamedTuple.

Class

NeedleLoader

NeedleLoader is a document loader for managing documents stored in a collection.

Class

SharePointLoader

Load from SharePoint.

Class

VsdxLoader

Class

NucliaLoader

Load from any file type using Nuclia Understanding API.

Class

UnstructuredPowerPointLoader

Load Microsoft PowerPoint files using Unstructured.

Works with both .ppt and .pptx files. You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the docume

Class

DedocBaseLoader

Base Loader that uses dedoc (https://dedoc.readthedocs.io).

Loader enables extracting text, tables and attached files from the given file: * Text can be split by pages, dedoc tree nodes, te

Class

DedocFileLoader

DedocFileLoader document loader integration to load files using dedoc.

The file loader automatically detects the file type (with the correct extension). The list of supported file types is gives at

Class

DedocAPIFileLoader

Load files using dedoc API. The file loader automatically detects the file type (even with the wrong extension). By default, the loader makes a call to the locally hosted dedoc API. More informati

Class

SRTLoader

Load .srt (subtitle) files.

Class

DiffbotLoader

Load Diffbot json file.

Class

TencentCOSDirectoryLoader

Load from Tencent Cloud COS directory.

Class

PySparkDataFrameLoader

Load PySpark DataFrames.

Class

ColumnNotFoundError

Column not found error.

Class

RocksetLoader

Load from a Rockset database.

To use, you should have the rockset python package installed.

Class

ScrapflyLoader

Turn a url to llm accessible markdown with Scrapfly.io.

For further details, visit: https://scrapfly.io/docs/sdk/python

Class

DuckDBLoader

Load from DuckDB.

Each document represents one row of the result. The page_content_columns are written into the page_content of the document. The metadata_columns are written into the `metada

Class

GitbookLoader

Load GitBook data.

load from either a single page, or
load all (relative) paths in the sitemap, handling nested sitemap indexes.

When load_all_paths=True, the loader parses XML sitemaps an

Class

CSVLoader

Load a CSV file into a list of Document objects.

Each document represents one row of the CSV file. Every row is converted into a key/value pair and outputted to a new line in the document's page_

Class

UnstructuredCSVLoader

Load CSV files using Unstructured.

Like other Unstructured loaders, UnstructuredCSVLoader can be used in both "single" and "elements" mode. If you use the loader in "elements" mode, the CSV file

Class

BlackboardLoader

Load a Blackboard course.

This loader is not compatible with all Blackboard courses. It is only compatible with courses that use the new Blackboard interface. To use this loader, you must have the

Class

GutenbergLoader

Load from Gutenberg.org.

Class

AcreomLoader

Load acreom vault from a directory.

Class

StripeLoader

Load from Stripe API.

Class

UnstructuredXMLLoader

Load XML file using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Document objec

Class

MergedDataLoader

Merge documents from a list of loaders

Class

BaiduBOSDirectoryLoader

Load from Baidu BOS directory.

Class

FacebookChatLoader

Load Facebook Chat messages directory dump.

Class

BSHTMLLoader

ModuleName document loader integration

Class

UnstructuredTSVLoader

Load TSV files using Unstructured.

Like other Unstructured loaders, UnstructuredTSVLoader can be used in both "single" and "elements" mode. If you use the loader in "elements" mode, the TSV file

Class

S3FileLoader

Load from Amazon AWS S3 file.

Class

UnstructuredImageLoader

Load PNG and JPG files using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Doc

Class

JSONLoader

Load a JSON file using a jq schema.

Class

PlaywrightEvaluator

Abstract base class for all evaluators.

Each evaluator should take a page, a browser instance, and a response object, process the page as necessary, and return the resulting text.

Class

UnstructuredHtmlEvaluator

Evaluate the page HTML content using the unstructured library.

Class

PlaywrightURLLoader

Load HTML pages with Playwright and parse with Unstructured.

This is useful for loading pages that require javascript to render.

Class

ToMarkdownLoader

Load HTML using 2markdown API.

Class

BlockchainType

Enumerator of the supported blockchains.

Class

BlockchainDocumentLoader

Load elements from a blockchain smart contract.

See supported blockchains here: https://python.langchain.com/v0.2/api_reference/community/document_loaders/langchain_community.document_loaders.blockch

Class

DocusaurusLoader

Load from Docusaurus Documentation.

It leverages the SitemapLoader to loop through the generated pages of a Docusaurus Documentation website and extracts the content by looking for specific HTML tags

Class

OneDriveFileLoader

Load a file from Microsoft OneDrive.

Class

MWDumpLoader

Load MediaWiki dump from an XML file.

Class

UnstructuredRSTLoader

Load RST files using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Document obje

Class

MastodonTootsLoader

Load the Mastodon 'toots'.

Class

RecursiveUrlLoader

Recursively load all child links from a root URL.

Security Note: This loader is a crawler that will start crawling at a given URL and then expand to crawl child links recursively.

We

Class

TextLoader

Load text file.

Class

MHTMLLoader

Parse MHTML files with BeautifulSoup.

Class

GitLoader

Load Git repository files.

The Repository can be local on disk available at repo_path, or remote at clone_url that will be cloned to repo_path. Currently, supports only text files.

Each docu

Class

WikipediaLoader

Load from Wikipedia.

The hard limit on the length of the query is 300 for now.

Each wiki page represents one Document.

Class

UnstructuredODTLoader

Load OpenOffice ODT files using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Do

Class

FireCrawlLoader

FireCrawlLoader document loader integration

Class

NewsURLLoader

Load news articles from URLs using Unstructured.

Class

RedditPostsLoader

Load Reddit posts.

Read posts on a subreddit. First, you need to go to https://www.reddit.com/prefs/apps/ and create your application

Class

SeleniumURLLoader

Load HTML pages with Selenium and parse with Unstructured.

This is useful for loading pages that require javascript to render.

Class

TrelloLoader

Load cards from a Trello board.

Class

ModernTreasuryLoader

Load from Modern Treasury.

Class

PubMedLoader

Load from the PubMed biomedical library.

Class

UnstructuredBaseLoader

Base Loader that uses Unstructured.

Class

EtherscanLoader

Load transactions from Ethereum mainnet.

The Loader use Etherscan API to interact with Ethereum mainnet.

ETHERSCAN_API_KEY environment variable must be set use this loader.

Class

UnstructuredHTMLLoader

Load HTML files using Unstructured.

You can run the loader in one of two modes: "single" and "elements". If you use "single" mode, the document will be returned as a single langchain Document obj

Class

WhatsAppChatLoader

Load WhatsApp messages text file.

Class

UnstructuredEmailLoader

Load email files using Unstructured.

Works with both .eml and .msg files. You can process attachments in addition to the e-mail message itself by passing process_attachments=True into the construct

Class

OutlookMessageLoader

Loads Outlook Message files using extract_msg.

https://github.com/TeamMsgExtractor/msg-extractor

Class

GlueCatalogLoader

Load table schemas from AWS Glue.

This loader fetches the schema of each table within a specified AWS Glue database. The schema details include column names and their data types, similar to pandas dt

Class

RSpaceLoader

Load content from RSpace notebooks, folders, documents or PDF Gallery files.

Map RSpace document <-> Langchain Document in 1-1. PDFs are imported using PyPDF.

Requirements are rspace_client (`pip in

Class

BraveSearchLoader

Load with Brave Search engine.

Class

NotionDBLoader

Load from Notion DB.

Reads content from pages within a Notion Database. Args: integration_token (str): Notion integration token. database_id (str): Notion database id. request_timeout_s

Class

TencentCOSFileLoader

Load from Tencent Cloud COS file.

Class

DiscordChatLoader

Load Discord chat logs.

Class

PsychicLoader

Load from Psychic.dev.

Class

ScrapingAntLoader

Turn an url to LLM accessible markdown with ScrapingAnt.

For further details, visit: https://docs.scrapingant.com/python-client

Class

BaseGitHubLoader

Load GitHub repository Issues.

Class

GitHubIssuesLoader

Load issues of a GitHub repository.

Class

GithubFileLoader

Load GitHub File

Class

BiliBiliLoader

Load fetching transcripts from BiliBili videos.

Class

BrowserbaseLoader

Load pre-rendered web pages using a headless browser hosted on Browserbase.

Depends on browserbase and playwright packages. Get your API key from https://browserbase.com

Class

SpiderLoader

Load web pages as Documents using Spider AI.

Must have the Python package spider-client installed and a Spider API key. See https://spider.cloud for more.

Class

UnstructuredExcelLoader

Load Microsoft Excel files using Unstructured.

Like other Unstructured loaders, UnstructuredExcelLoader can be used in both "single" and "elements" mode. If you use the loader in "elements" mode, e

Class

CloudBlobLoader

Load blobs from cloud URL or file:.

Example:

.. code-block:: python

loader = CloudBlobLoader("s3://mybucket/id")

for blob in loader.yield_blobs():
    print(blob)

Class

YoutubeAudioLoader

Load YouTube urls as audio file(s).

Class

FileSystemBlobLoader

Load blobs in the local file system.

Example:

.. code-block:: python

from langchain_community.document_loaders.blob_loaders import FileSystemBlobLoader
loader = FileSystemBlobLoader("/path/

Class

MsWordParser

Parse the Microsoft Word documents from a blob.

Class

PyPDFParser

Parse a blob from a PDF using pypdf library.

This class provides methods to parse a blob from a PDF document, supporting various configurations such as handling password-protected PDFs, extra

Class

PDFMinerParser

Parse a blob from a PDF using pdfminer.six library.

This class provides methods to parse a blob from a PDF document, supporting various configurations such as handling password-protected PDFs

Class

PyMuPDFParser

Parse a blob from a PDF using PyMuPDF library.

This class provides methods to parse a blob from a PDF document, supporting various configurations such as handling password-protected PDFs, ext

Class

PyPDFium2Parser

Parse a blob from a PDF using PyPDFium2 library.

This class provides methods to parse a blob from a PDF document, supporting various configurations such as handling password-protected PDFs, e

Class

PDFPlumberParser

Parse PDF with PDFPlumber.

Class

AmazonTextractPDFParser

Send PDF files to Amazon Textract and parse them.

For parsing multi-page PDFs, they have to reside on S3.

The AmazonTextractPDFLoader calls the [Amazon Textract Service](https://aws.amazon.com/t

Class

DocumentIntelligenceParser

Loads a PDF with Azure Document Intelligence (formerly Form Recognizer) and chunks at character level.

Class

AzureOpenAIWhisperParser

Transcribe and parse audio files using Azure OpenAI Whisper.

This parser integrates with the Azure OpenAI Whisper model to transcribe audio files. It differs from the standard OpenAI Whisper parser,

Class

OpenAIWhisperParser

Transcribe and parse audio files.

Audio transcription is with OpenAI Whisper model.

Class

OpenAIWhisperParserLocal

Transcribe and parse audio files with OpenAI Whisper model.

Audio transcription with OpenAI Whisper model locally from transformers.

Class

YandexSTTParser

Transcribe and parse audio files. Audio transcription is with OpenAI Whisper model.

Class

FasterWhisperParser

Transcribe and parse audio files with faster-whisper.

faster-whisper is a reimplementation of OpenAI's Whisper model using CTranslate2, which is up to 4 times faster than openai/whisper for the same

Class

DocumentLoaderAsParser

A wrapper class that adapts a document loader to function as a parser.

This class is a work-around that adapts a document loader to function as a parser. It is recommended to use a proper parser, if

Class

MimeTypeBasedParser

Parser that uses mime-types to parse a blob.

This parser is useful for simple pipelines where the mime-type is sufficient to determine how to parse a blob.

To use, configure handlers based on mime

Class

DocAIParsingResults

Dataclass to store Document AI parsing results.

Class

AzureAIDocumentIntelligenceParser

Loads a PDF with Azure Document Intelligence (formerly Forms Recognizer).

Class

TextParser

Parser for text blobs.

Class

VsdxParser

Parser for vsdx files.

Class

BaseImageBlobParser

Abstract base class for parsing image blobs into text.

Class

RapidOCRBlobParser

Parser for extracting text from images using the RapidOCR library.

Class

TesseractBlobParser

Parse for extracting text from images using the Tesseract OCR library.

Class

LLMImageBlobParser

Parser for analyzing images using a language model (LLM).

Class

ServerUnavailableException

Exception raised when the Grobid server is unavailable.

Class

GrobidParser

Load article PDF files using Grobid.

Class

GoSegmenter

Code segmenter for Go.

Class

PHPSegmenter

Code segmenter for PHP.

Class

LanguageParser

Parse using the respective programming language syntax.

Each top-level function and class in the code is loaded into separate documents. Furthermore, an extra document is generated, containing the re

Class

CSegmenter

Code segmenter for C.

Class

LuaSegmenter

Code segmenter for Lua.

Class

ScalaSegmenter

Code segmenter for Scala.

Class

RubySegmenter

Code segmenter for Ruby.

Class

TypeScriptSegmenter

Code segmenter for TypeScript.

Class

SQLSegmenter

Code segmenter for SQL. This class uses Tree-sitter to segment SQL code into its constituent statements (e.g., SELECT, CREATE TABLE). It also provides functionality to extract these statements and sim

Class

PythonSegmenter

Code segmenter for Python.

Class

CSharpSegmenter

Code segmenter for C#.

Class

CobolSegmenter

Code segmenter for COBOL.

Class

CodeSegmenter

Abstract class for the code segmenter.

Class

JavaSegmenter

Code segmenter for Java.

Class

ElixirSegmenter

Code segmenter for Elixir.

Class

JavaScriptSegmenter

Code segmenter for JavaScript.

Class

TreeSitterSegmenter

Abstract class for CodeSegmenters that use the tree-sitter library.

Class

PerlSegmenter

Code segmenter for Perl.

Class

KotlinSegmenter

Code segmenter for Kotlin.

Class

RustSegmenter

Code segmenter for Rust.

Class

CPPSegmenter

Code segmenter for C++.

Class

BS4HTMLParser

Parse HTML files using Beautiful Soup.

Class

VolcengineRerank

Document compressor that uses Volcengine Rerank API.

Class

FlashrankRerank

Document compressor using Flashrank interface.

Class

JinaRerank

Document compressor that uses Jina Rerank API.

Class

RerankRequest

Request for reranking.

Class

OpenVINOReranker

OpenVINO rerank models.

Class

RankLLMRerank

Document compressor using Flashrank interface.

Class

ModelType

Class

LLMLinguaCompressor

Compress using LLMLingua Project.

https://github.com/microsoft/LLMLingua

Class

InfinityRerank

Document compressor that uses Infinity Rerank API.

Class

DashScopeRerank

Document compressor that uses DashScope Rerank API.

Class

BeautifulSoupTransformer

Transform HTML content by extracting specific tags and removing unwanted ones.

Class

NucliaTextTransformer

Nuclia Text Transformer.

The Nuclia Understanding API splits into paragraphs and sentences, identifies entities, provides a summary of the text and generates embeddings for all sentences.

Class

Html2TextTransformer

Replace occurrences of a particular search pattern with a replacement string

Class

LongContextReorder

Reorder long context.

Lost in the middle: Performance degrades when models must access relevant information in the middle of long contexts. See: https://arxiv.org/abs//2307.03172

Class

OpenAIMetadataTagger

Extract metadata tags from document contents using OpenAI functions.

Example: .. code-block:: python

        from langchain_openai import ChatOpenAI
        from langchai

Class

DoctranPropertyExtractor

Extract properties from text documents using doctran.

Class

DoctranTextTranslator

Translate text documents using doctran.

Class

MarkdownifyTransformer

Converts HTML documents to Markdown format with customizable options for handling links, images, other tags and heading styles using the markdownify library.

Class

DoctranQATransformer

Extract QA from text documents using doctran.

Class

EmbeddingsRedundantFilter

Filter that drops redundant documents by comparing their embeddings.

Class

EmbeddingsClusteringFilter

Perform K-means clustering on document vectors. Returns an arbitrary number of documents closest to center.

Class

TelegramChatLoader

Load telegram conversations to LangChain chat messages.

To export, use the Telegram Desktop app from https://desktop.telegram.org/, select a conversation, click the three dots in the top right corn

Class

LangSmithRunChatLoader

Load chat sessions from a list of LangSmith "llm" runs.

Class

LangSmithDatasetChatLoader

Load chat sessions from a LangSmith dataset with the "chat" data type.

Class

IMessageChatLoader

Load chat sessions from the iMessage chat.db SQLite file.

It only works on macOS when you have iMessage enabled and have the chat.db file.

The chat.db file is likely located at ~/Library/Messages/

Class

SlackChatLoader

Load Slack conversations from a dump zip file.

Class

WhatsAppChatLoader

Load WhatsApp conversations from a dump zip file or directory.

Class

SingleFileFacebookMessengerChatLoader

Load Facebook Messenger chat data from a single file.

Class

FolderFacebookMessengerChatLoader

Load Facebook Messenger chat data from a folder.

Class

GMailLoader

Load chat sessions from Gmail.

Inherits from BaseChatLoader.

Loads sent messages and their preceding emails to create chat training examples.

This lo

Class

OracleAutonomousDatabaseLoader

deprecated

Load from oracle adb

Autonomous Database connection can be made by either connection_string or tns name. wallet_location and wallet_password are required for TLS connection. Each document will repres

Class

OracleDocLoader

deprecated

Read documents using OracleDocLoader Args: conn: Oracle Connection, params: Loader parameters.

Class

OracleTextSplitter

deprecated

Splitting text using Oracle chunker.

Class

AzureBlobStorageContainerLoader

deprecated

Load from Azure Blob Storage container.

Class

BigQueryLoader

deprecated

Load from the Google Cloud Platform BigQuery.

Each document represents one row of the result. The page_content_columns are written into the page_content of the document. The metadata_columns

Class

GCSFileLoader

deprecated

Load from GCS file.

Class

GoogleDriveLoader

deprecated

Load Google Docs from Google Drive.

Class

GCSDirectoryLoader

deprecated

Load from GCS directory.

Class

GoogleSpeechToTextLoader

deprecated

Loader for Google Cloud Speech-to-Text audio transcripts.

It uses the Google Cloud Speech-to-Text API to transcribe audio files and loads the transcribed text into one or more Documents, depending on

Class

AzureBlobStorageFileLoader

deprecated

Load from Azure Blob Storage files.

Class

ApifyDatasetLoader

deprecated

Load datasets from Apify web scraping, crawling, and data extraction platform.

For details, see https://docs.apify.com/platform/integrations/langchain

Class

AstraDBLoader

deprecated

Class

UnstructuredFileLoader

deprecated

Load files using Unstructured.

The file loader uses the unstructured partition function and will automatically detect the file type. You can run the loader in different modes: "single", "elements",

Class

UnstructuredAPIFileLoader

deprecated

Load files using Unstructured API.

By default, the loader makes a call to the hosted Unstructured API. If you are running the unstructured API locally, you can change the API rule by passing in the

Class

UnstructuredFileIOLoader

deprecated

Load file-like objects opened in read mode using Unstructured.

The file loader uses the unstructured partition function and will automatically detect the file type. You can run the loader in differ

Class

UnstructuredAPIFileIOLoader

deprecated

Send file-like objects with unstructured-client sdk to the Unstructured API.

By default, the loader makes a call to the hosted Unstructured API. If you are running the unstructured API locally, you

Class

DocugamiLoader

deprecated

Load from Docugami.

To use, you should have the dgml-utils python package installed.

Class

DocAIParser

deprecated

Google Cloud Document AI parser.

For a detailed explanation of Document AI, refer to the product documentation. https://cloud.google.com/document-ai/docs/overview

Class

GoogleTranslateTransformer

deprecated

Translate text documents using Google Cloud Translation.

Menu

Document Loaders

Classes

OBSFileLoader

ParseOracleDocMetadata

OracleDocReader

NotebookLoader

S3DirectoryLoader

TiDBLoader

AirbyteJSONLoader

SitemapLoader

TensorflowDatasetLoader

UnstructuredCHMLoader

CHMParser

UnstructuredOrgModeLoader

HuggingFaceDatasetLoader

RoamLoader

BaseDataFrameLoader

DataFrameLoader

DropboxLoader

OneNoteLoader

TelegramChatFileLoader

TelegramChatApiLoader

LLMSherpaFileLoader

PebbloSafeLoader

PebbloTextLoader

IFixitLoader

Docx2txtLoader

UnstructuredWordDocumentLoader

OBSDirectoryLoader

SnowflakeLoader

HuggingFaceModelLoader

CassandraLoader

MintbaseDocumentLoader

UnstructuredRTFLoader

UnstructuredPDFLoader

BasePDFLoader

OnlinePDFLoader

PyPDFLoader

PyPDFium2Loader

PyPDFDirectoryLoader

PDFMinerLoader

PDFMinerPDFasHTMLLoader

PyMuPDFLoader

MathpixPDFLoader

PDFPlumberLoader

AmazonTextractPDFLoader

DedocPDFLoader

DocumentIntelligenceLoader

ZeroxPDFLoader

YuqueLoader

OpenCityDataLoader

XorbitsLoader

LakeFSClient

LakeFSLoader

UnstructuredLakeFSLoader

AthenaLoader

OneDriveLoader

BaiduBOSFileLoader

UnstructuredEPubLoader

ChatGPTLoader

BrowserlessLoader

AsyncChromiumLoader

AsyncHtmlLoader

CoNLLULoader

UnstructuredURLLoader

ImageCaptionLoader

NotionDirectoryLoader

IuguLoader

AzureAIDataLoader

FaunaLoader

MongodbLoader

WebBaseLoader

DirectoryLoader

ArcGISLoader

QuipLoader

ConcurrentLoader

TranscriptFormat

AssemblyAIAudioTranscriptLoader

AssemblyAIAudioLoaderById