markdown

Enum of the programming languages.

Splitting text by recursively look at characters.

Recursively tries to split by different characters to find one that works.

Attempts to split the text along Markdown-formatted headings.

Splitting markdown files based on specified headers.

Line type as TypedDict.

Header type as TypedDict.

An experimental text splitter for handling Markdown syntax.

This splitter aims to retain the exact whitespace of the original text while extracting structured metadata, such as headers. It is a re-implementation of the MarkdownHeaderTextSplitter with notable changes to the approach and additional features.

Key Features:

• Retains the original whitespace and formatting of the Markdown text.
• Extracts headers, code blocks, and horizontal rules as metadata.
• Splits out code blocks and includes the language in the "Code" metadata key.
• Splits text on horizontal rules (---) as well.
• Defaults to sensible splitting behavior, which can be overridden using the headers_to_split_on parameter.