Ask a question to get started
Enter to send•Shift+Enter new line
CharacterTextSplitter( self, separator: str = '\n\n', is_separator_regex: bool = False, **kwargs:
TextSplitter
Create a list of Document objects from a list of json objects (dict).
Document
dict
Split documents.
Text splitter that uses Hugging Face tokenizer to count length.
Text splitter that uses tiktoken encoder to count length.
tiktoken
Transform sequence of documents by splitting them.
Splitting text that looks at characters.
Split into chunks without re-inserting lookaround separators.
