# TokenTextSplitter

> **Class** in `@langchain/textsplitters`

📖 [View in docs](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter)

Implementation of splitter which looks at tokens.

## Signature

```javascript
class TokenTextSplitter
```

## Extends

- `TextSplitter`

## Implements

- `TokenTextSplitterParams`

## Constructors

- [`constructor()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/constructor)

## Properties

- `allowedSpecial`
- `chunkOverlap`
- `chunkSize`
- `disallowedSpecial`
- `encodingName`
- `keepSeparator`
- `lc_kwargs`
- `lc_namespace`
- `lc_runnable`
- `lc_serializable`
- `lengthFunction`
- `name`
- `lc_aliases`
- `lc_attributes`
- `lc_id`
- `lc_secrets`
- `lc_serializable_keys`

## Methods

- [`_batchWithConfig()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/_batchWithConfig)
- [`_callWithConfig()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/_callWithConfig)
- [`_getOptionsList()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/_getOptionsList)
- [`_separateRunnableConfigFromCallOptions()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/_separateRunnableConfigFromCallOptions)
- [`_streamIterator()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/_streamIterator)
- [`_streamLog()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/_streamLog)
- [`_transformStreamWithConfig()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/_transformStreamWithConfig)
- [`assign()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/assign)
- [`asTool()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/asTool)
- [`batch()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/batch)
- [`createDocuments()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/createDocuments)
- [`getGraph()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/getGraph)
- [`getName()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/getName)
- [`invoke()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/invoke)
- [`mergeSplits()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/mergeSplits)
- [`pick()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/pick)
- [`pipe()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/pipe)
- [`splitDocuments()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/splitDocuments)
- [`splitOnSeparator()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/splitOnSeparator)
- [`splitText()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/splitText)
- [`stream()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/stream)
- [`streamEvents()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/streamEvents)
- [`streamLog()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/streamLog)
- [`toJSON()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/toJSON)
- [`toJSONNotImplemented()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/toJSONNotImplemented)
- [`transform()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/transform)
- [`transformDocuments()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/transformDocuments)
- [`withConfig()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/withConfig)
- [`withFallbacks()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/withFallbacks)
- [`withListeners()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/withListeners)
- [`withRetry()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/withRetry)
- [`isRunnable()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/isRunnable)
- [`lc_name()`](https://reference.langchain.com/javascript/langchain-textsplitters/TokenTextSplitter/lc_name)

---

[View source on GitHub](https://github.com/langchain-ai/langchainjs/blob/1596213afe2874842e98d0827752b422096d020b/libs/langchain-textsplitters/src/text_splitter.ts#L722)