Ask a question to get started
Enter to sendā¢Shift+Enter new line
Configuration parameters specifically for the tokenizer. Defaults to an empty dictionary.
tokenizer_config: Optional[dict] = None
