Enter to sendยทShift+Enter new line
tokenizer_config: Optional[dict] = None
Configuration parameters specifically for the tokenizer. Defaults to an empty dictionary.