Ask a question to get started
Enter to sendā¢Shift+Enter new line
Huggingface tokenizer name.
Solar tokenizer is opened in huggingface https://huggingface.co/upstage/solar-pro-tokenizer
tokenizer_name: Optional[str] = 'upstage/solar-pro2-tokenizer'
