Ask a question to get started
Enter to send•Shift+Enter new line
Return the ordered IDs of the tokens in a text.
get_token_ids( self, text: str, ) -> list[int]
text
str
The string input to tokenize.
