Ask a question to get started
Enter to sendā¢Shift+Enter new line
Calculate num tokens for OpenAI with tiktoken package.
get_num_tokens( string: str, openai_model_name: str, ) -> int
https://github.com/openai/openai-cookbook/blob/main:
/examples/How_to_count_tokens_with_tiktoken.ipynb
