Ask a question to get started
Enter to sendā¢Shift+Enter new line
n_keep: int = 0
Specify the number of tokens from the prompt to retain when the context size is exceeded and tokens need to be discarded. By default, this value is set to 0 (meaning no tokens are kept). Use -1 to retain all tokens from the prompt.