Ask a question to get started
Enter to sendā¢Shift+Enter new line
Number of tokens to process in parallel. Should be a number between 1 and n_ctx.
n_batch: Optional[int] = Field(512, alias='n_batch')
