Ask a question to get started
Enter to sendā¢Shift+Enter new line
n_batch: Optional[int] = Field(8, alias='n_batch')
Number of tokens to process in parallel. Should be a number between 1 and n_ctx.
