Ask a question to get started
Enter to sendā¢Shift+Enter new line
batch_size: int = 32
Internal batch size for inference, e.g. 32
