Ask a question to get started
Enter to sendā¢Shift+Enter new line
The max batch size for continuous batching of requests
max_batch_size: int = 4
