Ask a question to get started
Enter to sendā¢Shift+Enter new line
tensor_parallel: Optional[int] = None
The number of gpus you would like your model to be split across
