Ask a question to get started
Enter to sendā¢Shift+Enter new line
The number of gpus you would like your model to be split across
tensor_parallel: Optional[int] = None