Enter to send·Shift+Enter new line
device: str = 'auto'
Device to use for inference, e.g. 'cpu' or 'cuda', or 'mps'
