Enter to send·Shift+Enter new line
device: Device = Device.cuda
The device to use for inference, cuda or cpu
