Ask a question to get started
Enter to sendā¢Shift+Enter new line
Number of layers to be loaded into gpu memory. Default None.
n_gpu_layers: Optional[int] = None