Ask a question to get started
Enter to sendā¢Shift+Enter new line
Quantization mode to use. Can be one of awq or gptq.
awq
gptq
quantization: Optional[str] = None
