backend

Specifies the backend to use for the model.

Supported backends are:

• "llamacpp": For GGUF models using llama.cpp
• "transformers": For Hugging Face Transformers models (default)
• "transformers_vision": For vision-language models (e.g., LLaVA)
• "vllm": For models using the vLLM library
• "mlxlm": For models using the MLX framework

Note: Ensure you have the necessary dependencies installed for the chosen backend. The system will attempt to import required packages and may raise an ImportError if they are not available.