Ask a question to get started
Enter to send•Shift+Enter new line
Note that the modelPath is the only required parameter. For testing you can set this in the environment variable LLAMA_PATH.
LLAMA_PATH
interface LlamaCppEmbeddingsParams
LlamaBaseCppInputs
EmbeddingsParams