FastEmbedEmbeddings

The maximum number of tokens. Defaults to 512. Unknown behavior for values > 512.

The path to the cache directory. Defaults to local_cache in the parent directory

The number of threads single onnxruntime session can use. Defaults to None

Type of embedding to use for documents The available options are: "default" and "passage"

Batch size for encoding. Higher values will use more memory, but be faster. Defaults to 256.

If >1, parallel encoding is used, recommended for encoding of large datasets. If 0, use all available cores. If None, don't use data-parallel processing, use default onnxruntime threading. Defaults to None.

Validate that FastEmbed has been installed.

Generate embeddings for documents using FastEmbed.

Generate query embeddings using FastEmbed.