embeddings_redundant_filter

Row-wise cosine similarity between two equal-width matrices.

Convert a list of documents to a list of documents with state.

Filter that drops redundant documents by comparing their embeddings.

Perform K-means clustering on document vectors. Returns an arbitrary number of documents closest to center.