Document compressor that uses a pipeline of Transformers.
LLM Chain Extractor.
Document compressor that uses an LLM chain to extract the relevant parts of documents.
Filter that drops documents that aren't relevant to the query.
Document compressor that uses CrossEncoder for reranking.
Embeddings Filter.
Document compressor that uses embeddings to drop documents unrelated to the query.
Document compressor that uses Zero-Shot Listwise Document Reranking.
Adapted from: https://arxiv.org/pdf/2305.02156.pdf
LLMListwiseRerank uses a language model to rerank a list of documents based on
their relevance to a query.
Requires that underlying model implement with_structured_output.
Document compressor that uses Cohere Rerank API.
Filter that uses an LLM to drop documents that aren't relevant to the query.
Filter that uses an LLM to rerank documents listwise and select top-k.
DocumentFilter that uses an LLM chain to extract the relevant parts of documents.
