LangChain Reference home pageLangChain ReferenceLangChain Reference
  • GitHub
  • Main Docs
Deep Agents
LangChain
LangGraph
Integrations
LangSmith
  • Overview
  • MCP Adapters
    • Overview
    • Agents
    • Callbacks
    • Chains
    • Chat models
    • Embeddings
    • Evaluation
    • Globals
    • Hub
    • Memory
    • Output parsers
    • Retrievers
    • Runnables
    • LangSmith
    • Storage
    Standard Tests
    Text Splitters
    ⌘I

    LangChain Assistant

    Ask a question to get started

    Enter to send•Shift+Enter new line

    Menu

    MCP Adapters
    OverviewAgentsCallbacksChainsChat modelsEmbeddingsEvaluationGlobalsHubMemoryOutput parsersRetrieversRunnablesLangSmithStorage
    Standard Tests
    Text Splitters
    Language
    Theme
    Pythonlangchain-classicevaluationexact_matchbaseExactMatchStringEvaluator
    Class●Since v1.0

    ExactMatchStringEvaluator

    Compute an exact match between the prediction and the reference.

    Examples:

    evaluator = ExactMatchChain() evaluator.evaluate_strings( prediction="Mindy is the CTO", reference="Mindy is the CTO", ) # This will return {'score': 1.0}

    evaluator.evaluate_strings( prediction="Mindy is the CTO", reference="Mindy is the CEO", ) # This will return {'score': 0.0}

    Copy
    ExactMatchStringEvaluator(
      self,
      *,
      ignore_case: bool = False,
      ignore_punctuation: bool = False,
      ignore_numbers: bool = False,
      **_: Any = {}
    )

    Bases

    StringEvaluator

    Parameters

    NameTypeDescription
    ignore_casebool
    Default:False

    Whether to ignore case when comparing strings.

    ignore_punctuationbool
    Default:False

    Whether to ignore punctuation when comparing strings.

    ignore_numbersbool
    Default:False

    Whether to ignore numbers when comparing strings.

    Constructors

    constructor
    __init__
    NameType
    ignore_casebool
    ignore_punctuationbool
    ignore_numbersbool

    Attributes

    attribute
    ignore_case: ignore_case
    attribute
    ignore_punctuation: ignore_punctuation
    attribute
    ignore_numbers: ignore_numbers
    attribute
    requires_input: bool

    This evaluator does not require input.

    attribute
    requires_reference: bool

    This evaluator requires a reference.

    attribute
    input_keys: list[str]

    Get the input keys.

    attribute
    evaluation_name: str

    Get the evaluation name.

    Inherited fromStringEvaluator

    Methods

    Mevaluate_strings
    —

    Evaluate Chain or LLM output, based on optional input and label.

    Maevaluate_strings
    —

    Asynchronously evaluate Chain or LLM output, based on optional input and label.

    View source on GitHub