LangChain Reference home page

GitHub
Main Docs

Google GenAI (Gemini)

Google Vertex AI

IBM

⌘I

LangChain Assistant

Ask a question to get started

Enter to send•Shift+Enter new line

Menu

Google GenAI (Gemini)

Google Vertex AI

Language

Theme

Pythonlangchain-google-vertexaievaluatorsevaluationVertexStringEvaluatorevaluate

Method●Since v1.0

evaluate

Copy

evaluate(
  self,
  examples: Sequence[dict[str, str]],
  predictions: Sequence

Used in Docs

How to add evaluators to an existing experiment (Python only)
How to define a code evaluator
How to define an LLM-as-a-judge evaluator
How to evaluate an LLM application
How to evaluate with repetitions

View source on GitHub

[

[

,

str

]

]

,

*

,

question_key

:

=

'context'

,

answer_key

:

=

'reference'

,

prediction_key

:

=

'prediction'

,

instruction_key

:

=

'instruction'

,

**

kwargs

:

=

{

}

)

->

[

]