CotQAEvalChain

Prompt object to use.

Language model to call.

Output parser to use.

Whether to return only the final parsed result.

Will be whatever keys the prompt expects.

Will always return text key.

Generate LLM result from inputs.

Generate LLM result from inputs.

Prepare prompts from inputs.

Prepare prompts from inputs.

Whether this evaluator requires a reference label.

Evaluate Chain or LLM output, based on optional input and label.

Asynchronously evaluate Chain or LLM output, based on optional input and label.

Optional memory object.

Optional list of callback handlers (or callback manager).

Whether or not run in verbose mode. In verbose mode, some intermediate logs

Optional list of tags associated with the chain.

Optional metadata associated with the chain.

[DEPRECATED] Use callbacks instead.

Keys expected to be in the chain input.

Keys expected to be in the chain output.

Raise deprecation warning if callback_manager is used.