Package com.tnsai.evaluation.evaluators.rag

Class ContextualRecallEvaluator

java.lang.Object

com.tnsai.evaluation.evaluators.AbstractJudgeEvaluator

com.tnsai.evaluation.evaluators.rag.ContextualRecallEvaluator

All Implemented Interfaces:

Evaluator

public final class ContextualRecallEvaluator
extends AbstractJudgeEvaluator

Measures whether all relevant information needed for the answer was retrieved.

Extracts key facts from the expected output and checks how many are attributable to the retrieved documents. Score = attributed_facts / total_facts.

Requires retrieved_documents in metadata as List<String> and a non-empty expectedOutput.

Since:

0.3.0

Nested Class Summary

Nested classes/interfaces inherited from interface com.tnsai.evaluation.spi.Evaluator

Evaluator.EvaluationInput

Constructor Summary

Constructors

Constructor	Description
ContextualRecallEvaluator(LLMJudge judge)

Method Summary

Methods inherited from class com.tnsai.evaluation.evaluators.AbstractJudgeEvaluator

evaluate, name

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ContextualRecallEvaluator

public ContextualRecallEvaluator(LLMJudge judge)