Package com.tnsai.evaluation.evaluators.multiturn

Class ConversationCompletenessEvaluator

java.lang.Object

com.tnsai.evaluation.evaluators.AbstractJudgeEvaluator

com.tnsai.evaluation.evaluators.multiturn.ConversationCompletenessEvaluator

All Implemented Interfaces:

Evaluator

public final class ConversationCompletenessEvaluator
extends AbstractJudgeEvaluator

Measures whether a multi-turn conversation achieved its stated goal.

Uses LLM-as-judge to assess whether the user's intent was fully resolved by the end of the conversation.

Score is normalized to [0.0, 1.0] from a 1-5 scale: 1 = goal not addressed, 5 = goal fully achieved.

Requires conversation_history in metadata as List<Map<String, String>> with "role" and "content", and conversation_goal as a String.

Since:

0.3.0

Nested Class Summary

Nested classes/interfaces inherited from interface com.tnsai.evaluation.spi.Evaluator

Evaluator.EvaluationInput

Constructor Summary

Constructors

Constructor	Description
ConversationCompletenessEvaluator(LLMJudge judge)

Method Summary

Methods inherited from class com.tnsai.evaluation.evaluators.AbstractJudgeEvaluator

evaluate, name

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ConversationCompletenessEvaluator

public ConversationCompletenessEvaluator(LLMJudge judge)