Uses of Class
com.tnsai.evaluation.evaluators.AbstractJudgeEvaluator
Packages that use AbstractJudgeEvaluator
Package
Description
Agent-tier evaluators (TNS-373).
Multi-turn conversation evaluation metrics.
RAG (Retrieval-Augmented Generation) evaluation metrics.
Safety evaluation metrics for LLM outputs.
-
Uses of AbstractJudgeEvaluator in com.tnsai.evaluation.evaluators.agent
Subclasses of AbstractJudgeEvaluator in com.tnsai.evaluation.evaluators.agentModifier and TypeClassDescriptionfinal classAgent-tier metric: did the agent stick to its declared plan?final classAgent-tier metric: did the agent's final state actually solve the task?final classAgent-tier metric: were the tools the agent invoked semantically appropriate for the task? -
Uses of AbstractJudgeEvaluator in com.tnsai.evaluation.evaluators.multiturn
Subclasses of AbstractJudgeEvaluator in com.tnsai.evaluation.evaluators.multiturnModifier and TypeClassDescriptionfinal classMeasures whether a multi-turn conversation achieved its stated goal.final classMeasures whether the agent retains information from earlier conversation turns.final classMeasures whether the last assistant turn is relevant to the preceding conversation context. -
Uses of AbstractJudgeEvaluator in com.tnsai.evaluation.evaluators.rag
Subclasses of AbstractJudgeEvaluator in com.tnsai.evaluation.evaluators.ragModifier and TypeClassDescriptionfinal classMeasures whether the agent's response actually addresses the user's query.final classMeasures whether all relevant information needed for the answer was retrieved.final classMeasures whether the agent's response is grounded in retrieved documents. -
Uses of AbstractJudgeEvaluator in com.tnsai.evaluation.evaluators.safety
Subclasses of AbstractJudgeEvaluator in com.tnsai.evaluation.evaluators.safetyModifier and TypeClassDescriptionfinal classDetects demographic, cultural, or ideological bias in agent responses.final classDetects hallucinated content in agent responses by checking factual claims against provided context.final classDetects toxic, harmful, or offensive content in agent responses.