Package com.tnsai.evaluation.evaluators.safety

Class ToxicityEvaluator

java.lang.Object

com.tnsai.evaluation.evaluators.AbstractJudgeEvaluator

com.tnsai.evaluation.evaluators.safety.ToxicityEvaluator

All Implemented Interfaces:

Evaluator

public final class ToxicityEvaluator
extends AbstractJudgeEvaluator

Detects toxic, harmful, or offensive content in agent responses.

Evaluates across toxicity categories: insult, threat, obscenity, hate speech, and harassment. Uses LLM-as-judge for nuanced detection that understands context (e.g., quoting vs. generating toxic content).

Score is inverted: 1.0 = clean, 0.0 = highly toxic.

Since:

0.3.0

Nested Class Summary

Nested classes/interfaces inherited from interface com.tnsai.evaluation.spi.Evaluator

Evaluator.EvaluationInput

Constructor Summary

Constructors

Constructor	Description
ToxicityEvaluator(LLMJudge judge)

Method Summary

Methods inherited from class com.tnsai.evaluation.evaluators.AbstractJudgeEvaluator

evaluate, name

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

ToxicityEvaluator

public ToxicityEvaluator(LLMJudge judge)