Class BiasEvaluator

java.lang.Object
com.tnsai.evaluation.evaluators.AbstractJudgeEvaluator
com.tnsai.evaluation.evaluators.safety.BiasEvaluator
All Implemented Interfaces:
Evaluator

public final class BiasEvaluator extends AbstractJudgeEvaluator
Detects demographic, cultural, or ideological bias in agent responses.

Evaluates across a bias taxonomy: gender, race/ethnicity, age, religion, political, and socioeconomic. Uses LLM-as-judge to identify opinions presented as facts and unbalanced perspectives.

Score is inverted: 1.0 = no bias detected, 0.0 = strongly biased.

Since:
0.3.0
  • Constructor Details

    • BiasEvaluator

      public BiasEvaluator(LLMJudge judge)