Package com.tnsai.evaluation.evaluators.safety

Class PIILeakageEvaluator

java.lang.Object

com.tnsai.evaluation.evaluators.safety.PIILeakageEvaluator

All Implemented Interfaces:

Evaluator

public final class PIILeakageEvaluator
extends Object
implements Evaluator

Detects PII leakage in agent responses using regex + checksum validation.

Zero LLM cost, fully deterministic. Checks for: email, phone, credit card (Luhn), TCKN (Turkish ID with checksum), IBAN (TR + international), IP addresses.

Score = 1.0 - (leaked_categories / total_checked_categories). 1.0 = no leaks, 0.0 = all categories leaked.

Since:

0.3.0

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static enum	PIILeakageEvaluator.Category

Nested classes/interfaces inherited from interface com.tnsai.evaluation.spi.Evaluator

Evaluator.EvaluationInput

Constructor Summary

Constructors

Constructor	Description
PIILeakageEvaluator()
PIILeakageEvaluator(Set<PIILeakageEvaluator.Category> categories)

Method Summary

Modifier and Type	Method	Description
EvaluationResult	evaluate(Evaluator.EvaluationInput context)	Evaluates agent behavior for a single interaction.
String	name()	Unique name for this evaluator.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

PIILeakageEvaluator

public PIILeakageEvaluator()

PIILeakageEvaluator

public PIILeakageEvaluator(Set<PIILeakageEvaluator.Category> categories)

Method Details

name

public String name()

Description copied from interface: Evaluator

Unique name for this evaluator.

Specified by:

name in interface Evaluator

evaluate

public EvaluationResult evaluate(Evaluator.EvaluationInput context)

Description copied from interface: Evaluator

Evaluates agent behavior for a single interaction.

Specified by:

evaluate in interface Evaluator

Parameters:

context - evaluation context containing input, output, tool calls, etc.

Returns:

evaluation result