Package com.tnsai.evaluation.evaluators

Class CostEfficiencyEvaluator

java.lang.Object

com.tnsai.evaluation.evaluators.CostEfficiencyEvaluator

All Implemented Interfaces:

Evaluator

public final class CostEfficiencyEvaluator
extends Object
implements Evaluator

Evaluates cost efficiency: cost per successful task completion.

Scoring dimensions:

• Cost score: Based on configurable cost budget (lower is better)
• Token efficiency: Useful output per input token
• Latency score: Based on configurable latency budget

Since:

0.1.0

Nested Class Summary

Nested classes/interfaces inherited from interface com.tnsai.evaluation.spi.Evaluator

Evaluator.EvaluationInput

Constructor Summary

Constructors

Constructor	Description
CostEfficiencyEvaluator()	Creates with default budgets: $0.10 cost, 30s latency.
CostEfficiencyEvaluator(double costBudgetUsd, long latencyBudgetMs)	Creates with custom budgets.

Method Summary

Modifier and Type	Method	Description
EvaluationResult	evaluate(Evaluator.EvaluationInput context)	Evaluates agent behavior for a single interaction.
String	name()	Unique name for this evaluator.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

CostEfficiencyEvaluator

public CostEfficiencyEvaluator()

Creates with default budgets: $0.10 cost, 30s latency.

CostEfficiencyEvaluator

public CostEfficiencyEvaluator(double costBudgetUsd,
 long latencyBudgetMs)

Creates with custom budgets.

Parameters:

costBudgetUsd - maximum acceptable cost in USD

latencyBudgetMs - maximum acceptable latency in ms

Method Details

name

public String name()

Description copied from interface: Evaluator

Unique name for this evaluator.

Specified by:

name in interface Evaluator

evaluate

public EvaluationResult evaluate(Evaluator.EvaluationInput context)

Description copied from interface: Evaluator

Evaluates agent behavior for a single interaction.

Specified by:

evaluate in interface Evaluator

Parameters:

context - evaluation context containing input, output, tool calls, etc.

Returns:

evaluation result