Package com.tnsai.prompt.optimizer

Class DefaultPromptEvaluator

java.lang.Object

com.tnsai.prompt.optimizer.DefaultPromptEvaluator

All Implemented Interfaces:

PromptEvaluator

public class DefaultPromptEvaluator
extends Object
implements PromptEvaluator

Default evaluator using keyword matching and similarity metrics.

Combines multiple evaluation strategies:

• Keyword overlap (Jaccard similarity)
• Length similarity
• Key phrase presence

Constructor Summary

Constructors

Constructor	Description
DefaultPromptEvaluator()
DefaultPromptEvaluator(float keywordWeight, float lengthWeight, float phraseWeight)

Method Summary

Modifier and Type	Method	Description
float	evaluate(String actualResponse, String expectedOutput)	Evaluates a response against expected output.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

DefaultPromptEvaluator

public DefaultPromptEvaluator()

DefaultPromptEvaluator

public DefaultPromptEvaluator(float keywordWeight,
 float lengthWeight,
 float phraseWeight)

Method Details

evaluate

public float evaluate(String actualResponse,
 String expectedOutput)

Description copied from interface: PromptEvaluator

Evaluates a response against expected output.

Specified by:

evaluate in interface PromptEvaluator

Parameters:

actualResponse - the LLM response

expectedOutput - the expected output

Returns:

score between 0.0 and 1.0