Package com.tnsai.prompt.optimizer

Interface PromptEvaluator

All Known Implementing Classes:
DefaultPromptEvaluator
Functional Interface:
This is a functional interface and can therefore be used as the assignment target for a lambda expression or method reference.
@FunctionalInterface public interface PromptEvaluator
Evaluates prompt responses against expected outputs.

Implementations can use various metrics like exact match, semantic similarity, keyword presence, etc.

  • Method Summary

    Modifier and Type
    Method
    Description
    float
    evaluate(String actualResponse, String expectedOutput)
    Evaluates a response against expected output.

  • Method Details

    • evaluate

      float evaluate(String actualResponse, String expectedOutput)
      Evaluates a response against expected output.
      Parameters:
      actualResponse - the LLM response
      expectedOutput - the expected output
      Returns:
      score between 0.0 and 1.0