Package com.tnsai.evaluation.autoharness

Record Class EvalCase

java.lang.Object
java.lang.Record
com.tnsai.evaluation.autoharness.EvalCase
Record Components:
id - unique identifier for this eval case
input - the agent input to test
expectedBehavior - description of expected correct behavior
sourceClusterKey - the cluster key this case was generated from
tags - tags for filtering and categorization
metadata - additional context
public record EvalCase(String id, String input, String expectedBehavior, String sourceClusterKey, List<String> tags, Map<String,String> metadata) extends Record
A generated regression test case derived from a FailureCluster.

Can be converted to a TestCase for execution by BenchmarkRunner.

Since:
0.1.0

  • Constructor Details

    • EvalCase

      public EvalCase(String id, String input, String expectedBehavior, String sourceClusterKey, List<String> tags, Map<String,String> metadata)
      Creates an instance of a EvalCase record class.
      Parameters:
      id - the value for the id record component
      input - the value for the input record component
      expectedBehavior - the value for the expectedBehavior record component
      sourceClusterKey - the value for the sourceClusterKey record component
      tags - the value for the tags record component
      metadata - the value for the metadata record component

  • Method Details

    • toTestCase

      public TestCase toTestCase()
      Converts this eval case into a BenchmarkRunner-compatible TestCase.

    • toString

      public final String toString()
      Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.
      Specified by:
      toString in class Record
      Returns:
      a string representation of this object

    • hashCode

      public final int hashCode()
      Returns a hash code value for this object. The value is derived from the hash code of each of the record components.
      Specified by:
      hashCode in class Record
      Returns:
      a hash code value for this object

    • equals

      public final boolean equals(Object o)
      Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. All components in this record class are compared with Objects::equals(Object,Object).
      Specified by:
      equals in class Record
      Parameters:
      o - the object with which to compare
      Returns:
      true if this object is the same as the o argument; false otherwise.

    • id

      public String id()
      Returns the value of the id record component.
      Returns:
      the value of the id record component

    • input

      public String input()
      Returns the value of the input record component.
      Returns:
      the value of the input record component

    • expectedBehavior

      public String expectedBehavior()
      Returns the value of the expectedBehavior record component.
      Returns:
      the value of the expectedBehavior record component

    • sourceClusterKey

      public String sourceClusterKey()
      Returns the value of the sourceClusterKey record component.
      Returns:
      the value of the sourceClusterKey record component

    • tags

      public List<String> tags()
      Returns the value of the tags record component.
      Returns:
      the value of the tags record component

    • metadata

      public Map<String,String> metadata()
      Returns the value of the metadata record component.
      Returns:
      the value of the metadata record component