Package com.tnsai.evaluation.model

Record Class BenchmarkResult.TestCaseResult

java.lang.Object
java.lang.Record
com.tnsai.evaluation.model.BenchmarkResult.TestCaseResult
Enclosing class:
BenchmarkResult
public static record BenchmarkResult.TestCaseResult(String testCaseId, String agentResponse, List<String> actualToolSequence, List<EvaluationResult> evaluationResults, long latencyMs, double costUsd) extends Record
Result for a single test case within a benchmark run.

  • Constructor Details

    • TestCaseResult

      public TestCaseResult(String testCaseId, String agentResponse, List<String> actualToolSequence, List<EvaluationResult> evaluationResults, long latencyMs, double costUsd)
      Creates an instance of a TestCaseResult record class.
      Parameters:
      testCaseId - the value for the testCaseId record component
      agentResponse - the value for the agentResponse record component
      actualToolSequence - the value for the actualToolSequence record component
      evaluationResults - the value for the evaluationResults record component
      latencyMs - the value for the latencyMs record component
      costUsd - the value for the costUsd record component

  • Method Details

    • overallScore

      public double overallScore()

    • scoresByEvaluator

      public Map<String,Double> scoresByEvaluator()

    • toString

      public final String toString()
      Returns a string representation of this record class. The representation contains the name of the class, followed by the name and value of each of the record components.
      Specified by:
      toString in class Record
      Returns:
      a string representation of this object

    • hashCode

      public final int hashCode()
      Returns a hash code value for this object. The value is derived from the hash code of each of the record components.
      Specified by:
      hashCode in class Record
      Returns:
      a hash code value for this object

    • equals

      public final boolean equals(Object o)
      Indicates whether some other object is "equal to" this one. The objects are equal if the other object is of the same class and if all the record components are equal. Reference components are compared with Objects::equals(Object,Object); primitive components are compared with '=='.
      Specified by:
      equals in class Record
      Parameters:
      o - the object with which to compare
      Returns:
      true if this object is the same as the o argument; false otherwise.

    • testCaseId

      public String testCaseId()
      Returns the value of the testCaseId record component.
      Returns:
      the value of the testCaseId record component

    • agentResponse

      public String agentResponse()
      Returns the value of the agentResponse record component.
      Returns:
      the value of the agentResponse record component

    • actualToolSequence

      public List<String> actualToolSequence()
      Returns the value of the actualToolSequence record component.
      Returns:
      the value of the actualToolSequence record component

    • evaluationResults

      public List<EvaluationResult> evaluationResults()
      Returns the value of the evaluationResults record component.
      Returns:
      the value of the evaluationResults record component

    • latencyMs

      public long latencyMs()
      Returns the value of the latencyMs record component.
      Returns:
      the value of the latencyMs record component

    • costUsd

      public double costUsd()
      Returns the value of the costUsd record component.
      Returns:
      the value of the costUsd record component