Package com.tnsai.evaluation.autoharness
Class DefaultEvalCaseGenerator
java.lang.Object
com.tnsai.evaluation.autoharness.DefaultEvalCaseGenerator
- All Implemented Interfaces:
EvalCaseGenerator
Generates BenchmarkRunner-compatible regression test cases from failure clusters.
For each cluster, creates one eval case per representative example failure. Uses the failure's context to reconstruct test inputs. If no context input is available, constructs a synthetic input from the failure metadata.
- Since:
- 0.1.0
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptiongenerate(List<FailureCluster> clusters) Generates eval cases from the given failure clusters.
-
Constructor Details
-
DefaultEvalCaseGenerator
public DefaultEvalCaseGenerator() -
DefaultEvalCaseGenerator
public DefaultEvalCaseGenerator(int maxCasesPerCluster)
-
-
Method Details
-
generate
Description copied from interface:EvalCaseGeneratorGenerates eval cases from the given failure clusters.- Specified by:
generatein interfaceEvalCaseGenerator- Parameters:
clusters- failure clusters to convert- Returns:
- unmodifiable list of generated eval cases
-