Uses of Class
com.tnsai.evaluation.autoharness.AutoHarnessLoop.Builder
Packages that use AutoHarnessLoop.Builder
Package
Description
Self-improving agent evaluation loop (auto-harness pattern).
-
Uses of AutoHarnessLoop.Builder in com.tnsai.evaluation.autoharness
Methods in com.tnsai.evaluation.autoharness that return AutoHarnessLoop.BuilderModifier and TypeMethodDescriptionstatic AutoHarnessLoop.BuilderAutoHarnessLoop.builder()AutoHarnessLoop.Builder.clusterer(FailureClusterer clusterer) AutoHarnessLoop.Builder.generator(EvalCaseGenerator generator) AutoHarnessLoop.Builder.maxIterations(int max) Maximum number of loop iterations before giving up.AutoHarnessLoop.Builder.miner(FailureMiner miner) AutoHarnessLoop.Builder.minFailuresForClustering(int min) Minimum number of failures required before clustering is attempted.AutoHarnessLoop.Builder.passRateThreshold(double threshold) Minimum fraction of eval cases that must pass [0.0, 1.0].AutoHarnessLoop.Builder.runner(BenchmarkRunner runner) AutoHarnessLoop.Builder.scoreThreshold(double threshold) Minimum score for an individual case to be considered passing [0.0, 1.0].