Package com.tnsai.evaluation.benchmark
package com.tnsai.evaluation.benchmark
Layer 2: Benchmark engine for running test datasets, collecting results,
and detecting regressions against saved baselines.
- Since:
- 0.1.0
-
ClassDescriptionPersistent store for benchmark baselines.Runs benchmark datasets against an agent execution function, collecting evaluation results from registered evaluators.Output from agent execution for a test case.Statistical analysis utilities for evaluation scores.Statistical summary.