Package com.tnsai.evaluation.rag.embedding

Class EmbeddingBenchRunner

java.lang.Object

com.tnsai.evaluation.rag.embedding.EmbeddingBenchRunner

public final class EmbeddingBenchRunner
extends Object

Runs the bilingual fixture against one or more EmbeddingBenchModels.

Each model gets its own in-memory VectorMemoryStore over the union of gold documents. Same-language and cross-lingual queries share that pool so a translation of the same fact is a live distractor.

Since:

0.14.0

Field Summary

Fields

Modifier and Type	Field	Description
static final int	TOP_K

Constructor Summary

Constructors

Constructor	Description
EmbeddingBenchRunner(EmbeddingBenchCorpus corpus)

Method Summary

Modifier and Type	Method	Description
List<EmbeddingBenchModelScore>	run(List<EmbeddingBenchModel> models)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

TOP_K

public static final int TOP_K

See Also:

• Constant Field Values

Constructor Details

EmbeddingBenchRunner

public EmbeddingBenchRunner(EmbeddingBenchCorpus corpus)

Method Details

run

public List<EmbeddingBenchModelScore> run(List<EmbeddingBenchModel> models)