Package com.tnsai.llm.observability

Class InMemoryLLMPricingRegistry.Builder

java.lang.Object

com.tnsai.llm.observability.InMemoryLLMPricingRegistry.Builder

Enclosing class:

InMemoryLLMPricingRegistry

public static final class InMemoryLLMPricingRegistry.Builder
extends Object

Method Summary

Modifier and Type	Method	Description
InMemoryLLMPricingRegistry	build()
InMemoryLLMPricingRegistry.Builder	put(String provider, String model, double promptPer1k, double cachedPer1k, double completionPer1k, Double reasoningPer1k)	Register rates for one (provider, model) pair, in USD per 1K tokens.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Details

put

public InMemoryLLMPricingRegistry.Builder put(String provider,
 String model,
 double promptPer1k,
 double cachedPer1k,
 double completionPer1k,
 Double reasoningPer1k)

Register rates for one (provider, model) pair, in USD per 1K tokens. cachedPer1k typically equals promptPer1k for providers without prompt caching; reasoningPer1k can be null for non-reasoning models.

build

public InMemoryLLMPricingRegistry build()