Index

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

AbstractGoogleErrorMapper - Class in com.tnsai.llm.errors

Shared ProviderErrorMapper for Google Cloud LLM endpoints — the Generative Language API (Gemini) and Vertex AI both return the canonical Google API-Gateway error envelope, shared across every Google Cloud service:

AbstractLLMClient - Class in com.tnsai.llm.providers

Abstract base class for LLM client implementations.

AbstractOpenAICompatibleClient - Class in com.tnsai.llm.providers

Base class for providers that speak the OpenAI /chat/completions wire format verbatim — same request body, same choices[].message response, same choices[].delta streaming, Bearer auth.

AbstractOpenAICompatibleErrorMapper - Class in com.tnsai.llm.errors

Shared ProviderErrorMapper for providers that clone OpenAI's chat-completions API at the error-envelope level.

Adaptive Routing - Search tag in class com.tnsai.llm.routing.LatencyBasedRouter

Section

addClient(LLMClient) - Method in class com.tnsai.llm.routing.CapabilityRouter.Builder

addClient(LLMClient) - Method in class com.tnsai.llm.routing.CostBasedRouter.Builder

addClient(LLMClient) - Method in class com.tnsai.llm.routing.FallbackRouter.Builder

Adds a client to the fallback chain.

addClient(LLMClient) - Method in class com.tnsai.llm.routing.LatencyBasedRouter.Builder

addClient(LLMClient) - Method in class com.tnsai.llm.routing.RoundRobinRouter.Builder

addKeywords(TaskType, Set<String>) - Method in class com.tnsai.llm.routing.TaskClassifier.Builder

Adds custom keywords for a task type.

addPattern(TaskType, Pattern) - Method in class com.tnsai.llm.routing.TaskClassifier.Builder

Adds a custom pattern for a task type.

addText(String) - Method in class com.tnsai.llm.cache.CacheableContent.Builder

Adds a text block without cache control.

addText(String, CacheControl) - Method in class com.tnsai.llm.cache.CacheableContent.Builder

Adds a text block with cache control.

alertThreshold(double) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

alertThresholds(double...) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

always() - Static method in interface com.tnsai.llm.fallback.FallbackCondition

Always() - Constructor for record class com.tnsai.llm.fallback.FallbackCondition.Always

Creates an instance of a Always record class.

ANALYSIS - Enum constant in enum class com.tnsai.llm.routing.TaskType

Data analysis, summarization, extraction.

and(FallbackCondition...) - Static method in interface com.tnsai.llm.fallback.FallbackCondition

AND - Enum constant in enum class com.tnsai.llm.fallback.FallbackCondition.Composite.LogicalOp

Anthropic - Search tag in package com.tnsai.llm.providers

Section

AnthropicClient - Class in com.tnsai.llm.providers

Anthropic Claude LLM client implementation.

AnthropicClient(String) - Constructor for class com.tnsai.llm.providers.AnthropicClient

Creates an AnthropicClient with the specified model.

AnthropicClient(String, float) - Constructor for class com.tnsai.llm.providers.AnthropicClient

Creates an AnthropicClient with the specified model and temperature.

AnthropicClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.AnthropicClient

Creates an AnthropicClient with the specified model, temperature, topP, and max tokens.

AnthropicClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.AnthropicClient

Creates an AnthropicClient with the specified model, temperature, and max tokens.

AnthropicClient(String, String, float, Float, Integer, String, List<String>) - Constructor for class com.tnsai.llm.providers.AnthropicClient

Creates an AnthropicClient with full configuration including beta features.

AnthropicClient(String, String, float, Float, Integer, String, List<String>, boolean, int) - Constructor for class com.tnsai.llm.providers.AnthropicClient

Full constructor — see the 7-arg overload for the historical contract.

AnthropicClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.AnthropicClient

Creates an AnthropicClient with full configuration.

AnthropicClient.Builder - Class in com.tnsai.llm.providers

Builder for creating AnthropicClient instances.

Anthropic Prompt Caching - Search tag in class com.tnsai.llm.cache.CacheControl

Section

AnthropicProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Anthropic's Messages API.

AnthropicProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.AnthropicProviderErrorMapper

AnthropicToolConverter - Class in com.tnsai.llm.providers

Translates the OpenAI-flavoured intermediate tool schema into Anthropic's Messages-API tool shape.

API_KEY - Enum constant in enum class com.tnsai.llm.providers.AzureOpenAIClient.AuthType

API Key authentication using api-key header

apiKey(String) - Method in class com.tnsai.llm.audio.WhisperClient.Builder

apiKey(String) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Sets the API key.

apiKey(String) - Method in class com.tnsai.llm.providers.MiniMaxClient.Builder

apiKey(String) - Method in class com.tnsai.llm.providers.ZhipuAIClient.Builder

apiKeyEnv() - Method in record class com.tnsai.llm.LLMClientSettings

Returns the value of the apiKeyEnv record component.

arguments() - Method in record class com.tnsai.llm.observability.LLMResponse.ToolCallRequest

Returns the value of the arguments record component.

AttemptRecord(String, Instant, LLMException) - Constructor for record class com.tnsai.llm.fallback.LLMChainExhaustedException.AttemptRecord

Creates an instance of a AttemptRecord record class.

Auth (v1 scope) - Search tag in class com.tnsai.llm.providers.VertexAIClient

Section

Available Providers - Search tag in package com.tnsai.llm.providers

Section

Available Routers - Search tag in package com.tnsai.llm.routing

Section

averageCostPerRequest() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the averageCostPerRequest record component.

averageLatencyMs() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the averageLatencyMs record component.

avgLatencyMs() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns the value of the avgLatencyMs record component.

avgLatencyMs() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the avgLatencyMs record component.

avgLatencyPerProvider() - Method in record class com.tnsai.llm.routing.LatencyBasedRouter.LatencyStats

Returns the value of the avgLatencyPerProvider record component.

avgLatencyPerProvider() - Method in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Returns the value of the avgLatencyPerProvider record component.

AZURE_AD - Enum constant in enum class com.tnsai.llm.providers.AzureOpenAIClient.AuthType

Azure AD (Entra ID) token authentication using Bearer token

AzureContentFilterException(String) - Constructor for exception class com.tnsai.llm.providers.AzureOpenAIClient.AzureContentFilterException

AzureOpenAIClient - Class in com.tnsai.llm.providers

Azure OpenAI Service client implementation.

AzureOpenAIClient.AuthType - Enum Class in com.tnsai.llm.providers

Authentication type for Azure OpenAI.

AzureOpenAIClient.AzureContentFilterException - Exception Class in com.tnsai.llm.providers

Exception thrown when Azure OpenAI content filter rejects the request.

AzureOpenAIProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Azure OpenAI Service — ninth pilot mapper.

AzureOpenAIProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.AzureOpenAIProviderErrorMapper

B

baseUrl(String) - Method in class com.tnsai.llm.audio.WhisperClient.Builder

baseUrl(String) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Sets the API base URL.

baseUrl(String) - Method in class com.tnsai.llm.providers.MiniMaxClient.Builder

baseUrl(String) - Method in class com.tnsai.llm.providers.ZhipuAIClient.Builder

BedrockClient - Class in com.tnsai.llm.providers

AWS Bedrock LLM client implementation.

BedrockClient(String) - Constructor for class com.tnsai.llm.providers.BedrockClient

Creates a BedrockClient with the specified model ID.

BedrockClient(String, float) - Constructor for class com.tnsai.llm.providers.BedrockClient

BedrockClient(String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.BedrockClient

BedrockClient(String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.BedrockClient

BedrockProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for AWS Bedrock — sixth pilot mapper.

BedrockProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.BedrockProviderErrorMapper

beta(String) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Adds a beta feature identifier.

BETA_ADVANCED_TOOL_USE - Static variable in class com.tnsai.llm.providers.AnthropicClient

Beta header for advanced tool use features (tool search, programmatic calling)

BETA_COMPUTER_USE - Static variable in class com.tnsai.llm.providers.AnthropicClient

Beta header for computer use

BETA_FINE_GRAINED_TOOL_STREAMING - Static variable in class com.tnsai.llm.providers.OpenRouterClient

Beta header that opts into Anthropic's fine-grained tool streaming.

BETA_PROMPT_CACHING - Static variable in class com.tnsai.llm.providers.AnthropicClient

Beta header for prompt caching

BETA_WEB_SEARCH - Static variable in class com.tnsai.llm.providers.AnthropicClient

Beta header for web search capability

betas(List<String>) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Adds multiple beta feature identifiers.

BudgetAlert(BudgetManager.BudgetAlertType, double, BigDecimal, BigDecimal, BigDecimal) - Constructor for record class com.tnsai.llm.cost.BudgetManager.BudgetAlert

Creates an instance of a BudgetAlert record class.

BudgetExceededException - Exception Class in com.tnsai.llm.cost

Exception thrown when a budget limit is exceeded.

BudgetExceededException(String) - Constructor for exception class com.tnsai.llm.cost.BudgetExceededException

BudgetExceededException(BigDecimal, BigDecimal, BigDecimal) - Constructor for exception class com.tnsai.llm.cost.BudgetExceededException

budgetManager(BudgetManager) - Method in class com.tnsai.llm.cost.CostAwareLLMClient.Builder

BudgetManager - Class in com.tnsai.llm.cost

Manages budget limits and alerts for LLM usage.

BudgetManager.BudgetAlert - Record Class in com.tnsai.llm.cost

BudgetManager.BudgetAlertType - Enum Class in com.tnsai.llm.cost

BudgetManager.BudgetState - Enum Class in com.tnsai.llm.cost

BudgetManager.BudgetStatus - Record Class in com.tnsai.llm.cost

BudgetManager.Builder - Class in com.tnsai.llm.cost

BudgetStatus(BudgetManager.BudgetState, BigDecimal, BigDecimal, BigDecimal, double, Instant, Duration) - Constructor for record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Creates an instance of a BudgetStatus record class.

build() - Method in class com.tnsai.llm.audio.WhisperClient.Builder

build() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions.Builder

build() - Method in class com.tnsai.llm.audio.WhisperClient.TranslationOptions.Builder

build() - Method in class com.tnsai.llm.cache.CacheableContent.Builder

build() - Method in class com.tnsai.llm.cache.CachedLLMClient.Builder

build() - Method in class com.tnsai.llm.cache.InMemorySemanticCache.Builder

build() - Method in class com.tnsai.llm.cache.PromptCachingClient.Builder

build() - Method in class com.tnsai.llm.cost.BudgetManager.Builder

build() - Method in class com.tnsai.llm.cost.CostAwareLLMClient.Builder

build() - Method in class com.tnsai.llm.cost.InMemoryCostTracker.Builder

build() - Method in class com.tnsai.llm.cost.UsageRecord.Builder

build() - Method in class com.tnsai.llm.fallback.LLMFallbackChain.Builder

build() - Method in class com.tnsai.llm.format.JsonModeClient.Builder

Builds the JsonModeClient.

build() - Method in class com.tnsai.llm.LLMBasedConflictResolver.Builder

Builds the resolver.

build() - Method in class com.tnsai.llm.observability.InMemoryLLMPricingRegistry.Builder

build() - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

build() - Method in class com.tnsai.llm.observability.PromptLogger.Builder

build() - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Builds the AnthropicClient instance.

build() - Method in class com.tnsai.llm.providers.MiniMaxClient.Builder

build() - Method in class com.tnsai.llm.providers.ZhipuAIClient.Builder

build() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient.Builder

build() - Method in class com.tnsai.llm.routing.CapabilityRouter.Builder

build() - Method in class com.tnsai.llm.routing.CostBasedRouter.Builder

build() - Method in class com.tnsai.llm.routing.FallbackRouter.Builder

Builds the router.

build() - Method in class com.tnsai.llm.routing.LatencyBasedRouter.Builder

build() - Method in class com.tnsai.llm.routing.RoundRobinRouter.Builder

build() - Method in class com.tnsai.llm.routing.TaskBasedRouter.Builder

build() - Method in class com.tnsai.llm.routing.TaskClassifier.Builder

builder() - Static method in class com.tnsai.llm.audio.WhisperClient

Builder for WhisperClient.

builder() - Static method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions

builder() - Static method in class com.tnsai.llm.audio.WhisperClient.TranslationOptions

builder() - Static method in class com.tnsai.llm.cache.CacheableContent

Creates a builder for complex content with multiple blocks.

builder() - Static method in class com.tnsai.llm.cache.InMemorySemanticCache

builder() - Static method in class com.tnsai.llm.cache.PromptCachingClient

builder() - Static method in class com.tnsai.llm.cost.BudgetManager

builder() - Static method in class com.tnsai.llm.cost.CostAwareLLMClient

builder() - Static method in class com.tnsai.llm.cost.InMemoryCostTracker

builder() - Static method in class com.tnsai.llm.cost.UsageRecord

builder() - Static method in interface com.tnsai.llm.fallback.LLMFallbackChain

Returns a builder for configuring a chain.

builder() - Static method in class com.tnsai.llm.format.JsonModeClient

Creates a new builder.

builder() - Static method in class com.tnsai.llm.LLMBasedConflictResolver

Creates a builder for LLMBasedConflictResolver.

builder() - Static method in record class com.tnsai.llm.observability.LLMCallLog

Returns a builder pre-populated with the minimum required fields.

builder() - Static method in class com.tnsai.llm.observability.PromptLogger

builder() - Static method in class com.tnsai.llm.providers.AnthropicClient

Creates a new builder for AnthropicClient.

builder() - Static method in class com.tnsai.llm.providers.MiniMaxClient

Builder for MiniMaxClient.

builder() - Static method in class com.tnsai.llm.providers.ZhipuAIClient

Builder for ZhipuAIClient.

builder() - Static method in class com.tnsai.llm.resilience.CircuitBreakerClient

builder() - Static method in class com.tnsai.llm.routing.CapabilityRouter

Returns a builder for configuring the router.

builder() - Static method in class com.tnsai.llm.routing.CostBasedRouter

Returns a builder for configuring the router.

builder() - Static method in class com.tnsai.llm.routing.FallbackRouter

Returns a builder for configuring the router.

builder() - Static method in class com.tnsai.llm.routing.LatencyBasedRouter

Returns a builder for configuring the router.

builder() - Static method in class com.tnsai.llm.routing.RoundRobinRouter

Returns a builder for configuring the router.

builder() - Static method in class com.tnsai.llm.routing.TaskBasedRouter

Creates a new builder for TaskBasedRouter.

builder() - Static method in class com.tnsai.llm.routing.TaskClassifier

Returns a builder for customizing the classifier.

builder(String) - Static method in class com.tnsai.llm.observability.InMemoryLLMPricingRegistry

Builder() - Constructor for class com.tnsai.llm.audio.WhisperClient.Builder

Builder() - Constructor for class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions.Builder

Builder() - Constructor for class com.tnsai.llm.audio.WhisperClient.TranslationOptions.Builder

Builder() - Constructor for class com.tnsai.llm.cache.CacheableContent.Builder

Builder() - Constructor for class com.tnsai.llm.cache.InMemorySemanticCache.Builder

Builder() - Constructor for class com.tnsai.llm.cache.PromptCachingClient.Builder

Builder() - Constructor for class com.tnsai.llm.cost.BudgetManager.Builder

Builder() - Constructor for class com.tnsai.llm.cost.CostAwareLLMClient.Builder

Builder() - Constructor for class com.tnsai.llm.cost.InMemoryCostTracker.Builder

Builder() - Constructor for class com.tnsai.llm.cost.UsageRecord.Builder

Builder() - Constructor for class com.tnsai.llm.format.JsonModeClient.Builder

Builder() - Constructor for class com.tnsai.llm.LLMBasedConflictResolver.Builder

Builder() - Constructor for class com.tnsai.llm.observability.PromptLogger.Builder

Builder() - Constructor for class com.tnsai.llm.providers.AnthropicClient.Builder

Builder() - Constructor for class com.tnsai.llm.providers.MiniMaxClient.Builder

Builder() - Constructor for class com.tnsai.llm.providers.ZhipuAIClient.Builder

Builder() - Constructor for class com.tnsai.llm.routing.CapabilityRouter.Builder

Builder() - Constructor for class com.tnsai.llm.routing.CostBasedRouter.Builder

Builder() - Constructor for class com.tnsai.llm.routing.FallbackRouter.Builder

Builder() - Constructor for class com.tnsai.llm.routing.LatencyBasedRouter.Builder

Builder() - Constructor for class com.tnsai.llm.routing.RoundRobinRouter.Builder

Builder() - Constructor for class com.tnsai.llm.routing.TaskBasedRouter.Builder

Builder() - Constructor for class com.tnsai.llm.routing.TaskClassifier.Builder

C

CacheableContent - Class in com.tnsai.llm.cache

Wrapper for content that can be cached.

CacheableContent.Builder - Class in com.tnsai.llm.cache

CacheableContent.ContentBlock - Class in com.tnsai.llm.cache

A content block with optional cache control.

Cacheable System Prompt - Search tag in class com.tnsai.llm.cache.CacheableContent

Section

Cacheable with Multiple Text Blocks - Search tag in class com.tnsai.llm.cache.CacheableContent

Section

CacheControl - Class in com.tnsai.llm.cache

Cache control configuration for prompt caching.

CacheControl.Type - Enum Class in com.tnsai.llm.cache

Cache control type.

cacheControlMarkers() - Method in record class com.tnsai.llm.observability.LLMPrompt.PromptCacheInfo

Returns the value of the cacheControlMarkers record component.

cacheCreationInputTokens() - Method in record class com.tnsai.llm.cache.CacheUsage

Returns the value of the cacheCreationInputTokens record component.

cachedDiscountUSD() - Method in record class com.tnsai.llm.observability.CostEstimate

Returns the value of the cachedDiscountUSD record component.

cachedInputTokens(long) - Method in class com.tnsai.llm.cost.UsageRecord.Builder

CachedLLMClient - Class in com.tnsai.llm.cache

LLM client wrapper that adds semantic caching capabilities.

CachedLLMClient.Builder - Class in com.tnsai.llm.cache

Builder for CachedLLMClient.

cachedTokens() - Method in record class com.tnsai.llm.observability.TokenUsage

Returns the value of the cachedTokens record component.

CacheEntry - Record Class in com.tnsai.llm.cache

Represents a cached LLM response entry.

CacheEntry(String, String, float[], String, Optional<String>, String, Instant, Instant, long, Map<String, Object>) - Constructor for record class com.tnsai.llm.cache.CacheEntry

Creates an instance of a CacheEntry record class.

cacheHistoryBreakpoints(int) - Method in class com.tnsai.llm.cache.PromptCachingClient.Builder

Sets the requested number of history breakpoints.

cacheInfo() - Method in record class com.tnsai.llm.observability.LLMPrompt

Returns the value of the cacheInfo record component.

cacheLastNTurns(int) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Upper bound on how many of the last user messages in history get a cache_control marker (issue #27).

cacheReadInputTokens() - Method in record class com.tnsai.llm.cache.CacheUsage

Returns the value of the cacheReadInputTokens record component.

CacheStats(long, long, long, long, int, double) - Constructor for record class com.tnsai.llm.cache.SemanticCache.CacheStats

Creates an instance of a CacheStats record class.

cacheStreaming(boolean) - Method in class com.tnsai.llm.cache.CachedLLMClient.Builder

Whether to cache streaming responses.

cacheSystemPrompt(boolean) - Method in class com.tnsai.llm.cache.PromptCachingClient.Builder

cacheTools(boolean) - Method in class com.tnsai.llm.cache.PromptCachingClient.Builder

CacheUsage - Record Class in com.tnsai.llm.cache

Cache usage statistics from an LLM response.

CacheUsage(int, int) - Constructor for record class com.tnsai.llm.cache.CacheUsage

Creates an instance of a CacheUsage record class.

calculateCachedInputCost(long) - Method in class com.tnsai.llm.cost.ModelPricing

Calculates cost for cached input tokens.

calculateInputCost(long) - Method in class com.tnsai.llm.cost.ModelPricing

Calculates cost for input tokens.

calculateOutputCost(long) - Method in class com.tnsai.llm.cost.ModelPricing

Calculates cost for output tokens.

calculateSavingsRatio(int) - Method in record class com.tnsai.llm.cache.CacheUsage

Calculates savings ratio compared to non-cached request.

calculateTotalCost(long, long) - Method in class com.tnsai.llm.cost.ModelPricing

Calculates total cost for a request.

calculateTotalCost(long, long, long) - Method in class com.tnsai.llm.cost.ModelPricing

Calculates total cost with cached tokens.

callId() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the callId record component.

callId() - Method in record class com.tnsai.llm.observability.LLMResponse.ToolCallRequest

Returns the value of the callId record component.

callId(String) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

canSpend(BigDecimal) - Method in class com.tnsai.llm.cost.BudgetManager

Checks if a spend amount is within budget.

Capability-based Selection - Search tag in interface com.tnsai.llm.routing.LLMRouter

Section

CapabilityRouter - Class in com.tnsai.llm.routing

Routes LLM requests based on required capabilities.

CapabilityRouter.Builder - Class in com.tnsai.llm.routing

Builder for CapabilityRouter.

Captured Information - Search tag in class com.tnsai.llm.cost.UsageRecord

Section

Capturing channel — quick start - Search tag in package com.tnsai.llm.observability

Section

CapturingLLMClient - Class in com.tnsai.llm.observability

Decorator that wraps any LLMClient and emits one LLMCallLog per call to a configured LLMCallPublisher (issue #79).

CapturingLLMClient(LLMClient, LLMPricingRegistry, LLMCallPublisher) - Constructor for class com.tnsai.llm.observability.CapturingLLMClient

CapturingLLMClient(LLMClient, LLMPricingRegistry, LLMCallPublisher, String) - Constructor for class com.tnsai.llm.observability.CapturingLLMClient

CerebrasClient - Class in com.tnsai.llm.providers

Cerebras LLM client.

CerebrasClient(String) - Constructor for class com.tnsai.llm.providers.CerebrasClient

CerebrasClient(String, float) - Constructor for class com.tnsai.llm.providers.CerebrasClient

CerebrasClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.CerebrasClient

CerebrasClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.CerebrasClient

CerebrasClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.CerebrasClient

CerebrasClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.CerebrasClient

CerebrasProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Cerebras — an OpenAI-compatible provider.

CerebrasProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.CerebrasProviderErrorMapper

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cache.CachedLLMClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cache.PromptCachingClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cost.CostAwareLLMClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.format.JsonModeClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.CapturingLLMClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.ObservableLLMClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.AbstractOpenAICompatibleClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.AnthropicClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.AzureOpenAIClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.BedrockClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.CohereClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.GeminiClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.MiniMaxClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.OllamaClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.OpenAIClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.ReplicateClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.VertexAIClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.WatsonxClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.ZhipuAIClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.CapabilityRouter

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.CostBasedRouter

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.FallbackRouter

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.LatencyBasedRouter

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in interface com.tnsai.llm.routing.LLMRouter

Routes a chat request to the appropriate client.

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.RoundRobinRouter

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.TaskBasedRouter

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>, float) - Method in class com.tnsai.llm.cost.CostAwareLLMClient

chat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>, float) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

chat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cache.PromptCachingClient

chat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cost.CostAwareLLMClient

chat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.format.JsonModeClient

chat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.CapturingLLMClient

chat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.ObservableLLMClient

chat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.GeminiClient

chat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.ZhipuAIClient

chat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

CHAT - Enum constant in enum class com.tnsai.llm.routing.TaskType

Conversational, Qinvalid input: '&A', general knowledge.

chatAs(TaskType, String) - Method in class com.tnsai.llm.routing.TaskBasedRouter

Chat with explicit task type override.

chatAs(TaskType, String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.TaskBasedRouter

Chat with explicit task type override and full parameters.

chatAs(Class<T>, String) - Method in class com.tnsai.llm.format.JsonModeClient

Sends a chat message and parses the JSON response to the specified type.

chatAs(Class<T>, String, Optional<String>) - Method in class com.tnsai.llm.format.JsonModeClient

Sends a chat message with system prompt and parses the JSON response.

chatAs(Class<T>, String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.format.JsonModeClient

Sends a full chat request and parses the JSON response.

chatJson(String) - Method in interface com.tnsai.llm.format.JsonCapableLLMClient

Simplified chat with JSON object format.

chatJson(String, String) - Method in interface com.tnsai.llm.format.JsonCapableLLMClient

Simplified chat with JSON object format and system prompt.

chatWithFormat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>, ResponseFormat) - Method in interface com.tnsai.llm.format.JsonCapableLLMClient

Sends a chat message with the specified response format.

chatWithFormat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>, ResponseFormat) - Method in class com.tnsai.llm.providers.MiniMaxClient

chatWithFormat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>, ResponseFormat) - Method in class com.tnsai.llm.providers.OpenAIClient

chatWithFormat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>, ResponseFormat) - Method in class com.tnsai.llm.providers.ZhipuAIClient

chatWithSchema(String, String, Class<?>) - Method in interface com.tnsai.llm.format.JsonCapableLLMClient

Chat with JSON Schema generated from a class.

chatWithSchema(String, String, Map<String, Object>) - Method in interface com.tnsai.llm.format.JsonCapableLLMClient

Chat with JSON Schema format.

chunkCount() - Method in record class com.tnsai.llm.observability.StreamMetrics

Returns the value of the chunkCount record component.

CircuitBreakerClient - Class in com.tnsai.llm.resilience

LLMClient decorator that implements the circuit breaker pattern.

CircuitBreakerClient.Builder - Class in com.tnsai.llm.resilience

CircuitBreakerClient.CircuitBreakerMetrics - Record Class in com.tnsai.llm.resilience

Snapshot of circuit breaker metrics.

CircuitBreakerClient.State - Enum Class in com.tnsai.llm.resilience

Circuit breaker states.

CircuitBreakerMetrics(CircuitBreakerClient.State, long, long, long, long, long, int, int, Duration) - Constructor for record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Creates an instance of a CircuitBreakerMetrics record class.

CircuitOpenException - Exception Class in com.tnsai.llm.resilience

Thrown when a request is rejected because the circuit breaker is open.

CircuitOpenException(String, int, Duration, Instant) - Constructor for exception class com.tnsai.llm.resilience.CircuitOpenException

CLASSIFICATION - Enum constant in enum class com.tnsai.llm.cache.EmbeddingTask

Symmetric classification / label assignment.

ClassificationResult(TaskType, double, String) - Constructor for record class com.tnsai.llm.routing.TaskClassifier.ClassificationResult

Creates an instance of a ClassificationResult record class.

Classification Strategy - Search tag in class com.tnsai.llm.routing.TaskClassifier

Section

classifier(TaskClassifier) - Method in class com.tnsai.llm.routing.TaskBasedRouter.Builder

Uses a custom TaskClassifier.

classify(String) - Method in class com.tnsai.llm.routing.TaskClassifier

Classifies the given message into a task type.

classify(String, List<String>) - Method in class com.tnsai.llm.routing.TaskClassifier

Classifies the message with context from conversation history.

classifyTask(String) - Method in class com.tnsai.llm.routing.TaskBasedRouter

Classifies the message and returns the detected task type.

classifyTask(String, List<String>) - Method in class com.tnsai.llm.routing.TaskBasedRouter

Classifies the message with conversation history context.

classifyWithConfidence(String) - Method in class com.tnsai.llm.routing.TaskClassifier

Classifies with confidence score.

classifyWithConfidence(String, List<String>) - Method in class com.tnsai.llm.routing.TaskClassifier

Classifies with confidence score and history context.

clear() - Method in class com.tnsai.llm.cache.InMemorySemanticCache

clear() - Method in interface com.tnsai.llm.cache.SemanticCache

Clears all entries from the cache.

clear() - Method in interface com.tnsai.llm.cost.CostTracker

Clears all recorded data.

clear() - Method in class com.tnsai.llm.cost.InMemoryCostTracker

clearCache() - Method in class com.tnsai.llm.cache.CachedLLMClient

Clears the cache.

client(LLMClient) - Method in class com.tnsai.llm.cache.PromptCachingClient.Builder

client(LLMClient) - Method in class com.tnsai.llm.cost.CostAwareLLMClient.Builder

client(LLMClient) - Method in class com.tnsai.llm.format.JsonModeClient.Builder

Sets the LLM client to wrap.

client(LLMClient) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient.Builder

CLOSED - Enum constant in enum class com.tnsai.llm.resilience.CircuitBreakerClient.State

CLUSTERING - Enum constant in enum class com.tnsai.llm.cache.EmbeddingTask

Symmetric similarity: clustering, deduplication, semantic textual similarity, semantic cache.

codes() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnProviderCode

Returns the value of the codes record component.

CODING - Enum constant in enum class com.tnsai.llm.routing.TaskType

Code generation, debugging, refactoring, code review.

CohereClient - Class in com.tnsai.llm.providers

Cohere LLM client implementation.

CohereClient(String) - Constructor for class com.tnsai.llm.providers.CohereClient

CohereClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.CohereClient

CohereClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.CohereClient

CohereClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.CohereClient

CohereClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.CohereClient

CohereProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Cohere — tenth pilot mapper.

CohereProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.CohereProviderErrorMapper

CohereToolConverter - Class in com.tnsai.llm.providers

Translates the OpenAI-flavoured intermediate tool schema into Cohere's chat-API tool shape.

com.tnsai.llm - package com.tnsai.llm

com.tnsai.llm.audio - package com.tnsai.llm.audio

Audio processing capabilities for LLM integration.

com.tnsai.llm.cache - package com.tnsai.llm.cache

LLM response caching with semantic similarity and prompt caching support.

com.tnsai.llm.cost - package com.tnsai.llm.cost

Token usage tracking and budget management for LLM API calls.

com.tnsai.llm.errors - package com.tnsai.llm.errors

com.tnsai.llm.fallback - package com.tnsai.llm.fallback

com.tnsai.llm.format - package com.tnsai.llm.format

Output format handling for structured LLM responses.

com.tnsai.llm.observability - package com.tnsai.llm.observability

Observability components for LLM operations.

com.tnsai.llm.providers - package com.tnsai.llm.providers

LLM provider implementations for various AI services.

com.tnsai.llm.resilience - package com.tnsai.llm.resilience

com.tnsai.llm.routing - package com.tnsai.llm.routing

LLM routing and load balancing for multi-provider setups.

Common Features - Search tag in package com.tnsai.llm.providers

Section

completedAt() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the completedAt record component.

completedAt(Instant) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

completionTokens() - Method in record class com.tnsai.llm.observability.TokenUsage

Returns the value of the completionTokens record component.

completionUSD() - Method in record class com.tnsai.llm.observability.CostEstimate

Returns the value of the completionUSD record component.

Composite(List<FallbackCondition>, FallbackCondition.Composite.LogicalOp) - Constructor for record class com.tnsai.llm.fallback.FallbackCondition.Composite

Creates an instance of a Composite record class.

condition() - Method in record class com.tnsai.llm.fallback.LLMFallbackRule

Returns the value of the condition record component.

conditions() - Method in record class com.tnsai.llm.fallback.FallbackCondition.Composite

Returns the value of the conditions record component.

confidence() - Method in record class com.tnsai.llm.routing.TaskClassifier.ClassificationResult

Returns the value of the confidence record component.

confidenceThreshold(double) - Method in class com.tnsai.llm.routing.TaskBasedRouter.Builder

Sets the minimum confidence threshold for task classification.

Configuration (environment) - Search tag in class com.tnsai.llm.cache.OllamaEmbeddingProvider

Section

consecutiveFailures() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the value of the consecutiveFailures record component.

content() - Method in record class com.tnsai.llm.observability.LLMResponse

Returns the value of the content record component.

ContentBlock(String, String, CacheControl) - Constructor for class com.tnsai.llm.cache.CacheableContent.ContentBlock

context() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the context record component.

context(EventContext) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

context(String) - Method in class com.tnsai.llm.LLMBasedConflictResolver.Builder

Sets additional context about the agent.

convertToClaudeTools(List<Map<String, Object>>) - Static method in class com.tnsai.llm.providers.AnthropicToolConverter

Convert an OpenAI-flavoured tool list into Anthropic's tool list.

convertToCohereTools(List<Map<String, Object>>) - Static method in class com.tnsai.llm.providers.CohereToolConverter

Convert an OpenAI-flavoured tool list into Cohere's tool list.

cooldown() - Method in record class com.tnsai.llm.fallback.LLMFallbackRule

Returns the value of the cooldown record component.

cosineSimilarity(float[], float[]) - Static method in interface com.tnsai.llm.cache.EmbeddingProvider

Calculates cosine similarity between two embeddings.

cost() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the cost record component.

cost(CostEstimate) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

CostAwareLLMClient - Class in com.tnsai.llm.cost

LLMClient wrapper that tracks usage costs and enforces budgets.

CostAwareLLMClient.Builder - Class in com.tnsai.llm.cost

CostBasedRouter - Class in com.tnsai.llm.routing

Routes LLM requests to the cheapest viable provider.

CostBasedRouter.Builder - Class in com.tnsai.llm.routing

Builder for CostBasedRouter.

CostBasedRouter.CostStats - Record Class in com.tnsai.llm.routing

Cost statistics.

Cost Benefits - Search tag in class com.tnsai.llm.cache.CacheControl

Section

costByModel() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the costByModel record component.

costByProvider() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the costByProvider record component.

Cost Calculation - Search tag in record class com.tnsai.llm.cache.CacheUsage

Section

CostEstimate - Record Class in com.tnsai.llm.observability

USD cost breakdown for one LLM call (issue #79).

CostEstimate(BigDecimal, BigDecimal, BigDecimal, BigDecimal, BigDecimal, String) - Constructor for record class com.tnsai.llm.observability.CostEstimate

Creates an instance of a CostEstimate record class.

Cost Optimization - Search tag in interface com.tnsai.llm.routing.LLMRouter

Section

Cost Optimization Strategy - Search tag in class com.tnsai.llm.routing.CostBasedRouter

Section

costPerProvider() - Method in record class com.tnsai.llm.routing.CostBasedRouter.CostStats

Returns the value of the costPerProvider record component.

Cost Savings - Search tag in class com.tnsai.llm.cache.CachedLLMClient

Section

Cost Savings - Search tag in class com.tnsai.llm.cache.PromptCachingClient

Section

CostStatistics(int, long, long, long, BigDecimal, BigDecimal, BigDecimal, BigDecimal, long, Optional<UsageRecord>, Map<String, BigDecimal>, Map<String, BigDecimal>, Duration) - Constructor for record class com.tnsai.llm.cost.CostTracker.CostStatistics

Creates an instance of a CostStatistics record class.

CostStats(double, Map<String, Double>, long, long) - Constructor for record class com.tnsai.llm.routing.CostBasedRouter.CostStats

Creates an instance of a CostStats record class.

costTracker(CostTracker) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

costTracker(CostTracker) - Method in class com.tnsai.llm.cost.CostAwareLLMClient.Builder

CostTracker - Interface in com.tnsai.llm.cost

Interface for tracking LLM API usage costs.

CostTracker.CostStatistics - Record Class in com.tnsai.llm.cost

Aggregated cost statistics.

Cost Tracking - Search tag in class com.tnsai.llm.routing.CostBasedRouter

Section

create() - Static method in class com.tnsai.llm.cost.InMemoryCostTracker

create(String, String, float) - Static method in class com.tnsai.llm.LLMClientFactory

Creates an LLM client from the given provider, model, and temperature.

create(String, String, float[], String, Optional<String>, String) - Static method in record class com.tnsai.llm.cache.CacheEntry

Creates a new cache entry with current timestamp.

create(String, String, float, Integer) - Static method in class com.tnsai.llm.LLMClientFactory

Creates an LLM client from the given configuration.

create(String, String, float, Integer, Float) - Static method in class com.tnsai.llm.LLMClientFactory

Creates an LLM client from the given configuration with topP support.

create(String, String, float, Integer, Float) - Method in class com.tnsai.llm.LLMClientFactoryProvider

create(String, String, float, Integer, Float, LLMClientSettings) - Static method in class com.tnsai.llm.LLMClientFactory

Creates an LLM client honoring Phase 1 LLMClientSettings (endpoint, apiKeyEnv, timeoutMs, penalties).

createCodeExecutionTool() - Static method in class com.tnsai.llm.providers.AnthropicClient

Creates a code execution tool definition for programmatic tool calling.

createdAt() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the createdAt record component.

createDeferredTool(String, String, Map<String, Object>) - Static method in class com.tnsai.llm.providers.AnthropicClient

Creates a deferred tool definition for tool search.

createProgrammaticTool(String, String, Map<String, Object>) - Static method in class com.tnsai.llm.providers.AnthropicClient

Creates a tool definition that can be called by code execution.

createToolSearchTool() - Static method in class com.tnsai.llm.providers.AnthropicClient

Creates a tool search tool definition for dynamic tool discovery.

createWebSearchTool() - Static method in class com.tnsai.llm.providers.AnthropicClient

Creates a web search tool definition.

createWebSearchTool(List<String>, List<String>) - Static method in class com.tnsai.llm.providers.AnthropicClient

Creates a web search tool definition with domain filtering.

CREATIVE - Enum constant in enum class com.tnsai.llm.routing.TaskType

Creative writing, storytelling, poetry, marketing copy.

CRITICAL - Enum constant in enum class com.tnsai.llm.cost.BudgetManager.BudgetState

currentSize() - Method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

Returns the value of the currentSize record component.

currentSpend() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetAlert

Returns the value of the currentSpend record component.

currentSpend() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Returns the value of the currentSpend record component.

Customization - Search tag in class com.tnsai.llm.routing.TaskClassifier

Section

Custom Logging - Search tag in class com.tnsai.llm.observability.ObservableLLMClient

Section

D

daily() - Method in class com.tnsai.llm.cost.BudgetManager.Builder

DatabricksClient - Class in com.tnsai.llm.providers

Databricks Mosaic AI Model Serving LLM client.

DatabricksClient(String) - Constructor for class com.tnsai.llm.providers.DatabricksClient

DatabricksClient(String, float) - Constructor for class com.tnsai.llm.providers.DatabricksClient

DatabricksClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.DatabricksClient

DatabricksClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.DatabricksClient

DatabricksClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.DatabricksClient

DatabricksClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.DatabricksClient

DatabricksProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Databricks — an OpenAI-compatible provider.

DatabricksProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.DatabricksProviderErrorMapper

DEBUG - Enum constant in enum class com.tnsai.llm.observability.PromptLogger.LogLevel

DeepInfraClient - Class in com.tnsai.llm.providers

DeepInfra LLM client.

DeepInfraClient(String) - Constructor for class com.tnsai.llm.providers.DeepInfraClient

DeepInfraClient(String, float) - Constructor for class com.tnsai.llm.providers.DeepInfraClient

DeepInfraClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.DeepInfraClient

DeepInfraClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.DeepInfraClient

DeepInfraClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.DeepInfraClient

DeepInfraClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.DeepInfraClient

DeepInfraProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for DeepInfra — an OpenAI-compatible provider.

DeepInfraProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.DeepInfraProviderErrorMapper

DeepSeekClient - Class in com.tnsai.llm.providers

DeepSeek LLM client.

DeepSeekClient(String) - Constructor for class com.tnsai.llm.providers.DeepSeekClient

DeepSeekClient(String, float) - Constructor for class com.tnsai.llm.providers.DeepSeekClient

DeepSeekClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.DeepSeekClient

DeepSeekClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.DeepSeekClient

DeepSeekClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.DeepSeekClient

DeepSeekClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.DeepSeekClient

DeepSeekProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for DeepSeek — an OpenAI-compatible provider.

DeepSeekProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.DeepSeekProviderErrorMapper

DEFAULT_RESOURCE - Static variable in class com.tnsai.llm.observability.JsonLLMPricingRegistry

Default rate card shipped in this module.

DEFAULT_TIMEOUT_MS - Static variable in record class com.tnsai.llm.LLMClientSettings

defaultAlertThresholds() - Method in class com.tnsai.llm.cost.BudgetManager.Builder

Default Capability Selection - Search tag in class com.tnsai.llm.routing.CapabilityRouter

Section

defaultClassifier() - Static method in class com.tnsai.llm.routing.TaskClassifier

Returns the default classifier with standard settings.

defaultClient(LLMClient) - Method in class com.tnsai.llm.routing.TaskBasedRouter.Builder

Sets the default client for unmatched or low-confidence tasks.

defaultRegistry() - Static method in class com.tnsai.llm.observability.JsonLLMPricingRegistry

Load the bundled default rate card (JsonLLMPricingRegistry.DEFAULT_RESOURCE).

defaultRequirement(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.CapabilityRouter.Builder

defaults() - Static method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions

defaults() - Static method in class com.tnsai.llm.audio.WhisperClient.TranslationOptions

defaults() - Static method in record class com.tnsai.llm.LLMClientSettings

Different from the other 5 mappers: not invoked by executeRequest - Search tag in class com.tnsai.llm.errors.BedrockProviderErrorMapper

Section

disabled() - Static method in record class com.tnsai.llm.observability.LLMPrompt.PromptCacheInfo

No prompt caching configured for this call.

Discovery - Search tag in interface com.tnsai.llm.errors.ProviderErrorMapper

Section

DOCUMENT - Enum constant in enum class com.tnsai.llm.cache.EmbeddingTask

Asymmetric retrieval: corpus text to be retrieved by a EmbeddingTask.QUERY.

E

elapsed() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the elapsed record component.

embed(String) - Method in interface com.tnsai.llm.cache.EmbeddingProvider

Generates an embedding vector for the given text.

embed(String) - Method in class com.tnsai.llm.cache.HashEmbeddingProvider

embed(String) - Method in class com.tnsai.llm.cache.OllamaEmbeddingProvider

embed(String, EmbeddingTask) - Method in interface com.tnsai.llm.cache.EmbeddingProvider

Generates an embedding for text conditioned on task.

embed(String, EmbeddingTask) - Method in class com.tnsai.llm.cache.OllamaEmbeddingProvider

embedBatch(List<String>) - Method in interface com.tnsai.llm.cache.EmbeddingProvider

Generates embeddings for multiple texts in batch.

embedBatch(List<String>) - Method in class com.tnsai.llm.cache.OllamaEmbeddingProvider

embedBatch(List<String>, EmbeddingTask) - Method in interface com.tnsai.llm.cache.EmbeddingProvider

Batch counterpart of EmbeddingProvider.embed(String, EmbeddingTask).

embedBatch(List<String>, EmbeddingTask) - Method in class com.tnsai.llm.cache.OllamaEmbeddingProvider

embedding() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the embedding record component.

embeddingProvider(EmbeddingProvider) - Method in class com.tnsai.llm.cache.InMemorySemanticCache.Builder

EmbeddingProvider - Interface in com.tnsai.llm.cache

Provides embeddings for text to enable semantic similarity search.

EmbeddingTask - Enum Class in com.tnsai.llm.cache

The task an embedding is generated for.

empty() - Static method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

empty() - Static method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

empty() - Static method in record class com.tnsai.llm.observability.ToolSurface

An empty tool surface — the LLM call advertised no tools.

EMPTY - Static variable in record class com.tnsai.llm.cache.CacheUsage

Empty cache usage (no caching).

EMPTY - Static variable in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

enabled() - Method in record class com.tnsai.llm.observability.LLMPrompt.PromptCacheInfo

Returns the value of the enabled record component.

enableEphemeralCaching(boolean) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Toggles cache_control marker injection on the system prompt and the last AnthropicClient.Builder.cacheLastNTurns(int) user messages in history (issue #27).

endpoint() - Method in record class com.tnsai.llm.LLMClientSettings

Returns the value of the endpoint record component.

endpoint() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the endpoint record component.

endpoint(String) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

entry() - Method in record class com.tnsai.llm.cache.SemanticCache.SimilarityResult

Returns the value of the entry record component.

Environment Variables - Search tag in class com.tnsai.llm.LLMClientFactory

Section

Environment Variables - Search tag in class com.tnsai.llm.providers.OllamaClient

Section

ephemeral() - Static method in class com.tnsai.llm.cache.CacheControl

Creates an ephemeral cache control.

EPHEMERAL - Enum constant in enum class com.tnsai.llm.cache.CacheControl.Type

Ephemeral caching (5 minute TTL, refreshed on use).

equals(Object) - Method in record class com.tnsai.llm.cache.CacheEntry

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.cache.CacheUsage

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.cache.SemanticCache.SimilarityResult

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetAlert

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.fallback.FallbackCondition.Always

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.fallback.FallbackCondition.Composite

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnErrorType

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnHttpStatus

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnProviderCode

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.fallback.LLMChainExhaustedException.AttemptRecord

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.fallback.LLMFallbackRule

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in class com.tnsai.llm.format.ResponseFormat

equals(Object) - Method in record class com.tnsai.llm.LLMClientSettings

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.CostEstimate

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.ErrorInfo

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.LLMCallLog

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.LLMPrompt

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.LLMPrompt.PromptCacheInfo

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.LLMResponse

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.LLMResponse.ToolCallRequest

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.StreamMetrics

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.TokenUsage

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.observability.ToolSurface

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.routing.CostBasedRouter.CostStats

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.routing.LatencyBasedRouter.LatencyStats

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in record class com.tnsai.llm.routing.TaskClassifier.ClassificationResult

Indicates whether some other object is "equal to" this one.

error() - Method in record class com.tnsai.llm.fallback.LLMChainExhaustedException.AttemptRecord

Returns the value of the error record component.

error() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the error record component.

error(ErrorInfo) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

errorClass() - Method in record class com.tnsai.llm.observability.ErrorInfo

Returns the value of the errorClass record component.

ErrorInfo - Record Class in com.tnsai.llm.observability

Failure detail for a non-successful LLM call (issue #79).

ErrorInfo(String, String, int, Optional<String>, boolean) - Constructor for record class com.tnsai.llm.observability.ErrorInfo

Creates an instance of a ErrorInfo record class.

errorMessage() - Method in record class com.tnsai.llm.observability.ErrorInfo

Returns the value of the errorMessage record component.

errorRate() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

errorRate() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

errors() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns the value of the errors record component.

estimate(String, String, TokenUsage) - Method in class com.tnsai.llm.observability.InMemoryLLMPricingRegistry

estimate(String, String, TokenUsage) - Method in class com.tnsai.llm.observability.JsonLLMPricingRegistry

estimate(String, String, TokenUsage) - Method in interface com.tnsai.llm.observability.LLMPricingRegistry

Compute a USD cost estimate for the given usage under the named provider + model.

estimateBeforeRequest(boolean) - Method in class com.tnsai.llm.cost.CostAwareLLMClient.Builder

estimatedCost() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns the value of the estimatedCost record component.

estimatedInputTokensPerChar(int) - Method in class com.tnsai.llm.cost.CostAwareLLMClient.Builder

estimatedSavings() - Method in record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Returns the value of the estimatedSavings record component.

evictions() - Method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

Returns the value of the evictions record component.

Example - Search tag in class com.tnsai.llm.format.SchemaGenerator

Section

Example - Search tag in com.tnsai.llm.format.ResponseFormat.jsonObject()

Section

Example - Search tag in interface com.tnsai.llm.fallback.LLMFallbackChain

Section

Example Implementation - Search tag in interface com.tnsai.llm.format.JsonCapableLLMClient

Section

EXCEEDED - Enum constant in enum class com.tnsai.llm.cost.BudgetManager.BudgetState

Extending - Search tag in class com.tnsai.llm.providers.AbstractOpenAICompatibleClient

Section

F

failedRequests() - Method in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Returns the value of the failedRequests record component.

failureCount() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the value of the failureCount record component.

failuresPerProvider() - Method in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Returns the value of the failuresPerProvider record component.

failureThreshold() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the value of the failureThreshold record component.

failureThreshold(int) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient.Builder

fallback(LLMFallbackRule) - Method in class com.tnsai.llm.fallback.LLMFallbackChain.Builder

fallback(LLMClient, FallbackCondition) - Method in class com.tnsai.llm.fallback.LLMFallbackChain.Builder

fallback(LLMClient, FallbackCondition, Duration) - Method in class com.tnsai.llm.fallback.LLMFallbackChain.Builder

Fallback Behavior - Search tag in class com.tnsai.llm.routing.FallbackRouter

Section

FallbackCondition - Interface in com.tnsai.llm.fallback

Sealed predicate over an LLMException describing when a LLMFallbackRule should fire (issue #89).

FallbackCondition.Always - Record Class in com.tnsai.llm.fallback

Always matches — the catch-all "last resort" condition.

FallbackCondition.Composite - Record Class in com.tnsai.llm.fallback

Logical AND/OR over child conditions.

FallbackCondition.Composite.LogicalOp - Enum Class in com.tnsai.llm.fallback

FallbackCondition.OnErrorType - Record Class in com.tnsai.llm.fallback

Match when the failure's classified LLMException.ErrorType is in the configured set.

FallbackCondition.OnHttpStatus - Record Class in com.tnsai.llm.fallback

Match when the upstream HTTP status (from ProviderDetails) is in the configured set.

FallbackCondition.OnProviderCode - Record Class in com.tnsai.llm.fallback

Match when the failure originated from the named provider AND its native error code (from the ProviderDetails envelope) is in the configured set.

FallbackRouter - Class in com.tnsai.llm.routing

LLM router with automatic fallback on failure.

FallbackRouter.Builder - Class in com.tnsai.llm.routing

Builder for FallbackRouter.

fallbackStrategy(DesireConflictResolver) - Method in class com.tnsai.llm.LLMBasedConflictResolver.Builder

Sets the fallback strategy if LLM fails.

FAST - Enum constant in enum class com.tnsai.llm.routing.TaskType

Quick, simple tasks that need fast responses.

fastestLatencyMs() - Method in record class com.tnsai.llm.routing.LatencyBasedRouter.LatencyStats

Returns the value of the fastestLatencyMs record component.

fastestProvider() - Method in record class com.tnsai.llm.routing.LatencyBasedRouter.LatencyStats

Returns the value of the fastestProvider record component.

Features - Search tag in class com.tnsai.llm.cache.InMemorySemanticCache

Section

Features - Search tag in class com.tnsai.llm.cache.PromptCachingClient

Section

Features - Search tag in class com.tnsai.llm.cost.BudgetManager

Section

Features - Search tag in class com.tnsai.llm.cost.InMemoryCostTracker

Section

Features - Search tag in interface com.tnsai.llm.cost.CostTracker

Section

Field semantics - Search tag in record class com.tnsai.llm.observability.CostEstimate

Section

filterPII(boolean) - Method in class com.tnsai.llm.observability.PromptLogger.Builder

findAllSimilar(String, double, int) - Method in class com.tnsai.llm.cache.InMemorySemanticCache

findAllSimilar(String, double, int) - Method in interface com.tnsai.llm.cache.SemanticCache

Finds all similar entries above the threshold.

findSimilar(String, double) - Method in class com.tnsai.llm.cache.InMemorySemanticCache

findSimilar(String, double) - Method in interface com.tnsai.llm.cache.SemanticCache

Finds the most similar cached entry above the threshold.

findSimilar(String, Optional<String>, double) - Method in class com.tnsai.llm.cache.InMemorySemanticCache

findSimilar(String, Optional<String>, double) - Method in interface com.tnsai.llm.cache.SemanticCache

Finds the most similar cached entry with system prompt consideration.

finishReason() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the finishReason record component.

finishReason(ChatChunk.FinishReason) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

FireworksAIClient - Class in com.tnsai.llm.providers

Fireworks.ai LLM client.

FireworksAIClient(String) - Constructor for class com.tnsai.llm.providers.FireworksAIClient

FireworksAIClient(String, float) - Constructor for class com.tnsai.llm.providers.FireworksAIClient

FireworksAIClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.FireworksAIClient

FireworksAIClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.FireworksAIClient

FireworksAIClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.FireworksAIClient

FireworksAIClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.FireworksAIClient

FireworksAIProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Fireworks.ai — an OpenAI-compatible provider.

FireworksAIProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.FireworksAIProviderErrorMapper

firstChunkAt() - Method in record class com.tnsai.llm.observability.StreamMetrics

Returns the value of the firstChunkAt record component.

forcePromptEngineering(boolean) - Method in class com.tnsai.llm.format.JsonModeClient.Builder

Forces prompt engineering even if provider supports native JSON mode.

forChina(String) - Static method in class com.tnsai.llm.providers.MiniMaxClient

Creates a MiniMaxClient configured for China region.

forModel(String) - Static method in class com.tnsai.llm.cost.ModelPricing

Gets pricing for a model.

forProvider(String) - Static method in class com.tnsai.llm.errors.ProviderErrorMappers

forTask(TaskType, LLMClient) - Method in class com.tnsai.llm.routing.TaskBasedRouter.Builder

Assigns a client for a specific task type.

frequencyPenalty() - Method in record class com.tnsai.llm.LLMClientSettings

Returns the value of the frequencyPenalty record component.

from(LLMSpec) - Static method in record class com.tnsai.llm.LLMClientSettings

from(Throwable, int, String, boolean) - Static method in record class com.tnsai.llm.observability.ErrorInfo

Build an ErrorInfo from a throwable, defaulting unknown fields.

from(List<Map<String, Object>>) - Static method in class com.tnsai.llm.observability.ToolSurfaceHasher

Build a ToolSurface from the raw provider tool list.

fromAnnotation(Class<?>) - Static method in class com.tnsai.llm.LLMClientFactory

Creates an LLM client directly from a class's @RoleSpec annotation.

fromClasspath(String) - Static method in class com.tnsai.llm.observability.JsonLLMPricingRegistry

Load a rate card from a classpath resource.

fromEnv() - Static method in class com.tnsai.llm.providers.AzureOpenAIClient

Creates an AzureOpenAIClient from environment variables.

fromEnv(float) - Static method in class com.tnsai.llm.providers.AzureOpenAIClient

Creates an AzureOpenAIClient from environment variables with custom temperature.

fromEnv(float, Float, Integer) - Static method in class com.tnsai.llm.providers.AzureOpenAIClient

Creates an AzureOpenAIClient from environment variables with custom temperature, topP, and max tokens.

fromEnv(float, Integer) - Static method in class com.tnsai.llm.providers.AzureOpenAIClient

Creates an AzureOpenAIClient from environment variables with custom temperature and max tokens.

fromId(String) - Static method in enum class com.tnsai.llm.routing.TaskType

Finds TaskType by id.

fromSpec(RoleSpecReader.RoleSpec) - Static method in class com.tnsai.llm.LLMClientFactory

Creates an LLM client from role metadata.

fromSpecSource(LLMSpecSource, String) - Static method in class com.tnsai.llm.LLMClientFactory

Creates an LLM client from an LLMSpecSource.

G

GeminiClient - Class in com.tnsai.llm.providers

Google Gemini LLM client with multimodal support (text, image, audio, video).

GeminiClient() - Constructor for class com.tnsai.llm.providers.GeminiClient

GeminiClient(String) - Constructor for class com.tnsai.llm.providers.GeminiClient

GeminiClient(String, float) - Constructor for class com.tnsai.llm.providers.GeminiClient

GeminiClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.GeminiClient

GeminiClient(String, float, String) - Constructor for class com.tnsai.llm.providers.GeminiClient

GeminiClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.GeminiClient

GeminiClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.GeminiClient

GeminiProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Google's Generative Language API (Gemini).

GeminiProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.GeminiProviderErrorMapper

Gemini with Images - Search tag in package com.tnsai.llm.providers

Section

GENERAL - Enum constant in enum class com.tnsai.llm.routing.TaskType

Default/fallback for unclassified tasks.

generateRecordSchema(Class<?>) - Static method in class com.tnsai.llm.format.SchemaGenerator

Generates a JSON Schema from a record class.

generateSchema(Class<?>) - Static method in class com.tnsai.llm.format.SchemaGenerator

Generates a JSON Schema from a Java class.

getAgeSeconds() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the age of this entry in seconds.

getApiVersion() - Method in class com.tnsai.llm.providers.AzureOpenAIClient

Returns the API version.

getAttempts() - Method in exception class com.tnsai.llm.fallback.LLMChainExhaustedException

The full attempt history.

getAuthType() - Method in class com.tnsai.llm.providers.AzureOpenAIClient

Returns the authentication type.

getBaseUrl() - Method in class com.tnsai.llm.providers.AbstractLLMClient

getBetas() - Method in class com.tnsai.llm.providers.AnthropicClient

Returns the list of beta features enabled for this client.

getBlocks() - Method in class com.tnsai.llm.cache.CacheableContent

Gets content blocks (for complex content).

getBudgetManager() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

Gets the budget manager.

getBudgetStatus() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

Gets budget status if budget manager is configured.

getByHash(String) - Method in class com.tnsai.llm.cache.InMemorySemanticCache

getByHash(String) - Method in interface com.tnsai.llm.cache.SemanticCache

Gets an entry by exact prompt hash.

getCache() - Method in class com.tnsai.llm.cache.CachedLLMClient

Returns the cache instance.

getCacheControl() - Method in class com.tnsai.llm.cache.CacheableContent.ContentBlock

getCacheControl() - Method in class com.tnsai.llm.cache.CacheableContent

Gets the cache control (for simple content).

getCachedInputCost() - Method in class com.tnsai.llm.cost.UsageRecord

getCachedInputPricePerMillion() - Method in class com.tnsai.llm.cost.ModelPricing

getCachedInputTokens() - Method in class com.tnsai.llm.cost.UsageRecord

getCacheHistoryBreakpoints() - Method in class com.tnsai.llm.cache.PromptCachingClient

Gets the number of history breakpoints for caching.

getCacheHitRate() - Method in class com.tnsai.llm.cache.PromptCachingClient

Gets cache hit rate (0.0 to 1.0).

getCacheStats() - Method in class com.tnsai.llm.cache.CachedLLMClient

Returns cache statistics.

getCallTimeoutMs() - Method in class com.tnsai.llm.providers.AbstractLLMClient

getCapabilities() - Method in class com.tnsai.llm.cache.CachedLLMClient

getCapabilities() - Method in class com.tnsai.llm.cache.PromptCachingClient

getCapabilities() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

getCapabilities() - Method in class com.tnsai.llm.format.JsonModeClient

getCapabilities() - Method in class com.tnsai.llm.observability.CapturingLLMClient

getCapabilities() - Method in class com.tnsai.llm.observability.ObservableLLMClient

getCapabilities() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

getCapabilities() - Method in class com.tnsai.llm.routing.CapabilityRouter

getCapabilities() - Method in class com.tnsai.llm.routing.CostBasedRouter

getCapabilities() - Method in class com.tnsai.llm.routing.FallbackRouter

getCapabilities() - Method in class com.tnsai.llm.routing.LatencyBasedRouter

getCapabilities() - Method in class com.tnsai.llm.routing.RoundRobinRouter

getCapabilities() - Method in class com.tnsai.llm.routing.TaskBasedRouter

getClientForTask(TaskType) - Method in class com.tnsai.llm.routing.TaskBasedRouter

Returns the client assigned to a specific task type.

getClients() - Method in class com.tnsai.llm.routing.CapabilityRouter

getClients() - Method in class com.tnsai.llm.routing.CostBasedRouter

getClients() - Method in class com.tnsai.llm.routing.FallbackRouter

getClients() - Method in class com.tnsai.llm.routing.LatencyBasedRouter

getClients() - Method in interface com.tnsai.llm.routing.LLMRouter

Returns all registered LLM clients.

getClients() - Method in class com.tnsai.llm.routing.RoundRobinRouter

getClients() - Method in class com.tnsai.llm.routing.TaskBasedRouter

getConsecutiveFailures() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

Gets the number of consecutive failures.

getCostByModel() - Method in interface com.tnsai.llm.cost.CostTracker

Gets cost breakdown by model.

getCostByModel() - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getCostByProvider() - Method in interface com.tnsai.llm.cost.CostTracker

Gets cost breakdown by provider.

getCostByProvider() - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getCostStats() - Method in class com.tnsai.llm.routing.CostBasedRouter

Returns cost statistics.

getCostTracker() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

Gets the cost tracker.

getCurrentIndex() - Method in class com.tnsai.llm.routing.RoundRobinRouter

Returns the current rotation index.

getCurrentSpend() - Method in exception class com.tnsai.llm.cost.BudgetExceededException

getCurrentSpend() - Method in class com.tnsai.llm.cost.BudgetManager

Gets the current spend in this period.

getDelegate() - Method in class com.tnsai.llm.cache.CachedLLMClient

Returns the underlying LLM client.

getDelegate() - Method in class com.tnsai.llm.cache.PromptCachingClient

Gets the underlying delegate client.

getDelegate() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

Gets the underlying delegate client.

getDelegate() - Method in class com.tnsai.llm.format.JsonModeClient

Gets the wrapped delegate client.

getDelegate() - Method in class com.tnsai.llm.observability.CapturingLLMClient

getDelegate() - Method in class com.tnsai.llm.observability.ObservableLLMClient

Returns the underlying client.

getDelegate() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

Gets the underlying delegate client.

getDeploymentId() - Method in class com.tnsai.llm.providers.AzureOpenAIClient

Returns the deployment ID.

getDimension() - Method in interface com.tnsai.llm.cache.EmbeddingProvider

Returns the dimension of the embedding vectors.

getDimension() - Method in class com.tnsai.llm.cache.HashEmbeddingProvider

getDimension() - Method in class com.tnsai.llm.cache.OllamaEmbeddingProvider

getDuration() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionResult

getEndpoint() - Method in class com.tnsai.llm.providers.AzureOpenAIClient

Returns the Azure OpenAI endpoint.

getEstimatedCost() - Method in exception class com.tnsai.llm.cost.BudgetExceededException

getEstimatedSavings() - Method in class com.tnsai.llm.cache.PromptCachingClient

Gets estimated cost savings from caching.

getFailureCount() - Method in exception class com.tnsai.llm.resilience.CircuitOpenException

getFrequencyPenalty() - Method in class com.tnsai.llm.providers.OpenAIClient

getGroupId() - Method in class com.tnsai.llm.providers.MiniMaxClient

Returns the configured group ID.

getId() - Method in class com.tnsai.llm.cost.UsageRecord

getId() - Method in enum class com.tnsai.llm.routing.TaskType

Returns the task type identifier.

getInputCost() - Method in class com.tnsai.llm.cost.UsageRecord

getInputPricePerMillion() - Method in class com.tnsai.llm.cost.ModelPricing

getInputTokens() - Method in class com.tnsai.llm.cost.UsageRecord

getKeywords() - Method in enum class com.tnsai.llm.routing.TaskType

Returns keywords associated with this task type.

getLanguage() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions

getLanguage() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionResult

getLatencyMs() - Method in class com.tnsai.llm.cost.UsageRecord

getLatencyStats() - Method in class com.tnsai.llm.routing.LatencyBasedRouter

Returns latency statistics.

getLimit() - Method in exception class com.tnsai.llm.cost.BudgetExceededException

getLimit() - Method in class com.tnsai.llm.cost.BudgetManager

Gets the budget limit.

getMaxTokens() - Method in class com.tnsai.llm.cache.CachedLLMClient

getMaxTokens() - Method in class com.tnsai.llm.cache.PromptCachingClient

getMaxTokens() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

getMaxTokens() - Method in class com.tnsai.llm.format.JsonModeClient

getMaxTokens() - Method in class com.tnsai.llm.observability.CapturingLLMClient

getMaxTokens() - Method in class com.tnsai.llm.observability.ObservableLLMClient

getMaxTokens() - Method in class com.tnsai.llm.providers.AbstractLLMClient

getMaxTokens() - Method in class com.tnsai.llm.providers.AzureOpenAIClient

getMaxTokens() - Method in class com.tnsai.llm.providers.BedrockClient

getMaxTokens() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

getMaxTokens() - Method in class com.tnsai.llm.routing.CapabilityRouter

getMaxTokens() - Method in class com.tnsai.llm.routing.CostBasedRouter

getMaxTokens() - Method in class com.tnsai.llm.routing.FallbackRouter

getMaxTokens() - Method in class com.tnsai.llm.routing.LatencyBasedRouter

getMaxTokens() - Method in class com.tnsai.llm.routing.RoundRobinRouter

getMaxTokens() - Method in class com.tnsai.llm.routing.TaskBasedRouter

getMetrics() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

Gets circuit breaker metrics.

getMetricsByProvider() - Method in class com.tnsai.llm.observability.LLMMetrics

Gets metrics per provider.

getModel() - Method in class com.tnsai.llm.audio.WhisperClient

Returns the model being used.

getModel() - Method in class com.tnsai.llm.cache.CachedLLMClient

getModel() - Method in class com.tnsai.llm.cache.PromptCachingClient

getModel() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

getModel() - Method in class com.tnsai.llm.format.JsonModeClient

getModel() - Method in class com.tnsai.llm.observability.CapturingLLMClient

getModel() - Method in class com.tnsai.llm.observability.ObservableLLMClient

getModel() - Method in class com.tnsai.llm.providers.AbstractLLMClient

getModel() - Method in class com.tnsai.llm.providers.AzureOpenAIClient

getModel() - Method in class com.tnsai.llm.providers.BedrockClient

getModel() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

getModel() - Method in exception class com.tnsai.llm.resilience.CircuitOpenException

getModel() - Method in class com.tnsai.llm.routing.CapabilityRouter

getModel() - Method in class com.tnsai.llm.routing.CostBasedRouter

getModel() - Method in class com.tnsai.llm.routing.FallbackRouter

getModel() - Method in class com.tnsai.llm.routing.LatencyBasedRouter

getModel() - Method in class com.tnsai.llm.routing.RoundRobinRouter

getModel() - Method in class com.tnsai.llm.routing.TaskBasedRouter

getModelId() - Method in class com.tnsai.llm.cost.ModelPricing

getModelId() - Method in class com.tnsai.llm.cost.UsageRecord

getModelName() - Method in interface com.tnsai.llm.cache.EmbeddingProvider

Returns the name of the embedding model.

getModelName() - Method in class com.tnsai.llm.cache.HashEmbeddingProvider

getModelName() - Method in class com.tnsai.llm.cache.OllamaEmbeddingProvider

getObserver() - Method in class com.tnsai.llm.observability.ObservableLLMClient

Returns the observer.

getOpenedAt() - Method in exception class com.tnsai.llm.resilience.CircuitOpenException

getOutputCost() - Method in class com.tnsai.llm.cost.UsageRecord

getOutputPricePerMillion() - Method in class com.tnsai.llm.cost.ModelPricing

getOutputTokens() - Method in class com.tnsai.llm.cost.UsageRecord

getPeriod() - Method in class com.tnsai.llm.cost.BudgetManager

Gets the budget period.

getPeriodStart() - Method in class com.tnsai.llm.cost.BudgetManager

Gets the period start time.

getPresencePenalty() - Method in class com.tnsai.llm.providers.OpenAIClient

getPrimaryClient() - Method in class com.tnsai.llm.routing.CapabilityRouter

getPrimaryClient() - Method in class com.tnsai.llm.routing.CostBasedRouter

getPrimaryClient() - Method in class com.tnsai.llm.routing.FallbackRouter

getPrimaryClient() - Method in class com.tnsai.llm.routing.LatencyBasedRouter

getPrimaryClient() - Method in interface com.tnsai.llm.routing.LLMRouter

Returns the currently selected/primary client.

getPrimaryClient() - Method in class com.tnsai.llm.routing.RoundRobinRouter

getPrimaryClient() - Method in class com.tnsai.llm.routing.TaskBasedRouter

getPrompt() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions

getPrompt() - Method in class com.tnsai.llm.audio.WhisperClient.TranslationOptions

getProvider() - Method in class com.tnsai.llm.cost.ModelPricing

getProvider() - Method in class com.tnsai.llm.cost.UsageRecord

getProviderName() - Method in class com.tnsai.llm.observability.CapturingLLMClient

getProviderName() - Method in class com.tnsai.llm.providers.OllamaClient

getProviderName() - Method in class com.tnsai.llm.providers.OpenAIClient

getRawContent() - Method in exception class com.tnsai.llm.format.JsonModeClient.JsonParseException

Gets the raw content that failed to parse.

getRecordCount() - Method in interface com.tnsai.llm.cost.CostTracker

Gets the record count.

getRecordCount() - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getRecords() - Method in interface com.tnsai.llm.cost.CostTracker

Gets all recorded usage records.

getRecords() - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getRecords(Instant, Instant) - Method in interface com.tnsai.llm.cost.CostTracker

Gets usage records within a time range.

getRecords(Instant, Instant) - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getRecordsByModel(String) - Method in interface com.tnsai.llm.cost.CostTracker

Gets usage records for a specific model.

getRecordsByModel(String) - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getRecordsByProvider(String) - Method in interface com.tnsai.llm.cost.CostTracker

Gets usage records for a specific provider.

getRecordsByProvider(String) - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getRecoveryTimeout() - Method in exception class com.tnsai.llm.resilience.CircuitOpenException

getRemaining() - Method in exception class com.tnsai.llm.cost.BudgetExceededException

getRemainingBudget() - Method in class com.tnsai.llm.cost.BudgetManager

Gets the remaining budget.

getRemainingRecoveryTime() - Method in exception class com.tnsai.llm.resilience.CircuitOpenException

Returns the estimated time remaining until the circuit transitions to HALF_OPEN.

getRemainingTime() - Method in class com.tnsai.llm.cost.BudgetManager

Gets time remaining in current period.

getReport() - Method in class com.tnsai.llm.observability.LLMMetrics

Gets a comprehensive metrics report.

getRequestCount() - Method in class com.tnsai.llm.cache.PromptCachingClient

Gets total request count.

getRequestCount() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

Gets total request count.

getResponseFormat() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions

getResponseFormat() - Method in class com.tnsai.llm.audio.WhisperClient.TranslationOptions

getResponseFormat() - Method in class com.tnsai.llm.format.JsonModeClient

Gets the response format being used.

getSchema() - Method in class com.tnsai.llm.format.ResponseFormat

Gets the JSON schema (only for JSON_SCHEMA type).

getSchemaName() - Method in class com.tnsai.llm.format.ResponseFormat

Gets the schema name (only for JSON_SCHEMA type).

getSegments() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionResult

getSpec() - Method in class com.tnsai.llm.cost.UsageRecord

getSpec(String, Class<T>) - Method in class com.tnsai.llm.cost.UsageRecord

getState() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

Gets the current circuit state.

getStatistics() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

Gets cost statistics.

getStatistics() - Method in interface com.tnsai.llm.cost.CostTracker

Gets aggregated statistics.

getStatistics() - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getStatistics(Instant, Instant) - Method in interface com.tnsai.llm.cost.CostTracker

Gets statistics for a time range.

getStatistics(Instant, Instant) - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getStats() - Method in class com.tnsai.llm.cache.InMemorySemanticCache

getStats() - Method in interface com.tnsai.llm.cache.SemanticCache

Returns cache statistics.

getStats() - Method in class com.tnsai.llm.routing.CapabilityRouter

getStats() - Method in class com.tnsai.llm.routing.CostBasedRouter

getStats() - Method in class com.tnsai.llm.routing.FallbackRouter

getStats() - Method in class com.tnsai.llm.routing.LatencyBasedRouter

getStats() - Method in interface com.tnsai.llm.routing.LLMRouter

Returns routing statistics (calls per provider, failures, latencies).

getStats() - Method in class com.tnsai.llm.routing.RoundRobinRouter

getStats() - Method in class com.tnsai.llm.routing.TaskBasedRouter

getStatus() - Method in class com.tnsai.llm.cost.BudgetManager

Gets current budget status.

getTaskStats() - Method in class com.tnsai.llm.routing.TaskBasedRouter

Returns task-specific routing statistics.

getTemperature() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions

getTemperature() - Method in class com.tnsai.llm.audio.WhisperClient.TranslationOptions

getTemperature() - Method in class com.tnsai.llm.cache.CachedLLMClient

getTemperature() - Method in class com.tnsai.llm.cache.PromptCachingClient

getTemperature() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

getTemperature() - Method in class com.tnsai.llm.format.JsonModeClient

getTemperature() - Method in class com.tnsai.llm.observability.CapturingLLMClient

getTemperature() - Method in class com.tnsai.llm.observability.ObservableLLMClient

getTemperature() - Method in class com.tnsai.llm.providers.AbstractLLMClient

getTemperature() - Method in class com.tnsai.llm.providers.AzureOpenAIClient

getTemperature() - Method in class com.tnsai.llm.providers.BedrockClient

getTemperature() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

getTemperature() - Method in class com.tnsai.llm.routing.CapabilityRouter

getTemperature() - Method in class com.tnsai.llm.routing.CostBasedRouter

getTemperature() - Method in class com.tnsai.llm.routing.FallbackRouter

getTemperature() - Method in class com.tnsai.llm.routing.LatencyBasedRouter

getTemperature() - Method in class com.tnsai.llm.routing.RoundRobinRouter

getTemperature() - Method in class com.tnsai.llm.routing.TaskBasedRouter

getText() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionResult

getText() - Method in class com.tnsai.llm.cache.CacheableContent.ContentBlock

getText() - Method in class com.tnsai.llm.cache.CacheableContent

Gets the text content (for simple content).

getTimestamp() - Method in class com.tnsai.llm.cost.UsageRecord

getTimestampGranularities() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions

getTopP() - Method in class com.tnsai.llm.observability.CapturingLLMClient

getTopP() - Method in class com.tnsai.llm.providers.AbstractLLMClient

getTopP() - Method in class com.tnsai.llm.providers.AzureOpenAIClient

getTopP() - Method in class com.tnsai.llm.providers.BedrockClient

getTotalCacheCreationTokens() - Method in class com.tnsai.llm.cache.PromptCachingClient

Gets total cache creation tokens across all requests.

getTotalCacheReadTokens() - Method in class com.tnsai.llm.cache.PromptCachingClient

Gets total cache read tokens across all requests.

getTotalCost() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

Gets total cost across all requests.

getTotalCost() - Method in interface com.tnsai.llm.cost.CostTracker

Gets the total cost across all records.

getTotalCost() - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getTotalCost() - Method in class com.tnsai.llm.cost.UsageRecord

getTotalCost(Instant, Instant) - Method in interface com.tnsai.llm.cost.CostTracker

Gets the total cost within a time range.

getTotalCost(Instant, Instant) - Method in class com.tnsai.llm.cost.InMemoryCostTracker

getTotalInputTokens() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

Gets total input tokens used.

getTotalOutputTokens() - Method in class com.tnsai.llm.cost.CostAwareLLMClient

Gets total output tokens used.

getTotalTokens() - Method in class com.tnsai.llm.cost.UsageRecord

getType() - Method in class com.tnsai.llm.cache.CacheableContent.ContentBlock

getType() - Method in class com.tnsai.llm.cache.CacheControl

Gets the cache control type.

getType() - Method in class com.tnsai.llm.format.ResponseFormat

Gets the format type.

getTypeValue() - Method in class com.tnsai.llm.cache.CacheControl

Gets the type value as string.

getUsagePercent() - Method in class com.tnsai.llm.cost.BudgetManager

Gets the usage percentage (0.0 to 1.0+).

getValue() - Method in enum class com.tnsai.llm.audio.WhisperClient.ResponseFormat

getValue() - Method in enum class com.tnsai.llm.cache.CacheControl.Type

getValue() - Method in enum class com.tnsai.llm.format.ResponseFormat.Type

Gets the API value for this type.

getWords() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionResult

GroqClient - Class in com.tnsai.llm.providers

Groq LLM client implementation.

GroqClient(String) - Constructor for class com.tnsai.llm.providers.GroqClient

GroqClient(String, float) - Constructor for class com.tnsai.llm.providers.GroqClient

GroqClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.GroqClient

GroqClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.GroqClient

GroqClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.GroqClient

GroqClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.GroqClient

GroqProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Groq — seventh pilot mapper.

GroqProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.GroqProviderErrorMapper

groupId(String) - Method in class com.tnsai.llm.providers.MiniMaxClient.Builder

H

HALF_OPEN - Enum constant in enum class com.tnsai.llm.resilience.CircuitBreakerClient.State

hardLimit(boolean) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

hasAdvancedToolUse() - Method in class com.tnsai.llm.providers.AnthropicClient

Checks if this client has advanced tool use enabled.

hasBetas() - Method in class com.tnsai.llm.providers.AnthropicClient

Returns true if any beta features are enabled.

hasCacheCreation() - Method in record class com.tnsai.llm.cache.CacheUsage

Checks if any cache was created.

hasCacheHit() - Method in record class com.tnsai.llm.cache.CacheUsage

Checks if any cache was used.

hashCode() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.cache.CacheUsage

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.cache.SemanticCache.SimilarityResult

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetAlert

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.fallback.FallbackCondition.Always

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.fallback.FallbackCondition.Composite

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnErrorType

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnHttpStatus

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnProviderCode

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.fallback.LLMChainExhaustedException.AttemptRecord

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.fallback.LLMFallbackRule

Returns a hash code value for this object.

hashCode() - Method in class com.tnsai.llm.format.ResponseFormat

hashCode() - Method in record class com.tnsai.llm.LLMClientSettings

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.CostEstimate

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.ErrorInfo

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.LLMPrompt

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.LLMPrompt.PromptCacheInfo

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.LLMResponse

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.LLMResponse.ToolCallRequest

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.StreamMetrics

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.TokenUsage

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.observability.ToolSurface

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.routing.CostBasedRouter.CostStats

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.routing.LatencyBasedRouter.LatencyStats

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Returns a hash code value for this object.

hashCode() - Method in record class com.tnsai.llm.routing.TaskClassifier.ClassificationResult

Returns a hash code value for this object.

HashEmbeddingProvider - Class in com.tnsai.llm.cache

Simple hash-based embedding provider for testing and development.

HashEmbeddingProvider() - Constructor for class com.tnsai.llm.cache.HashEmbeddingProvider

HashEmbeddingProvider(int) - Constructor for class com.tnsai.llm.cache.HashEmbeddingProvider

hasNonDefault() - Method in record class com.tnsai.llm.LLMClientSettings

hasPromptCaching() - Method in class com.tnsai.llm.providers.AnthropicClient

Checks if this client has prompt caching enabled.

hasSchema() - Method in class com.tnsai.llm.format.ResponseFormat

Returns true if this has a schema.

hasSegments() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionResult

hasWebSearch() - Method in class com.tnsai.llm.providers.AnthropicClient

Checks if this client has web search enabled.

hasWords() - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionResult

highThreshold(double) - Method in class com.tnsai.llm.cache.CachedLLMClient.Builder

Sets the high similarity threshold for direct cache hits.

hitCount() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the hitCount record component.

hitRate() - Method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

Returns the value of the hitRate record component.

hits() - Method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

Returns the value of the hits record component.

How It Works - Search tag in class com.tnsai.llm.LLMBasedConflictResolver

Section

How It Works - Search tag in class com.tnsai.llm.cache.CachedLLMClient

Section

How It Works - Search tag in interface com.tnsai.llm.cache.SemanticCache

Section

httpStatus() - Method in record class com.tnsai.llm.observability.ErrorInfo

Returns the value of the httpStatus record component.

HuggingFaceClient - Class in com.tnsai.llm.providers

HuggingFace Inference API client using OpenAI-compatible endpoint.

HuggingFaceClient(String) - Constructor for class com.tnsai.llm.providers.HuggingFaceClient

HuggingFaceClient(String, float) - Constructor for class com.tnsai.llm.providers.HuggingFaceClient

HuggingFaceClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.HuggingFaceClient

HuggingFaceClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.HuggingFaceClient

HuggingFaceClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.HuggingFaceClient

HuggingFaceClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.HuggingFaceClient

HuggingFaceProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for HuggingFace Inference API — eleventh pilot mapper.

HuggingFaceProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.HuggingFaceProviderErrorMapper

I

id() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the id record component.

id(String) - Method in class com.tnsai.llm.cost.UsageRecord.Builder

Implementations - Search tag in interface com.tnsai.llm.cache.EmbeddingProvider

Section

includeSystemPrompt(boolean) - Method in class com.tnsai.llm.cache.InMemorySemanticCache.Builder

INFO - Enum constant in enum class com.tnsai.llm.observability.PromptLogger.LogLevel

InMemoryCostTracker - Class in com.tnsai.llm.cost

In-memory implementation of CostTracker.

InMemoryCostTracker.Builder - Class in com.tnsai.llm.cost

InMemoryLLMPricingRegistry - Class in com.tnsai.llm.observability

In-memory LLMPricingRegistry populated programmatically via InMemoryLLMPricingRegistry.Builder (issue #79).

InMemoryLLMPricingRegistry.Builder - Class in com.tnsai.llm.observability

InMemorySemanticCache - Class in com.tnsai.llm.cache

In-memory implementation of SemanticCache.

InMemorySemanticCache.Builder - Class in com.tnsai.llm.cache

Builder for InMemorySemanticCache.

inputTokens() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns the value of the inputTokens record component.

inputTokens(long) - Method in class com.tnsai.llm.cost.UsageRecord.Builder

Integration with Micrometer - Search tag in class com.tnsai.llm.observability.LLMMetrics

Section

interChunkP50() - Method in record class com.tnsai.llm.observability.StreamMetrics

Returns the value of the interChunkP50 record component.

interChunkP99() - Method in record class com.tnsai.llm.observability.StreamMetrics

Returns the value of the interChunkP99 record component.

isCacheable() - Method in class com.tnsai.llm.cache.CacheableContent

Checks if this content has cache control enabled.

isCacheSystemPromptEnabled() - Method in class com.tnsai.llm.cache.PromptCachingClient

Checks if system prompt caching is enabled.

isCacheToolsEnabled() - Method in class com.tnsai.llm.cache.PromptCachingClient

Checks if tool caching is enabled.

isCodeModel() - Method in class com.tnsai.llm.providers.ZhipuAIClient

Returns true if the current model is optimized for code.

isConfident(double) - Method in record class com.tnsai.llm.routing.TaskClassifier.ClassificationResult

Returns true if confidence is above the given threshold.

isExpired(long) - Method in record class com.tnsai.llm.cache.CacheEntry

Checks if this entry has expired.

isFailure() - Method in record class com.tnsai.llm.observability.LLMCallLog

true when this call ended in ErrorInfo.

isFineGrainedToolStreamingEnabled() - Method in class com.tnsai.llm.providers.OpenRouterClient

Whether the fine-grained tool streaming beta header will be sent (#26).

isHardLimit() - Method in class com.tnsai.llm.cost.BudgetManager

Checks if in hard limit mode.

isJson() - Method in class com.tnsai.llm.format.ResponseFormat

Returns true if this requires JSON output.

isSimple() - Method in class com.tnsai.llm.cache.CacheableContent

Checks if this is simple text content.

isStreamed() - Method in record class com.tnsai.llm.observability.LLMCallLog

true when streaming-specific metrics were recorded.

isStrict() - Method in class com.tnsai.llm.format.ResponseFormat

Returns whether strict schema validation is enabled.

isText() - Method in class com.tnsai.llm.format.ResponseFormat

Returns true if this is a text format.

isVisionModel() - Method in class com.tnsai.llm.providers.ZhipuAIClient

Returns true if the current model supports vision (images).

J

JSON - Enum constant in enum class com.tnsai.llm.audio.WhisperClient.ResponseFormat

JSON_OBJECT - Enum constant in enum class com.tnsai.llm.format.ResponseFormat.Type

Generic JSON object output.

JSON_SCHEMA - Enum constant in enum class com.tnsai.llm.format.ResponseFormat.Type

Structured output with JSON Schema validation.

JsonCapableLLMClient - Interface in com.tnsai.llm.format

Extended LLM client interface that supports native JSON mode.

JsonLLMPricingRegistry - Class in com.tnsai.llm.observability

LLMPricingRegistry that loads rates from a classpath JSON file (issue #79).

JsonModeClient - Class in com.tnsai.llm.format

LLM client wrapper that enforces JSON mode output.

JsonModeClient.Builder - Class in com.tnsai.llm.format

Builder for JsonModeClient.

JsonModeClient.JsonParseException - Exception Class in com.tnsai.llm.format

Exception thrown when JSON parsing fails.

jsonObject() - Static method in class com.tnsai.llm.format.ResponseFormat

Creates a JSON object format.

JsonParseException(String, String, Throwable) - Constructor for exception class com.tnsai.llm.format.JsonModeClient.JsonParseException

jsonSchema(String, Class<?>) - Static method in class com.tnsai.llm.format.ResponseFormat

Creates a JSON Schema format from a class.

jsonSchema(String, Map<String, Object>) - Static method in class com.tnsai.llm.format.ResponseFormat

Creates a JSON Schema format with the given schema.

jsonSchema(String, Map<String, Object>, boolean) - Static method in class com.tnsai.llm.format.ResponseFormat

Creates a JSON Schema format with optional strict mode.

K

Key Benefits - Search tag in class com.tnsai.llm.routing.TaskBasedRouter

Section

L

language(String) - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions.Builder

lastAccessedAt() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the lastAccessedAt record component.

LatencyBasedRouter - Class in com.tnsai.llm.routing

Routes LLM requests to the fastest available provider.

LatencyBasedRouter.Builder - Class in com.tnsai.llm.routing

Builder for LatencyBasedRouter.

LatencyBasedRouter.LatencyStats - Record Class in com.tnsai.llm.routing

Latency statistics.

latencyMs(long) - Method in class com.tnsai.llm.cost.UsageRecord.Builder

Latency Optimization Strategy - Search tag in class com.tnsai.llm.routing.LatencyBasedRouter

Section

LatencyStats(Map<String, Double>, String, double) - Constructor for record class com.tnsai.llm.routing.LatencyBasedRouter.LatencyStats

Creates an instance of a LatencyStats record class.

limit() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetAlert

Returns the value of the limit record component.

limit() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Returns the value of the limit record component.

limit(double) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

limit(String) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

limit(BigDecimal) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

LIMIT_EXCEEDED - Enum constant in enum class com.tnsai.llm.cost.BudgetManager.BudgetAlertType

Limitations - Search tag in class com.tnsai.llm.cache.HashEmbeddingProvider

Section

listModels() - Method in class com.tnsai.llm.providers.GeminiClient

Lists available Gemini models from the API.

listModels() - Method in class com.tnsai.llm.providers.OllamaClient

listModels() - Method in class com.tnsai.llm.providers.OpenAIClient

LlamaCppServerClient - Class in com.tnsai.llm.providers

llama.cpp server LLM client.

LlamaCppServerClient(String) - Constructor for class com.tnsai.llm.providers.LlamaCppServerClient

LlamaCppServerClient(String, float) - Constructor for class com.tnsai.llm.providers.LlamaCppServerClient

LlamaCppServerClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.LlamaCppServerClient

LlamaCppServerClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.LlamaCppServerClient

LlamaCppServerClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.LlamaCppServerClient

LlamaCppServerClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.LlamaCppServerClient

LlamaCppServerProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for llama.cpp — an OpenAI-compatible provider.

LlamaCppServerProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.LlamaCppServerProviderErrorMapper

llm(LLMClient) - Method in class com.tnsai.llm.LLMBasedConflictResolver.Builder

Sets the LLM client.

LLMBasedConflictResolver - Class in com.tnsai.llm

LLM-based desire conflict resolver.

LLMBasedConflictResolver(LLMClient) - Constructor for class com.tnsai.llm.LLMBasedConflictResolver

Creates a new LLM-based conflict resolver.

LLMBasedConflictResolver(LLMClient, String, DesireConflictResolver) - Constructor for class com.tnsai.llm.LLMBasedConflictResolver

Creates a new LLM-based conflict resolver with custom context.

LLMBasedConflictResolver.Builder - Class in com.tnsai.llm

Builder for LLMBasedConflictResolver.

LLMCallLog - Record Class in com.tnsai.llm.observability

One observed LLM call, end-to-end (issue #79).

LLMCallLog(String, Instant, Instant, Duration, String, String, String, EventContext, LLMPrompt, ToolSurface, LLMResponse, TokenUsage, CostEstimate, ChatChunk.FinishReason, Optional<StreamMetrics>, Optional<ErrorInfo>, int, Map<String, Object>) - Constructor for record class com.tnsai.llm.observability.LLMCallLog

Creates an instance of a LLMCallLog record class.

LLMCallLog.Builder - Class in com.tnsai.llm.observability

Mutable builder — collects fields as the call executes (start → response → finish), then produces the immutable record.

LLMCallPublisher - Interface in com.tnsai.llm.observability

SPI for publishing LLMCallLog events emitted by CapturingLLMClient (issue #79).

LLMChainExhaustedException - Exception Class in com.tnsai.llm.fallback

Thrown by an LLMFallbackChain when every eligible target has been tried and none succeeded (issue #89).

LLMChainExhaustedException(List<LLMChainExhaustedException.AttemptRecord>) - Constructor for exception class com.tnsai.llm.fallback.LLMChainExhaustedException

LLMChainExhaustedException.AttemptRecord - Record Class in com.tnsai.llm.fallback

One try against one chain target.

LLMClientFactory - Class in com.tnsai.llm

Factory for creating LLM clients from configuration.

LLMClientFactoryProvider - Class in com.tnsai.llm

ServiceLoader-based implementation of LLMClientProvider.

LLMClientFactoryProvider() - Constructor for class com.tnsai.llm.LLMClientFactoryProvider

LLMClientSettings - Record Class in com.tnsai.llm

Phase 1 transport / sampling extras from LLMSpec (TAN-3637).

LLMClientSettings(String, String, int, float, float) - Constructor for record class com.tnsai.llm.LLMClientSettings

Creates an instance of a LLMClientSettings record class.

LLMFallbackChain - Interface in com.tnsai.llm.fallback

An LLMClient that wraps a primary plus a list of LLMFallbackRules, transparently routing failed calls to the first matching, not-cooling-down fallback target (issue #89).

LLMFallbackChain.Builder - Class in com.tnsai.llm.fallback

Fluent configurator.

LLMFallbackRule - Record Class in com.tnsai.llm.fallback

One entry in an LLMFallbackChain: a target LLMClient to try, the FallbackCondition that gates it, and an optional cooldown window (issue #89).

LLMFallbackRule(LLMClient, FallbackCondition) - Constructor for record class com.tnsai.llm.fallback.LLMFallbackRule

LLMFallbackRule(LLMClient, FallbackCondition, Duration) - Constructor for record class com.tnsai.llm.fallback.LLMFallbackRule

LLMFallbackRule(LLMClient, FallbackCondition, Optional<Duration>) - Constructor for record class com.tnsai.llm.fallback.LLMFallbackRule

Creates an instance of a LLMFallbackRule record class.

LLMMetrics - Class in com.tnsai.llm.observability

Collects and reports metrics for LLM operations.

LLMMetrics() - Constructor for class com.tnsai.llm.observability.LLMMetrics

LLMMetrics.ProviderMetrics - Record Class in com.tnsai.llm.observability

Per-provider metrics.

LLMMetrics.Report - Record Class in com.tnsai.llm.observability

Comprehensive metrics report.

LLMObserver - Interface in com.tnsai.llm.observability

Observer interface for LLM request/response monitoring.

LLMPricingRegistry - Interface in com.tnsai.llm.observability

SPI for converting TokenUsage into a USD CostEstimate (issue #79).

LLMPrompt - Record Class in com.tnsai.llm.observability

Captured input side of an LLM call (issue #79).

LLMPrompt(List<Map<String, Object>>, Optional<String>, Map<String, Object>, LLMPrompt.PromptCacheInfo) - Constructor for record class com.tnsai.llm.observability.LLMPrompt

Creates an instance of a LLMPrompt record class.

LLMPrompt.PromptCacheInfo - Record Class in com.tnsai.llm.observability

Cache-control metadata for prompt-caching providers (Anthropic, Google).

LLMResponse - Record Class in com.tnsai.llm.observability

Captured output side of an LLM call (issue #79).

LLMResponse(String, List<LLMResponse.ToolCallRequest>, Optional<String>) - Constructor for record class com.tnsai.llm.observability.LLMResponse

Creates an instance of a LLMResponse record class.

LLMResponse.ToolCallRequest - Record Class in com.tnsai.llm.observability

One tool-call request from the LLM.

LLMRouter - Interface in com.tnsai.llm.routing

Routes LLM requests to appropriate providers based on configurable strategies.

LLMRouter.RoutingStats - Record Class in com.tnsai.llm.routing

Records for routing statistics.

LMStudioClient - Class in com.tnsai.llm.providers

LM Studio LLM client.

LMStudioClient(String) - Constructor for class com.tnsai.llm.providers.LMStudioClient

LMStudioClient(String, float) - Constructor for class com.tnsai.llm.providers.LMStudioClient

LMStudioClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.LMStudioClient

LMStudioClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.LMStudioClient

LMStudioClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.LMStudioClient

LMStudioClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.LMStudioClient

LMStudioProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for LM Studio — an OpenAI-compatible provider.

LMStudioProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.LMStudioProviderErrorMapper

Log Format - Search tag in class com.tnsai.llm.observability.PromptLogger

Section

logFullContent(boolean) - Method in class com.tnsai.llm.observability.PromptLogger.Builder

logLevel(PromptLogger.LogLevel) - Method in class com.tnsai.llm.observability.PromptLogger.Builder

lowThreshold(double) - Method in class com.tnsai.llm.cache.CachedLLMClient.Builder

Sets the low similarity threshold.

M

Manual Override - Search tag in class com.tnsai.llm.routing.TaskBasedRouter

Section

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.AbstractGoogleErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.AbstractOpenAICompatibleErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.AnthropicProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.AzureOpenAIProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.BedrockProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.CohereProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.GroqProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.HuggingFaceProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.MiniMaxProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.MistralProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.OllamaProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.OpenAIProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.OpenRouterProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in interface com.tnsai.llm.errors.ProviderErrorMapper

Translate a raw HTTP error response into a typed LLMException.

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.ReplicateProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.WatsonxProviderErrorMapper

map(int, Map<String, String>, String, String, Throwable) - Method in class com.tnsai.llm.errors.ZhipuAIProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.AbstractGoogleErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.AbstractOpenAICompatibleErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.AnthropicProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.AzureOpenAIProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.BedrockProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.CohereProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.GroqProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.HuggingFaceProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.MiniMaxProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.MistralProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.OllamaProviderErrorMapper

Heuristic mapping from Ollama's free-text error message to a framework LLMException.ErrorType.

mapErrorType(String) - Method in class com.tnsai.llm.errors.OpenAIProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.OpenRouterProviderErrorMapper

mapErrorType(String) - Method in interface com.tnsai.llm.errors.ProviderErrorMapper

Map a provider-native error code to a framework LLMException.ErrorType.

mapErrorType(String) - Method in class com.tnsai.llm.errors.ReplicateProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.WatsonxProviderErrorMapper

mapErrorType(String) - Method in class com.tnsai.llm.errors.ZhipuAIProviderErrorMapper

matches(LLMException) - Method in record class com.tnsai.llm.fallback.FallbackCondition.Always

matches(LLMException) - Method in record class com.tnsai.llm.fallback.FallbackCondition.Composite

matches(LLMException) - Method in interface com.tnsai.llm.fallback.FallbackCondition

Returns true if this condition matches the given primary failure — i.e. the framework should try the rule's fallback target.

matches(LLMException) - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnErrorType

matches(LLMException) - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnHttpStatus

matches(LLMException) - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnProviderCode

matches(String) - Method in enum class com.tnsai.llm.routing.TaskType

Checks if the given text contains keywords for this task type.

matchScore(String) - Method in enum class com.tnsai.llm.routing.TaskType

Calculates a match score for the given text.

MATH - Enum constant in enum class com.tnsai.llm.routing.TaskType

Mathematical reasoning, calculations, proofs.

maxContentLength(int) - Method in class com.tnsai.llm.observability.PromptLogger.Builder

maxEntries(int) - Method in class com.tnsai.llm.cache.InMemorySemanticCache.Builder

maxLatencyMs(long) - Method in class com.tnsai.llm.routing.LatencyBasedRouter.Builder

maxRecords(int) - Method in class com.tnsai.llm.cost.InMemoryCostTracker.Builder

maxTokens(int) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Sets the maximum number of tokens to generate.

maxTokens(Integer) - Method in class com.tnsai.llm.providers.MiniMaxClient.Builder

maxTokens(Integer) - Method in class com.tnsai.llm.providers.ZhipuAIClient.Builder

MDC (Mapped Diagnostic Context) - Search tag in class com.tnsai.llm.observability.PromptLogger

Section

messages() - Method in record class com.tnsai.llm.observability.LLMPrompt

Returns the value of the messages record component.

metadata() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the metadata record component.

metadata(Map<String, Object>) - Method in class com.tnsai.llm.cost.UsageRecord.Builder

Metrics Tracked - Search tag in package com.tnsai.llm.observability

Section

MiniMaxClient - Class in com.tnsai.llm.providers

MiniMax LLM client implementation.

MiniMaxClient(String) - Constructor for class com.tnsai.llm.providers.MiniMaxClient

MiniMaxClient(String, float) - Constructor for class com.tnsai.llm.providers.MiniMaxClient

MiniMaxClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.MiniMaxClient

MiniMaxClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.MiniMaxClient

MiniMaxClient(String, String, float, Float, Integer, String, String, boolean) - Constructor for class com.tnsai.llm.providers.MiniMaxClient

MiniMaxClient(String, String, float, Integer, String, String, boolean) - Constructor for class com.tnsai.llm.providers.MiniMaxClient

MiniMaxClient.Builder - Class in com.tnsai.llm.providers

MiniMaxProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for MiniMax — twelfth pilot mapper.

MiniMaxProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.MiniMaxProviderErrorMapper

minTokensForCaching(int) - Method in class com.tnsai.llm.cache.PromptCachingClient.Builder

misses() - Method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

Returns the value of the misses record component.

MistralClient - Class in com.tnsai.llm.providers

Mistral AI LLM client implementation.

MistralClient(String) - Constructor for class com.tnsai.llm.providers.MistralClient

MistralClient(String, float) - Constructor for class com.tnsai.llm.providers.MistralClient

MistralClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.MistralClient

MistralClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.MistralClient

MistralClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.MistralClient

MistralClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.MistralClient

MistralProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Mistral's chat completions API.

MistralProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.MistralProviderErrorMapper

model() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the model record component.

model(String) - Method in class com.tnsai.llm.audio.WhisperClient.Builder

model(String) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

model(String) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Sets the model to use.

model(String) - Method in class com.tnsai.llm.providers.MiniMaxClient.Builder

model(String) - Method in class com.tnsai.llm.providers.ZhipuAIClient.Builder

modelId(String) - Method in class com.tnsai.llm.cost.UsageRecord.Builder

ModelPricing - Class in com.tnsai.llm.cost

Model pricing information for cost calculation.

Monitoring - Search tag in class com.tnsai.llm.routing.FallbackRouter

Section

Monitoring - Search tag in package com.tnsai.llm.routing

Section

monthly() - Method in class com.tnsai.llm.cost.BudgetManager.Builder

mostCommonTask() - Method in record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Returns the most common task type.

mostExpensiveRequest() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the mostExpensiveRequest record component.

Multiple Observers - Search tag in class com.tnsai.llm.observability.ObservableLLMClient

Section

Multiple Observers - Search tag in interface com.tnsai.llm.observability.LLMObserver

Section

N

name() - Method in record class com.tnsai.llm.observability.LLMResponse.ToolCallRequest

Returns the value of the name record component.

noOp() - Static method in interface com.tnsai.llm.observability.LLMCallPublisher

Returns LLMCallPublisher.NOOP.

NOOP - Static variable in interface com.tnsai.llm.observability.LLMCallPublisher

Publisher that drops every event — the framework default.

NOOP - Static variable in interface com.tnsai.llm.observability.LLMObserver

No-op observer that does nothing.

NvidiaNIMClient - Class in com.tnsai.llm.providers

NVIDIA NIM (NVIDIA Inference Microservices) LLM client.

NvidiaNIMClient(String) - Constructor for class com.tnsai.llm.providers.NvidiaNIMClient

NvidiaNIMClient(String, float) - Constructor for class com.tnsai.llm.providers.NvidiaNIMClient

NvidiaNIMClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.NvidiaNIMClient

NvidiaNIMClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.NvidiaNIMClient

NvidiaNIMClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.NvidiaNIMClient

NvidiaNIMClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.NvidiaNIMClient

NvidiaNIMProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for NVIDIA NIM — an OpenAI-compatible provider.

NvidiaNIMProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.NvidiaNIMProviderErrorMapper

O

objectMapper(ObjectMapper) - Method in class com.tnsai.llm.format.JsonModeClient.Builder

Sets a custom ObjectMapper for JSON parsing.

ObservableLLMClient - Class in com.tnsai.llm.observability

Wrapper that adds observability to any LLMClient.

ObservableLLMClient(LLMClient, LLMObserver) - Constructor for class com.tnsai.llm.observability.ObservableLLMClient

Creates an observable client with a single observer.

ObservableLLMClient(LLMClient, LLMObserver...) - Constructor for class com.tnsai.llm.observability.ObservableLLMClient

Creates an observable client with multiple observers.

ObservableLLMClient.CompositeObserver - Class in com.tnsai.llm.observability

Composes multiple observers into one.

of(int, int) - Static method in record class com.tnsai.llm.cache.CacheUsage

Creates cache usage from read and creation token counts.

of(long, long) - Static method in record class com.tnsai.llm.observability.TokenUsage

Convenience: minimal usage with only prompt + completion.

of(LLMClient...) - Static method in class com.tnsai.llm.routing.CapabilityRouter

Creates a CapabilityRouter with the given clients.

of(LLMClient...) - Static method in class com.tnsai.llm.routing.CostBasedRouter

Creates a CostBasedRouter with the given clients.

of(LLMClient...) - Static method in class com.tnsai.llm.routing.FallbackRouter

Creates a FallbackRouter with the given clients.

of(LLMClient...) - Static method in class com.tnsai.llm.routing.LatencyBasedRouter

Creates a LatencyBasedRouter with the given clients.

of(LLMClient...) - Static method in class com.tnsai.llm.routing.RoundRobinRouter

Creates a RoundRobinRouter with the given clients.

of(LLMClient, LLMClient...) - Static method in interface com.tnsai.llm.fallback.LLMFallbackChain

Convenience: build a chain with default policy (try each in order on any LLMException, no cooldowns, no strict mode).

of(LLMObserver...) - Static method in class com.tnsai.llm.observability.ObservableLLMClient.CompositeObserver

of(String) - Static method in class com.tnsai.llm.cache.CacheableContent

Creates cacheable content from text.

of(String, CacheControl) - Static method in class com.tnsai.llm.cache.CacheableContent

Creates cacheable content from text with cache control.

of(List<LLMClient>) - Static method in class com.tnsai.llm.routing.FallbackRouter

Creates a FallbackRouter with the given clients.

of(List<LLMClient>) - Static method in class com.tnsai.llm.routing.RoundRobinRouter

Creates a RoundRobinRouter with the given clients.

of(List<String>, List<String>) - Static method in record class com.tnsai.llm.observability.ToolSurface

Build a tool surface from parallel names and schemas lists.

OK - Enum constant in enum class com.tnsai.llm.cost.BudgetManager.BudgetState

Ollama (Local) - Search tag in package com.tnsai.llm.providers

Section

OllamaClient - Class in com.tnsai.llm.providers

Ollama LLM client implementation for local and cloud deployments.

OllamaClient(String) - Constructor for class com.tnsai.llm.providers.OllamaClient

OllamaClient(String, float) - Constructor for class com.tnsai.llm.providers.OllamaClient

OllamaClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.OllamaClient

OllamaClient(String, String, float, Float, Integer, String, LLMClientSettings) - Constructor for class com.tnsai.llm.providers.OllamaClient

OllamaClient(String, String, float, Integer) - Constructor for class com.tnsai.llm.providers.OllamaClient

OllamaClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.OllamaClient

OllamaEmbeddingProvider - Class in com.tnsai.llm.cache

EmbeddingProvider backed by an Ollama server's /api/embed endpoint.

OllamaEmbeddingProvider() - Constructor for class com.tnsai.llm.cache.OllamaEmbeddingProvider

Local Ollama with nomic-embed-text, honouring OLLAMA_* env vars.

OllamaEmbeddingProvider(String) - Constructor for class com.tnsai.llm.cache.OllamaEmbeddingProvider

Local Ollama with a custom embedding model.

OllamaEmbeddingProvider(String, String, String) - Constructor for class com.tnsai.llm.cache.OllamaEmbeddingProvider

OllamaProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Ollama, the local-first LLM runtime that runs models on the host machine (http://localhost:11434 by default).

OllamaProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.OllamaProviderErrorMapper

onAlert(Consumer<BudgetManager.BudgetAlert>) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

onError(LLMClient, Exception, long) - Method in class com.tnsai.llm.observability.LLMMetrics

onError(LLMClient, Exception, long) - Method in interface com.tnsai.llm.observability.LLMObserver

Called when an error occurs.

onError(LLMClient, Exception, long) - Method in class com.tnsai.llm.observability.ObservableLLMClient.CompositeObserver

onError(LLMClient, Exception, long) - Method in class com.tnsai.llm.observability.PromptLogger

onErrorType(LLMException.ErrorType...) - Static method in interface com.tnsai.llm.fallback.FallbackCondition

OnErrorType(Set<LLMException.ErrorType>) - Constructor for record class com.tnsai.llm.fallback.FallbackCondition.OnErrorType

Creates an instance of a OnErrorType record class.

onHttpStatus(Integer...) - Static method in interface com.tnsai.llm.fallback.FallbackCondition

OnHttpStatus(Set<Integer>) - Constructor for record class com.tnsai.llm.fallback.FallbackCondition.OnHttpStatus

Creates an instance of a OnHttpStatus record class.

onLimitExceeded(Consumer<BigDecimal>) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

onProviderCode(String, String...) - Static method in interface com.tnsai.llm.fallback.FallbackCondition

OnProviderCode(String, Set<String>) - Constructor for record class com.tnsai.llm.fallback.FallbackCondition.OnProviderCode

Creates an instance of a OnProviderCode record class.

onRequest(LLMClient, String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.LLMMetrics

onRequest(LLMClient, String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in interface com.tnsai.llm.observability.LLMObserver

Called before sending a request to the LLM.

onRequest(LLMClient, String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.ObservableLLMClient.CompositeObserver

onRequest(LLMClient, String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.PromptLogger

onResponse(LLMClient, ChatResponse, long) - Method in class com.tnsai.llm.observability.LLMMetrics

onResponse(LLMClient, ChatResponse, long) - Method in interface com.tnsai.llm.observability.LLMObserver

Called after receiving a successful response.

onResponse(LLMClient, ChatResponse, long) - Method in class com.tnsai.llm.observability.ObservableLLMClient.CompositeObserver

onResponse(LLMClient, ChatResponse, long) - Method in class com.tnsai.llm.observability.PromptLogger

onStreamChunk(LLMClient, String, int) - Method in class com.tnsai.llm.observability.LLMMetrics

onStreamChunk(LLMClient, String, int) - Method in interface com.tnsai.llm.observability.LLMObserver

Called for each streaming chunk received.

onStreamChunk(LLMClient, String, int) - Method in class com.tnsai.llm.observability.ObservableLLMClient.CompositeObserver

onStreamComplete(LLMClient, int, long) - Method in class com.tnsai.llm.observability.LLMMetrics

onStreamComplete(LLMClient, int, long) - Method in interface com.tnsai.llm.observability.LLMObserver

Called when streaming completes.

onStreamComplete(LLMClient, int, long) - Method in class com.tnsai.llm.observability.ObservableLLMClient.CompositeObserver

onStreamComplete(LLMClient, int, long) - Method in class com.tnsai.llm.observability.PromptLogger

onStreamError(LLMClient, Exception, int, long) - Method in class com.tnsai.llm.observability.LLMMetrics

onStreamError(LLMClient, Exception, int, long) - Method in interface com.tnsai.llm.observability.LLMObserver

Called when streaming encounters an error.

onStreamError(LLMClient, Exception, int, long) - Method in class com.tnsai.llm.observability.ObservableLLMClient.CompositeObserver

op() - Method in record class com.tnsai.llm.fallback.FallbackCondition.Composite

Returns the value of the op record component.

OPEN - Enum constant in enum class com.tnsai.llm.resilience.CircuitBreakerClient.State

OpenAI - Search tag in package com.tnsai.llm.providers

Section

OpenAIClient - Class in com.tnsai.llm.providers

OpenAI LLM client implementation.

OpenAIClient(String) - Constructor for class com.tnsai.llm.providers.OpenAIClient

Creates an OpenAIClient with the specified model.

OpenAIClient(String, float) - Constructor for class com.tnsai.llm.providers.OpenAIClient

Creates an OpenAIClient with the specified model and temperature.

OpenAIClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.OpenAIClient

Creates an OpenAIClient with the specified model, temperature, topP, and max tokens.

OpenAIClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.OpenAIClient

Creates an OpenAIClient with the specified model, temperature, and max tokens.

OpenAIClient(String, String, float, Float, Integer, String, String) - Constructor for class com.tnsai.llm.providers.OpenAIClient

Creates an OpenAIClient with full configuration.

OpenAIClient(String, String, float, Float, Integer, String, String, LLMClientSettings) - Constructor for class com.tnsai.llm.providers.OpenAIClient

OpenAIProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for OpenAI's chat / completions / embeddings APIs.

OpenAIProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.OpenAIProviderErrorMapper

OpenRouterClient - Class in com.tnsai.llm.providers

OpenRouter LLM client implementation.

OpenRouterClient(String) - Constructor for class com.tnsai.llm.providers.OpenRouterClient

OpenRouterClient(String, float) - Constructor for class com.tnsai.llm.providers.OpenRouterClient

OpenRouterClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.OpenRouterClient

OpenRouterClient(String, float, Float, Integer, String, String, String) - Constructor for class com.tnsai.llm.providers.OpenRouterClient

OpenRouterClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.OpenRouterClient

OpenRouterClient(String, float, Integer, String, String, String) - Constructor for class com.tnsai.llm.providers.OpenRouterClient

OpenRouterProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for OpenRouter — eighth pilot mapper.

OpenRouterProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.OpenRouterProviderErrorMapper

or(FallbackCondition...) - Static method in interface com.tnsai.llm.fallback.FallbackCondition

OR - Enum constant in enum class com.tnsai.llm.fallback.FallbackCondition.Composite.LogicalOp

originalPrompt() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the originalPrompt record component.

outputTokens() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns the value of the outputTokens record component.

outputTokens(long) - Method in class com.tnsai.llm.cost.UsageRecord.Builder

P

p50LatencyMs() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the p50LatencyMs record component.

p95LatencyMs() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the p95LatencyMs record component.

p99LatencyMs() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the p99LatencyMs record component.

parameters() - Method in record class com.tnsai.llm.observability.LLMPrompt

Returns the value of the parameters record component.

parseResponse(String, Class<T>) - Method in class com.tnsai.llm.format.JsonModeClient

Parses a JSON response to the specified type.

period(Duration) - Method in class com.tnsai.llm.cost.BudgetManager.Builder

PERIOD_RESET - Enum constant in enum class com.tnsai.llm.cost.BudgetManager.BudgetAlertType

periodStart() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Returns the value of the periodStart record component.

PerplexityClient - Class in com.tnsai.llm.providers

Perplexity LLM client.

PerplexityClient(String) - Constructor for class com.tnsai.llm.providers.PerplexityClient

PerplexityClient(String, float) - Constructor for class com.tnsai.llm.providers.PerplexityClient

PerplexityClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.PerplexityClient

PerplexityClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.PerplexityClient

PerplexityClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.PerplexityClient

PerplexityClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.PerplexityClient

PerplexityProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Perplexity — an OpenAI-compatible provider.

PerplexityProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.PerplexityProviderErrorMapper

Per-Provider Metrics - Search tag in class com.tnsai.llm.observability.LLMMetrics

Section

PII Filtering - Search tag in class com.tnsai.llm.observability.PromptLogger

Section

PII Filtering - Search tag in package com.tnsai.llm.observability

Section

presencePenalty() - Method in record class com.tnsai.llm.LLMClientSettings

Returns the value of the presencePenalty record component.

pricingTableVersion() - Method in record class com.tnsai.llm.observability.CostEstimate

Returns the value of the pricingTableVersion record component.

Pricing Units - Search tag in class com.tnsai.llm.cost.ModelPricing

Section

primary() - Method in interface com.tnsai.llm.fallback.LLMFallbackChain

The chain's primary target — tried first on every call.

primary(LLMClient) - Method in class com.tnsai.llm.fallback.LLMFallbackChain.Builder

Programmatic Usage - Search tag in class com.tnsai.llm.LLMClientFactory

Section

prompt() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the prompt record component.

prompt(LLMPrompt) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

prompt(String) - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions.Builder

prompt(String) - Method in class com.tnsai.llm.audio.WhisperClient.TranslationOptions.Builder

PromptCacheInfo(boolean, List<String>) - Constructor for record class com.tnsai.llm.observability.LLMPrompt.PromptCacheInfo

Creates an instance of a PromptCacheInfo record class.

PromptCachingClient - Class in com.tnsai.llm.cache

LLMClient wrapper that adds prompt caching support.

PromptCachingClient.Builder - Class in com.tnsai.llm.cache

promptHash() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the promptHash record component.

PromptLogger - Class in com.tnsai.llm.observability

Logs LLM prompts and responses with PII filtering support.

PromptLogger.Builder - Class in com.tnsai.llm.observability

Builder for PromptLogger.

PromptLogger.LogLevel - Enum Class in com.tnsai.llm.observability

promptTokens() - Method in record class com.tnsai.llm.observability.TokenUsage

Returns the value of the promptTokens record component.

promptUSD() - Method in record class com.tnsai.llm.observability.CostEstimate

Returns the value of the promptUSD record component.

provider() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnProviderCode

Returns the value of the provider record component.

provider() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the provider record component.

provider(String) - Method in class com.tnsai.llm.cost.UsageRecord.Builder

provider(String) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

providerErrorCode() - Method in record class com.tnsai.llm.observability.ErrorInfo

Returns the value of the providerErrorCode record component.

ProviderErrorMapper - Interface in com.tnsai.llm.errors

Provider-specific translation from a raw HTTP error response to a typed LLMException with attached ProviderDetails.

ProviderErrorMappers - Class in com.tnsai.llm.errors

Static lookup facade for ProviderErrorMappers registered via ServiceLoader.

providerExtensions() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the providerExtensions record component.

providerExtensions(Map<String, Object>) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

providerId() - Method in class com.tnsai.llm.errors.AbstractGoogleErrorMapper

providerId() - Method in class com.tnsai.llm.errors.AbstractOpenAICompatibleErrorMapper

providerId() - Method in class com.tnsai.llm.errors.AnthropicProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.AzureOpenAIProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.BedrockProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.CohereProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.GroqProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.HuggingFaceProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.MiniMaxProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.MistralProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.OllamaProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.OpenAIProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.OpenRouterProviderErrorMapper

providerId() - Method in interface com.tnsai.llm.errors.ProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.ReplicateProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.WatsonxProviderErrorMapper

providerId() - Method in class com.tnsai.llm.errors.ZhipuAIProviderErrorMapper

ProviderMetrics(long, long, long, long, long, double, double, long) - Constructor for record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Creates an instance of a ProviderMetrics record class.

providerModel() - Method in record class com.tnsai.llm.observability.LLMCallLog

Stable identifier of the (provider, model) pair — useful as a Prometheus label and as a dashboard group key.

Provider Selection Guide - Search tag in package com.tnsai.llm.providers

Section

Provider Support - Search tag in class com.tnsai.llm.format.ResponseFormat

Section

publish(LLMCallLog) - Method in interface com.tnsai.llm.observability.LLMCallPublisher

Publish one captured LLM call.

publish(LLMCallLog) - Method in class com.tnsai.llm.observability.Slf4jLLMCallPublisher

put(String, String) - Method in class com.tnsai.llm.cache.InMemorySemanticCache

put(String, String) - Method in interface com.tnsai.llm.cache.SemanticCache

Stores a prompt-response pair in the cache.

put(String, String, double, double, double, Double) - Method in class com.tnsai.llm.observability.InMemoryLLMPricingRegistry.Builder

Register rates for one (provider, model) pair, in USD per 1K tokens.

put(String, Optional<String>, String) - Method in class com.tnsai.llm.cache.InMemorySemanticCache

put(String, Optional<String>, String) - Method in interface com.tnsai.llm.cache.SemanticCache

Stores a prompt-response pair with system prompt.

puts() - Method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

Returns the value of the puts record component.

Q

QUERY - Enum constant in enum class com.tnsai.llm.cache.EmbeddingTask

Asymmetric retrieval: a search query, matched against EmbeddingTask.DOCUMENT vectors.

Quick Start - Search tag in class com.tnsai.llm.format.JsonModeClient

Section

Quick Start - Search tag in class com.tnsai.llm.format.ResponseFormat

Section

Quick Start - Search tag in package com.tnsai.llm.observability

Section

Quick Start - Search tag in package com.tnsai.llm.routing

Section

QwenCloudClient - Class in com.tnsai.llm.providers

Alibaba Qwen Cloud (DashScope) LLM client.

QwenCloudClient(String) - Constructor for class com.tnsai.llm.providers.QwenCloudClient

QwenCloudClient(String, float) - Constructor for class com.tnsai.llm.providers.QwenCloudClient

QwenCloudClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.QwenCloudClient

QwenCloudClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.QwenCloudClient

QwenCloudClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.QwenCloudClient

QwenCloudClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.QwenCloudClient

QwenCloudProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for DashScope — an OpenAI-compatible provider.

QwenCloudProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.QwenCloudProviderErrorMapper

R

1. Raw-string com.tnsai.llm.observability.LLMObserver (legacy / lightweight) - Search tag in package com.tnsai.llm.observability

Section

Rate Limit Avoidance - Search tag in class com.tnsai.llm.routing.RoundRobinRouter

Section

reason() - Method in record class com.tnsai.llm.routing.TaskClassifier.ClassificationResult

Returns the value of the reason record component.

REASONING - Enum constant in enum class com.tnsai.llm.routing.TaskType

Tasks requiring deep reasoning and thinking.

reasoningContent() - Method in record class com.tnsai.llm.observability.LLMResponse

Returns the value of the reasoningContent record component.

reasoningSplit(boolean) - Method in class com.tnsai.llm.providers.MiniMaxClient.Builder

Enables reasoning split mode for M2 models.

reasoningTokens() - Method in record class com.tnsai.llm.observability.TokenUsage

Returns the value of the reasoningTokens record component.

reasoningUSD() - Method in record class com.tnsai.llm.observability.CostEstimate

Returns the value of the reasoningUSD record component.

record(UsageRecord) - Method in interface com.tnsai.llm.cost.CostTracker

Records a usage record.

record(UsageRecord) - Method in class com.tnsai.llm.cost.InMemoryCostTracker

recordCount() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the recordCount record component.

recordSpend(BigDecimal) - Method in class com.tnsai.llm.cost.BudgetManager

Records a spend and triggers alerts if thresholds crossed.

recoveryTimeout() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the value of the recoveryTimeout record component.

recoveryTimeout(Duration) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient.Builder

registerPricing(String, String, BigDecimal, BigDecimal) - Static method in class com.tnsai.llm.cost.ModelPricing

Registers custom pricing for a model.

rejectedCount() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the value of the rejectedCount record component.

reload() - Static method in class com.tnsai.llm.errors.ProviderErrorMappers

Force a re-scan of the SPI.

remaining() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetAlert

Returns the value of the remaining record component.

remaining() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Returns the value of the remaining record component.

remainingTime() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Returns the value of the remainingTime record component.

remove(String) - Method in class com.tnsai.llm.cache.InMemorySemanticCache

remove(String) - Method in interface com.tnsai.llm.cache.SemanticCache

Removes an entry from the cache.

ReplicateClient - Class in com.tnsai.llm.providers

Replicate LLM client.

ReplicateClient(String) - Constructor for class com.tnsai.llm.providers.ReplicateClient

ReplicateClient(String, float) - Constructor for class com.tnsai.llm.providers.ReplicateClient

ReplicateClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.ReplicateClient

ReplicateClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.ReplicateClient

ReplicateClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.ReplicateClient

ReplicateClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.ReplicateClient

ReplicateProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Replicate.

ReplicateProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.ReplicateProviderErrorMapper

Report(long, long, long, long, long, double, double, double, double, double, Instant) - Constructor for record class com.tnsai.llm.observability.LLMMetrics.Report

Creates an instance of a Report record class.

requests() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns the value of the requests record component.

requestsPerProvider() - Method in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Returns the value of the requestsPerProvider record component.

requestsPerTask() - Method in record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Returns the value of the requestsPerTask record component.

requireCapability(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.CostBasedRouter.Builder

requireCapability(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.FallbackRouter.Builder

Sets a capability filter - only clients matching this filter will be used.

requireCapability(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.LatencyBasedRouter.Builder

requireFunctionCalling() - Method in class com.tnsai.llm.routing.CapabilityRouter.Builder

requireFunctionCalling() - Method in class com.tnsai.llm.routing.CostBasedRouter.Builder

requireFunctionCalling() - Method in class com.tnsai.llm.routing.FallbackRouter.Builder

Requires function calling capability.

requireFunctionCalling() - Method in class com.tnsai.llm.routing.LatencyBasedRouter.Builder

requireStructuredOutput() - Method in class com.tnsai.llm.routing.CapabilityRouter.Builder

requireVision() - Method in class com.tnsai.llm.routing.CapabilityRouter.Builder

requireVision() - Method in class com.tnsai.llm.routing.CostBasedRouter.Builder

requireVision() - Method in class com.tnsai.llm.routing.FallbackRouter.Builder

Requires vision capability.

requireVision() - Method in class com.tnsai.llm.routing.LatencyBasedRouter.Builder

reset() - Method in class com.tnsai.llm.cost.BudgetManager

Manually resets the budget period.

reset() - Method in class com.tnsai.llm.observability.LLMMetrics

Resets all metrics.

reset() - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

Manually resets the circuit breaker to CLOSED state.

resetStats() - Method in class com.tnsai.llm.cache.InMemorySemanticCache

resetStats() - Method in class com.tnsai.llm.cache.PromptCachingClient

Resets statistics.

resetStats() - Method in interface com.tnsai.llm.cache.SemanticCache

Resets cache statistics.

resetStats() - Method in class com.tnsai.llm.routing.CapabilityRouter

resetStats() - Method in class com.tnsai.llm.routing.CostBasedRouter

resetStats() - Method in class com.tnsai.llm.routing.FallbackRouter

resetStats() - Method in class com.tnsai.llm.routing.LatencyBasedRouter

resetStats() - Method in interface com.tnsai.llm.routing.LLMRouter

Resets routing statistics.

resetStats() - Method in class com.tnsai.llm.routing.RoundRobinRouter

resetStats() - Method in class com.tnsai.llm.routing.TaskBasedRouter

resolve(List<Desire>) - Method in class com.tnsai.llm.LLMBasedConflictResolver

response() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the response record component.

response() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the response record component.

response(LLMResponse) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

responseFormat(WhisperClient.ResponseFormat) - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions.Builder

responseFormat(WhisperClient.ResponseFormat) - Method in class com.tnsai.llm.audio.WhisperClient.TranslationOptions.Builder

responseFormat(ResponseFormat) - Method in class com.tnsai.llm.format.JsonModeClient.Builder

Sets the response format.

ResponseFormat - Class in com.tnsai.llm.format

Represents the desired output format for LLM responses.

ResponseFormat.Type - Enum Class in com.tnsai.llm.format

Response format type.

responses() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns the value of the responses record component.

retryable() - Method in record class com.tnsai.llm.observability.ErrorInfo

Returns the value of the retryable record component.

retryAttempt() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the retryAttempt record component.

retryAttempt(int) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

RoundRobinRouter - Class in com.tnsai.llm.routing

Routes LLM requests using round-robin load distribution.

RoundRobinRouter.Builder - Class in com.tnsai.llm.routing

Builder for RoundRobinRouter.

routingStats() - Method in record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Returns the value of the routingStats record component.

RoutingStats(long, long, long, Map<String, Long>, Map<String, Long>, Map<String, Double>) - Constructor for record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Creates an instance of a RoutingStats record class.

Routing Strategies - Search tag in interface com.tnsai.llm.routing.LLMRouter

Section

rules() - Method in interface com.tnsai.llm.fallback.LLMFallbackChain

Ordered list of fallback rules.

S

schemaFromClass(String, Class<?>) - Method in class com.tnsai.llm.format.JsonModeClient.Builder

Creates a JSON Schema format from the given class.

SchemaGenerator - Class in com.tnsai.llm.format

Generates JSON Schema from Java classes using reflection.

selectByCapability(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.CapabilityRouter

selectByCapability(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.CostBasedRouter

selectByCapability(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.FallbackRouter

selectByCapability(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.LatencyBasedRouter

selectByCapability(Predicate<LLMCapabilities>) - Method in interface com.tnsai.llm.routing.LLMRouter

Selects a client that matches the given capability predicate.

selectByCapability(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.RoundRobinRouter

selectByCapability(Predicate<LLMCapabilities>) - Method in class com.tnsai.llm.routing.TaskBasedRouter

selectStructuredOutputCapable() - Method in class com.tnsai.llm.routing.CapabilityRouter

Selects the best client for structured output (JSON mode).

selectToolCapable() - Method in class com.tnsai.llm.routing.CapabilityRouter

Selects the best client for tool/function calling.

selectVisionCapable() - Method in class com.tnsai.llm.routing.CapabilityRouter

Selects the best client for vision tasks.

selectWithMinContext(int) - Method in class com.tnsai.llm.routing.CapabilityRouter

Selects a client with minimum context window size.

SemanticCache - Interface in com.tnsai.llm.cache

Semantic cache for LLM responses based on prompt similarity.

SemanticCache.CacheStats - Record Class in com.tnsai.llm.cache

Cache statistics.

SemanticCache.SimilarityResult - Record Class in com.tnsai.llm.cache

Result of a similarity search.

setDefaultType(TaskType) - Method in class com.tnsai.llm.routing.TaskClassifier.Builder

Sets the default task type when classification confidence is too low.

setFineGrainedToolStreaming(boolean) - Method in class com.tnsai.llm.providers.OpenRouterClient

Explicit override for the auto-detected fine-grained tool streaming flag (#26).

setMinConfidenceThreshold(double) - Method in class com.tnsai.llm.routing.TaskClassifier.Builder

Sets the minimum confidence threshold.

similarity() - Method in record class com.tnsai.llm.cache.SemanticCache.SimilarityResult

Returns the value of the similarity record component.

SimilarityResult(CacheEntry, double) - Constructor for record class com.tnsai.llm.cache.SemanticCache.SimilarityResult

Creates an instance of a SimilarityResult record class.

size() - Method in class com.tnsai.llm.cache.InMemorySemanticCache

size() - Method in interface com.tnsai.llm.cache.SemanticCache

Returns the current number of entries.

Slf4jLLMCallPublisher - Class in com.tnsai.llm.observability

Default LLMCallPublisher that emits one structured SLF4J line per LLM call (issue #79).

Slf4jLLMCallPublisher() - Constructor for class com.tnsai.llm.observability.Slf4jLLMCallPublisher

softLimit() - Method in class com.tnsai.llm.cost.BudgetManager.Builder

SRT - Enum constant in enum class com.tnsai.llm.audio.WhisperClient.ResponseFormat

startedAt() - Method in record class com.tnsai.llm.fallback.LLMChainExhaustedException.AttemptRecord

Returns the value of the startedAt record component.

startedAt() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the startedAt record component.

startedAt(Instant) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

state() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Returns the value of the state record component.

state() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the value of the state record component.

States - Search tag in class com.tnsai.llm.resilience.CircuitBreakerClient

Section

stateTransitions() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the value of the stateTransitions record component.

State Transitions - Search tag in class com.tnsai.llm.resilience.CircuitBreakerClient

Section

statuses() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnHttpStatus

Returns the value of the statuses record component.

Status routing - Search tag in class com.tnsai.llm.errors.BedrockProviderErrorMapper

Section

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cache.CachedLLMClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cache.PromptCachingClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cost.CostAwareLLMClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.format.JsonModeClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.CapturingLLMClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.ObservableLLMClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.AbstractOpenAICompatibleClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.AnthropicClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.AzureOpenAIClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.BedrockClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.CohereClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.GeminiClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.MiniMaxClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.OllamaClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.OpenAIClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.ReplicateClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.VertexAIClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.WatsonxClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.ZhipuAIClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.CapabilityRouter

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.CostBasedRouter

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.FallbackRouter

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.LatencyBasedRouter

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.RoundRobinRouter

streamChat(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.TaskBasedRouter

streamChat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cost.CostAwareLLMClient

streamChat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.providers.GeminiClient

streamChat(List<ContentPart>, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

streamChatWithHandler(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>, Consumer<ChatChunk>) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cache.CachedLLMClient

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cache.PromptCachingClient

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.cost.CostAwareLLMClient

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.observability.ObservableLLMClient

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.resilience.CircuitBreakerClient

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.CapabilityRouter

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.CostBasedRouter

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.FallbackRouter

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.LatencyBasedRouter

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.RoundRobinRouter

streamChatWithSpec(String, Optional<String>, Optional<List<Map<String, Object>>>, Optional<List<Map<String, Object>>>) - Method in class com.tnsai.llm.routing.TaskBasedRouter

streamChunks() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns the value of the streamChunks record component.

streamMetrics() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the streamMetrics record component.

streamMetrics(StreamMetrics) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

StreamMetrics - Record Class in com.tnsai.llm.observability

Streaming-specific timing metrics for one LLM call (issue #79).

StreamMetrics(Instant, Duration, long, Duration, Duration) - Constructor for record class com.tnsai.llm.observability.StreamMetrics

Creates an instance of a StreamMetrics record class.

strictMode() - Method in interface com.tnsai.llm.fallback.LLMFallbackChain

When true, fallbacks are disabled — the primary's failure propagates unchanged.

strictMode(boolean) - Method in class com.tnsai.llm.fallback.LLMFallbackChain.Builder

Strict mode - Search tag in interface com.tnsai.llm.fallback.LLMFallbackChain

Section

successCount() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the value of the successCount record component.

successfulRequests() - Method in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Returns the value of the successfulRequests record component.

successRate() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

successRate() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

successRate() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the success rate as a percentage (0.0 to 100.0).

Supported models - Search tag in class com.tnsai.llm.providers.VertexAIClient

Section

Supported Providers - Search tag in class com.tnsai.llm.LLMClientFactory

Section

Supported Providers - Search tag in class com.tnsai.llm.cost.ModelPricing

Section

supportsCachedPricing() - Method in class com.tnsai.llm.cost.ModelPricing

supportsExtendedContext() - Method in class com.tnsai.llm.providers.MiniMaxClient

Returns true if the current model supports extended context (1M tokens).

supportsFormat(ResponseFormat) - Method in interface com.tnsai.llm.format.JsonCapableLLMClient

Checks if this client supports the given response format.

supportsFormat(ResponseFormat) - Method in class com.tnsai.llm.providers.MiniMaxClient

supportsFormat(ResponseFormat) - Method in class com.tnsai.llm.providers.OpenAIClient

supportsFormat(ResponseFormat) - Method in class com.tnsai.llm.providers.ZhipuAIClient

supportsNativeJsonMode() - Method in class com.tnsai.llm.format.JsonModeClient

Checks if the underlying provider supports native JSON mode.

supportsReasoningSplit() - Method in class com.tnsai.llm.providers.MiniMaxClient

Returns true if the current model supports reasoning split mode.

surfaceHash() - Method in record class com.tnsai.llm.observability.ToolSurface

Returns the value of the surfaceHash record component.

Symmetric vs asymmetric - Search tag in enum class com.tnsai.llm.cache.EmbeddingTask

Section

systemPrompt() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns the value of the systemPrompt record component.

systemPrompt() - Method in record class com.tnsai.llm.observability.LLMPrompt

Returns the value of the systemPrompt record component.

T

2. Typed com.tnsai.llm.observability.LLMCallLog channel (issue #79) - Search tag in package com.tnsai.llm.observability

Section

tableVersion() - Method in class com.tnsai.llm.observability.InMemoryLLMPricingRegistry

tableVersion() - Method in class com.tnsai.llm.observability.JsonLLMPricingRegistry

tableVersion() - Method in interface com.tnsai.llm.observability.LLMPricingRegistry

Stable version identifier of the pricing data — a date string, a content hash, whatever survives "what was the rate when this call was billed?"

target() - Method in record class com.tnsai.llm.fallback.LLMFallbackRule

Returns the value of the target record component.

targetLabel() - Method in record class com.tnsai.llm.fallback.LLMChainExhaustedException.AttemptRecord

Returns the value of the targetLabel record component.

TaskBasedRouter - Class in com.tnsai.llm.routing

Routes LLM requests to the most appropriate model based on task type.

TaskBasedRouter.Builder - Class in com.tnsai.llm.routing

Builder for TaskBasedRouter.

TaskBasedRouter.TaskRoutingStats - Record Class in com.tnsai.llm.routing

Task routing statistics.

TaskClassifier - Class in com.tnsai.llm.routing

Classifies user prompts into task types for intelligent model routing.

TaskClassifier.Builder - Class in com.tnsai.llm.routing

Builder for TaskClassifier.

TaskClassifier.ClassificationResult - Record Class in com.tnsai.llm.routing

Classification result with confidence score.

taskDistribution() - Method in record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Returns the task distribution as percentages.

Task-instruction prefixes (nomic) - Search tag in class com.tnsai.llm.cache.OllamaEmbeddingProvider

Section

TaskRoutingStats(Map<TaskType, Long>, Map<TaskType, Long>, double, LLMRouter.RoutingStats) - Constructor for record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Creates an instance of a TaskRoutingStats record class.

taskType() - Method in record class com.tnsai.llm.routing.TaskClassifier.ClassificationResult

Returns the value of the taskType record component.

TaskType - Enum Class in com.tnsai.llm.routing

Defines task types for intelligent model routing.

temperature(float) - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions.Builder

temperature(float) - Method in class com.tnsai.llm.audio.WhisperClient.TranslationOptions.Builder

temperature(float) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Sets the temperature for response generation.

temperature(float) - Method in class com.tnsai.llm.providers.MiniMaxClient.Builder

temperature(float) - Method in class com.tnsai.llm.providers.ZhipuAIClient.Builder

TencentHunyuanClient - Class in com.tnsai.llm.providers

Tencent Hunyuan LLM client.

TencentHunyuanClient(String) - Constructor for class com.tnsai.llm.providers.TencentHunyuanClient

TencentHunyuanClient(String, float) - Constructor for class com.tnsai.llm.providers.TencentHunyuanClient

TencentHunyuanClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.TencentHunyuanClient

TencentHunyuanClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.TencentHunyuanClient

TencentHunyuanClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.TencentHunyuanClient

TencentHunyuanClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.TencentHunyuanClient

TencentHunyuanProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Hunyuan — an OpenAI-compatible provider.

TencentHunyuanProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.TencentHunyuanProviderErrorMapper

text() - Static method in class com.tnsai.llm.format.ResponseFormat

Creates a text format (default).

TEXT - Enum constant in enum class com.tnsai.llm.audio.WhisperClient.ResponseFormat

TEXT - Enum constant in enum class com.tnsai.llm.format.ResponseFormat.Type

Default text output with no special formatting.

textOnly(String) - Static method in class com.tnsai.llm.audio.WhisperClient.TranscriptionResult

textOnly(String) - Static method in record class com.tnsai.llm.observability.LLMResponse

Convenience: pure-text response (no tool calls, no reasoning).

threshold() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetAlert

Returns the value of the threshold record component.

THRESHOLD_REACHED - Enum constant in enum class com.tnsai.llm.cost.BudgetManager.BudgetAlertType

Thresholds - Search tag in class com.tnsai.llm.cache.CachedLLMClient

Section

timeoutMs() - Method in record class com.tnsai.llm.LLMClientSettings

Returns the value of the timeoutMs record component.

timeSpan() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the timeSpan record component.

timestamp() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the timestamp record component.

timestamp(Instant) - Method in class com.tnsai.llm.cost.UsageRecord.Builder

timestampGranularities(List<String>) - Method in class com.tnsai.llm.audio.WhisperClient.TranscriptionOptions.Builder

timeToFirstToken() - Method in record class com.tnsai.llm.observability.StreamMetrics

Returns the value of the timeToFirstToken record component.

toApiFormat() - Method in class com.tnsai.llm.cache.CacheableContent.ContentBlock

toApiFormat() - Method in class com.tnsai.llm.cache.CacheableContent

Converts to Anthropic API format.

toGeminiFormat() - Method in class com.tnsai.llm.format.ResponseFormat

Converts this format to Gemini API format.

TogetherAIClient - Class in com.tnsai.llm.providers

Together.ai LLM client.

TogetherAIClient(String) - Constructor for class com.tnsai.llm.providers.TogetherAIClient

TogetherAIClient(String, float) - Constructor for class com.tnsai.llm.providers.TogetherAIClient

TogetherAIClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.TogetherAIClient

TogetherAIClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.TogetherAIClient

TogetherAIClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.TogetherAIClient

TogetherAIClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.TogetherAIClient

TogetherAIProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Together.ai — an OpenAI-compatible provider.

TogetherAIProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.TogetherAIProviderErrorMapper

tokensPerTask() - Method in record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Returns the value of the tokensPerTask record component.

Token Types - Search tag in record class com.tnsai.llm.cache.CacheUsage

Section

TokenUsage - Record Class in com.tnsai.llm.observability

Token-count breakdown for one LLM call (issue #79).

TokenUsage(long, long, long, long, long) - Constructor for record class com.tnsai.llm.observability.TokenUsage

Creates an instance of a TokenUsage record class.

TOOL_TYPE_CODE_EXECUTION - Static variable in class com.tnsai.llm.providers.AnthropicClient

Tool type for code execution (programmatic tool calling)

TOOL_TYPE_SEARCH_REGEX - Static variable in class com.tnsai.llm.providers.AnthropicClient

Tool type for regex-based tool search

TOOL_TYPE_WEB_SEARCH - Static variable in class com.tnsai.llm.providers.AnthropicClient

Tool type for web search

ToolCallRequest(String, Map<String, Object>, Optional<String>) - Constructor for record class com.tnsai.llm.observability.LLMResponse.ToolCallRequest

Creates an instance of a ToolCallRequest record class.

toolCalls() - Method in record class com.tnsai.llm.observability.LLMResponse

Returns the value of the toolCalls record component.

toOllamaFormat() - Method in class com.tnsai.llm.format.ResponseFormat

Converts this format to Ollama API format.

toolNames() - Method in record class com.tnsai.llm.observability.ToolSurface

Returns the value of the toolNames record component.

tools() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the tools record component.

tools(ToolSurface) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

toolSchemas() - Method in record class com.tnsai.llm.observability.ToolSurface

Returns the value of the toolSchemas record component.

ToolSurface - Record Class in com.tnsai.llm.observability

Snapshot of the tool set advertised to the LLM on one call (issue #79).

ToolSurface(List<String>, List<String>, String) - Constructor for record class com.tnsai.llm.observability.ToolSurface

Creates an instance of a ToolSurface record class.

ToolSurfaceHasher - Class in com.tnsai.llm.observability

Single canonical entry point for building a ToolSurface from the raw List<Map<String,Object>> tool shape every framework caller passes around (issue #79).

toOpenAIFormat() - Method in class com.tnsai.llm.format.ResponseFormat

Converts this format to OpenAI API format.

topP(float) - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Sets the top-p (nucleus sampling) value.

topP(Float) - Method in class com.tnsai.llm.providers.MiniMaxClient.Builder

topP(Float) - Method in class com.tnsai.llm.providers.ZhipuAIClient.Builder

toString() - Method in class com.tnsai.llm.cache.CacheControl

toString() - Method in record class com.tnsai.llm.cache.CacheEntry

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.cache.CacheUsage

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.cache.SemanticCache.CacheStats

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.cache.SemanticCache.SimilarityResult

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetAlert

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns a string representation of this record class.

toString() - Method in class com.tnsai.llm.cost.ModelPricing

toString() - Method in class com.tnsai.llm.cost.UsageRecord

toString() - Method in record class com.tnsai.llm.fallback.FallbackCondition.Always

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.fallback.FallbackCondition.Composite

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnErrorType

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnHttpStatus

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnProviderCode

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.fallback.LLMChainExhaustedException.AttemptRecord

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.fallback.LLMFallbackRule

Returns a string representation of this record class.

toString() - Method in class com.tnsai.llm.format.ResponseFormat

toString() - Method in record class com.tnsai.llm.LLMClientSettings

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.CostEstimate

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.ErrorInfo

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.LLMMetrics.ProviderMetrics

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.LLMPrompt.PromptCacheInfo

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.LLMPrompt

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.LLMResponse.ToolCallRequest

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.LLMResponse

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.StreamMetrics

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.TokenUsage

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.observability.ToolSurface

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.routing.CostBasedRouter.CostStats

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.routing.LatencyBasedRouter.LatencyStats

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.routing.TaskBasedRouter.TaskRoutingStats

Returns a string representation of this record class.

toString() - Method in record class com.tnsai.llm.routing.TaskClassifier.ClassificationResult

Returns a string representation of this record class.

totalCachedTokens() - Method in record class com.tnsai.llm.cache.CacheUsage

Gets total cached tokens (read + creation).

totalCachedTokens() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the totalCachedTokens record component.

totalCost() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the totalCost record component.

totalErrors() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the totalErrors record component.

totalEstimatedCost() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the totalEstimatedCost record component.

totalEstimatedCost() - Method in record class com.tnsai.llm.routing.CostBasedRouter.CostStats

Returns the value of the totalEstimatedCost record component.

totalInputCost() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the totalInputCost record component.

totalInputTokens() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the totalInputTokens record component.

totalInputTokens() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the totalInputTokens record component.

totalInputTokens() - Method in record class com.tnsai.llm.routing.CostBasedRouter.CostStats

Returns the value of the totalInputTokens record component.

totalOutputCost() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the totalOutputCost record component.

totalOutputTokens() - Method in record class com.tnsai.llm.cost.CostTracker.CostStatistics

Returns the value of the totalOutputTokens record component.

totalOutputTokens() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the totalOutputTokens record component.

totalOutputTokens() - Method in record class com.tnsai.llm.routing.CostBasedRouter.CostStats

Returns the value of the totalOutputTokens record component.

totalRequests() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the totalRequests record component.

totalRequests() - Method in record class com.tnsai.llm.resilience.CircuitBreakerClient.CircuitBreakerMetrics

Returns the value of the totalRequests record component.

totalRequests() - Method in record class com.tnsai.llm.routing.LLMRouter.RoutingStats

Returns the value of the totalRequests record component.

totalResponses() - Method in record class com.tnsai.llm.observability.LLMMetrics.Report

Returns the value of the totalResponses record component.

totalTokens() - Method in record class com.tnsai.llm.observability.TokenUsage

Returns the value of the totalTokens record component.

totalUSD() - Method in record class com.tnsai.llm.observability.CostEstimate

Returns the value of the totalUSD record component.

transcribe(AudioPart) - Method in class com.tnsai.llm.audio.WhisperClient

Transcribes audio with default options.

transcribe(AudioPart, WhisperClient.TranscriptionOptions) - Method in class com.tnsai.llm.audio.WhisperClient

Transcribes audio with custom options.

transcribe(File) - Method in class com.tnsai.llm.audio.WhisperClient

Transcribes audio from a file.

TranscriptionResult(String, String, Double, List<Map<String, Object>>, List<Map<String, Object>>) - Constructor for class com.tnsai.llm.audio.WhisperClient.TranscriptionResult

translate(AudioPart, WhisperClient.TranslationOptions) - Method in class com.tnsai.llm.audio.WhisperClient

Translates audio to English with custom options.

translate(File) - Method in class com.tnsai.llm.audio.WhisperClient

Translates audio to English.

TRANSLATION - Enum constant in enum class com.tnsai.llm.routing.TaskType

Language translation between languages.

trySpend(BigDecimal) - Method in class com.tnsai.llm.cost.BudgetManager

Atomically checks budget and records spend in one operation.

ttlSeconds(long) - Method in class com.tnsai.llm.cache.InMemorySemanticCache.Builder

Two parallel observation channels - Search tag in package com.tnsai.llm.observability

Section

type() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetAlert

Returns the value of the type record component.

types() - Method in record class com.tnsai.llm.fallback.FallbackCondition.OnErrorType

Returns the value of the types record component.

U

UNLIMITED - Enum constant in enum class com.tnsai.llm.cost.BudgetManager.BudgetState

usage() - Method in record class com.tnsai.llm.observability.LLMCallLog

Returns the value of the usage record component.

usage(TokenUsage) - Method in class com.tnsai.llm.observability.LLMCallLog.Builder

Usage - Search tag in class com.tnsai.llm.providers.AbstractLLMClient

Section

Usage - Search tag in class com.tnsai.llm.resilience.CircuitBreakerClient

Section

Usage - Search tag in com.tnsai.llm.LLMClientFactory.fromAnnotation(Class<?>)

Section

Usage - Search tag in interface com.tnsai.llm.format.JsonCapableLLMClient

Section

Usage Example - Search tag in class com.tnsai.llm.LLMBasedConflictResolver

Section

Usage Example - Search tag in class com.tnsai.llm.cache.CacheControl

Section

Usage Example - Search tag in class com.tnsai.llm.cache.CachedLLMClient

Section

Usage Example - Search tag in class com.tnsai.llm.cache.InMemorySemanticCache

Section

Usage Example - Search tag in class com.tnsai.llm.cache.PromptCachingClient

Section

Usage Example - Search tag in class com.tnsai.llm.cost.BudgetManager

Section

Usage Example - Search tag in class com.tnsai.llm.cost.CostAwareLLMClient

Section

Usage Example - Search tag in class com.tnsai.llm.cost.InMemoryCostTracker

Section

Usage Example - Search tag in class com.tnsai.llm.cost.ModelPricing

Section

Usage Example - Search tag in class com.tnsai.llm.cost.UsageRecord

Section

Usage Example - Search tag in class com.tnsai.llm.observability.LLMMetrics

Section

Usage Example - Search tag in class com.tnsai.llm.observability.ObservableLLMClient

Section

Usage Example - Search tag in class com.tnsai.llm.observability.PromptLogger

Section

Usage Example - Search tag in class com.tnsai.llm.routing.CapabilityRouter

Section

Usage Example - Search tag in class com.tnsai.llm.routing.CostBasedRouter

Section

Usage Example - Search tag in class com.tnsai.llm.routing.FallbackRouter

Section

Usage Example - Search tag in class com.tnsai.llm.routing.LatencyBasedRouter

Section

Usage Example - Search tag in class com.tnsai.llm.routing.RoundRobinRouter

Section

Usage Example - Search tag in class com.tnsai.llm.routing.TaskBasedRouter

Section

Usage Example - Search tag in class com.tnsai.llm.routing.TaskClassifier

Section

Usage Example - Search tag in interface com.tnsai.llm.cache.SemanticCache

Section

Usage Example - Search tag in interface com.tnsai.llm.cost.CostTracker

Section

Usage Example - Search tag in interface com.tnsai.llm.observability.LLMObserver

Section

Usage Example - Search tag in interface com.tnsai.llm.routing.LLMRouter

Section

Usage Examples - Search tag in class com.tnsai.llm.cache.CacheableContent

Section

Usage Examples - Search tag in package com.tnsai.llm.providers

Section

usagePercent() - Method in record class com.tnsai.llm.cost.BudgetManager.BudgetStatus

Returns the value of the usagePercent record component.

UsageRecord - Class in com.tnsai.llm.cost

Record of a single LLM API call usage.

UsageRecord.Builder - Class in com.tnsai.llm.cost

Usage with @LLMSpec Annotation - Search tag in class com.tnsai.llm.LLMClientFactory

Section

Usage with TaskBasedRouter - Search tag in enum class com.tnsai.llm.routing.TaskType

Section

V

v1 scope (this client) - Search tag in class com.tnsai.llm.providers.ReplicateClient

Section

valueOf(String) - Static method in enum class com.tnsai.llm.audio.WhisperClient.ResponseFormat

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.cache.CacheControl.Type

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.cache.EmbeddingTask

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.cost.BudgetManager.BudgetAlertType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.cost.BudgetManager.BudgetState

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.fallback.FallbackCondition.Composite.LogicalOp

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.format.ResponseFormat.Type

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.observability.PromptLogger.LogLevel

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.providers.AzureOpenAIClient.AuthType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.resilience.CircuitBreakerClient.State

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.tnsai.llm.routing.TaskType

Returns the enum constant of this class with the specified name.

values() - Static method in enum class com.tnsai.llm.audio.WhisperClient.ResponseFormat

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.cache.CacheControl.Type

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.cache.EmbeddingTask

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.cost.BudgetManager.BudgetAlertType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.cost.BudgetManager.BudgetState

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.fallback.FallbackCondition.Composite.LogicalOp

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.format.ResponseFormat.Type

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.observability.PromptLogger.LogLevel

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.providers.AzureOpenAIClient.AuthType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.resilience.CircuitBreakerClient.State

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.tnsai.llm.routing.TaskType

Returns an array containing the constants of this enum class, in the order they are declared.

VERBOSE_JSON - Enum constant in enum class com.tnsai.llm.audio.WhisperClient.ResponseFormat

VertexAIClient - Class in com.tnsai.llm.providers

Google Cloud Vertex AI LLM client (enterprise Gemini).

VertexAIClient(String) - Constructor for class com.tnsai.llm.providers.VertexAIClient

VertexAIClient(String, float) - Constructor for class com.tnsai.llm.providers.VertexAIClient

VertexAIClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.VertexAIClient

VertexAIClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.VertexAIClient

VertexAIClient(String, String, float, Float, Integer, String, String, String) - Constructor for class com.tnsai.llm.providers.VertexAIClient

VertexAIProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Google Cloud Vertex AI.

VertexAIProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.VertexAIProviderErrorMapper

VISION - Enum constant in enum class com.tnsai.llm.routing.TaskType

Image understanding and visual tasks.

VLLMClient - Class in com.tnsai.llm.providers

vLLM LLM client.

VLLMClient(String) - Constructor for class com.tnsai.llm.providers.VLLMClient

VLLMClient(String, float) - Constructor for class com.tnsai.llm.providers.VLLMClient

VLLMClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.VLLMClient

VLLMClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.VLLMClient

VLLMClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.VLLMClient

VLLMClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.VLLMClient

VLLMProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for vLLM — an OpenAI-compatible provider.

VLLMProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.VLLMProviderErrorMapper

VTT - Enum constant in enum class com.tnsai.llm.audio.WhisperClient.ResponseFormat

W

warmCache(Map<String, String>) - Method in class com.tnsai.llm.cache.CachedLLMClient

Warms the cache with common prompts and responses.

WARN - Enum constant in enum class com.tnsai.llm.observability.PromptLogger.LogLevel

WARNING - Enum constant in enum class com.tnsai.llm.cost.BudgetManager.BudgetState

WatsonxClient - Class in com.tnsai.llm.providers

IBM watsonx.ai LLM client.

WatsonxClient(String) - Constructor for class com.tnsai.llm.providers.WatsonxClient

WatsonxClient(String, float) - Constructor for class com.tnsai.llm.providers.WatsonxClient

WatsonxClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.WatsonxClient

WatsonxClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.WatsonxClient

WatsonxClient(String, String, float, Float, Integer, String, String) - Constructor for class com.tnsai.llm.providers.WatsonxClient

WatsonxProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for IBM watsonx.ai.

WatsonxProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.WatsonxProviderErrorMapper

WhisperClient - Class in com.tnsai.llm.audio

OpenAI Whisper client for audio transcription and translation.

WhisperClient() - Constructor for class com.tnsai.llm.audio.WhisperClient

Creates a WhisperClient with default settings.

WhisperClient(String) - Constructor for class com.tnsai.llm.audio.WhisperClient

Creates a WhisperClient with the specified model.

WhisperClient(String, String, String) - Constructor for class com.tnsai.llm.audio.WhisperClient

Creates a WhisperClient with full configuration.

WhisperClient.Builder - Class in com.tnsai.llm.audio

WhisperClient.ResponseFormat - Enum Class in com.tnsai.llm.audio

Response format for transcription/translation.

WhisperClient.TranscriptionOptions - Class in com.tnsai.llm.audio

Transcription options.

WhisperClient.TranscriptionOptions.Builder - Class in com.tnsai.llm.audio

WhisperClient.TranscriptionResult - Class in com.tnsai.llm.audio

Transcription result with optional metadata.

WhisperClient.TranslationOptions - Class in com.tnsai.llm.audio

Translation options.

WhisperClient.TranslationOptions.Builder - Class in com.tnsai.llm.audio

Why an SPI - Search tag in interface com.tnsai.llm.errors.ProviderErrorMapper

Section

Why this exists alongside LLMObserver - Search tag in interface com.tnsai.llm.observability.LLMCallPublisher

Section

withAccess() - Method in record class com.tnsai.llm.cache.CacheEntry

Creates a copy with updated access time and hit count.

withAdvancedToolUse() - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Enables advanced tool use features (tool search, programmatic calling).

withApiKey(String, String, String) - Static method in class com.tnsai.llm.providers.AzureOpenAIClient

Creates an AzureOpenAIClient with API key authentication.

withApiKey(String, String, String, String, float, Integer) - Static method in class com.tnsai.llm.providers.AzureOpenAIClient

Creates an AzureOpenAIClient with API key authentication and custom settings.

withAzureAD(String, String, String) - Static method in class com.tnsai.llm.providers.AzureOpenAIClient

Creates an AzureOpenAIClient with Azure AD (Entra ID) authentication.

withAzureAD(String, String, String, String, float, Integer) - Static method in class com.tnsai.llm.providers.AzureOpenAIClient

Creates an AzureOpenAIClient with Azure AD authentication and custom settings.

withCache(SemanticCache) - Method in class com.tnsai.llm.cache.CachedLLMClient.Builder

Sets the semantic cache to use.

With Capability Filter - Search tag in class com.tnsai.llm.routing.CostBasedRouter

Section

With Capability Filter - Search tag in class com.tnsai.llm.routing.FallbackRouter

Section

withCommonSetup(LLMClient, LLMClient, LLMClient, LLMClient) - Method in class com.tnsai.llm.routing.TaskBasedRouter.Builder

Convenience method to set up common task mappings.

withComputerUse() - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Enables computer use capabilities.

With Fallback - Search tag in class com.tnsai.llm.routing.TaskBasedRouter

Section

With JSON Schema - Search tag in class com.tnsai.llm.format.JsonModeClient

Section

With Latency Threshold - Search tag in class com.tnsai.llm.routing.LatencyBasedRouter

Section

withoutFiltering() - Static method in class com.tnsai.llm.observability.PromptLogger

Creates a logger without PII filtering.

withPIIFiltering() - Static method in class com.tnsai.llm.observability.PromptLogger

Creates a default logger with PII filtering enabled.

withPromptCaching() - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Enables prompt caching for reduced latency and ~75% lower input-token cost on repeated prompts (issue #27).

withSpec(String, Object) - Method in record class com.tnsai.llm.cache.CacheEntry

Creates a copy with additional metadata.

withWebSearch() - Method in class com.tnsai.llm.providers.AnthropicClient.Builder

Enables web search capability.

wrap(LLMClient) - Static method in class com.tnsai.llm.cache.CachedLLMClient

Creates a builder to wrap the given LLM client.

wrap(LLMClient) - Static method in class com.tnsai.llm.cost.CostAwareLLMClient

Wraps a client with default cost tracking.

wrap(LLMClient) - Static method in class com.tnsai.llm.format.JsonModeClient

Creates a simple JSON mode wrapper with default settings.

wrap(LLMClient) - Static method in class com.tnsai.llm.resilience.CircuitBreakerClient

Wraps a client with default circuit breaker settings (5 failures, 30s recovery).

wrap(LLMClient, BudgetManager) - Static method in class com.tnsai.llm.cost.CostAwareLLMClient

Wraps a client with cost tracking and budget.

wrap(LLMClient, ResponseFormat) - Static method in class com.tnsai.llm.format.JsonModeClient

Creates a JSON mode wrapper with the specified format.

X

XAIGrokClient - Class in com.tnsai.llm.providers

xAI Grok LLM client.

XAIGrokClient(String) - Constructor for class com.tnsai.llm.providers.XAIGrokClient

XAIGrokClient(String, float) - Constructor for class com.tnsai.llm.providers.XAIGrokClient

XAIGrokClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.XAIGrokClient

XAIGrokClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.XAIGrokClient

XAIGrokClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.XAIGrokClient

XAIGrokClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.XAIGrokClient

XAIGrokProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for xAI Grok — an OpenAI-compatible provider.

XAIGrokProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.XAIGrokProviderErrorMapper

Y

YiClient - Class in com.tnsai.llm.providers

01.AI Yi LLM client.

YiClient(String) - Constructor for class com.tnsai.llm.providers.YiClient

YiClient(String, float) - Constructor for class com.tnsai.llm.providers.YiClient

YiClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.YiClient

YiClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.YiClient

YiClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.YiClient

YiClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.YiClient

YiProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for Yi — an OpenAI-compatible provider.

YiProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.YiProviderErrorMapper

Z

zero() - Static method in record class com.tnsai.llm.observability.TokenUsage

Convenience: zero usage — placeholder for failed calls.

zero(String) - Static method in record class com.tnsai.llm.observability.CostEstimate

Convenience: zero-cost estimate — useful for failed calls or local models.

ZhipuAIClient - Class in com.tnsai.llm.providers

ZhipuAI (Z.AI/Zhipu) LLM client implementation.

ZhipuAIClient(String) - Constructor for class com.tnsai.llm.providers.ZhipuAIClient

ZhipuAIClient(String, float) - Constructor for class com.tnsai.llm.providers.ZhipuAIClient

ZhipuAIClient(String, float, Float, Integer) - Constructor for class com.tnsai.llm.providers.ZhipuAIClient

ZhipuAIClient(String, float, Integer) - Constructor for class com.tnsai.llm.providers.ZhipuAIClient

ZhipuAIClient(String, String, float, Float, Integer, String) - Constructor for class com.tnsai.llm.providers.ZhipuAIClient

ZhipuAIClient(String, String, float, Integer, String) - Constructor for class com.tnsai.llm.providers.ZhipuAIClient

ZhipuAIClient.Builder - Class in com.tnsai.llm.providers

ZhipuAIProviderErrorMapper - Class in com.tnsai.llm.errors

ProviderErrorMapper for ZhipuAI (Z.AI / GLM) — thirteenth and final pilot mapper for the original SPI matrix.

ZhipuAIProviderErrorMapper() - Constructor for class com.tnsai.llm.errors.ZhipuAIProviderErrorMapper

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form