Uses of Package
com.tnsai.llm.cache

Packages that use com.tnsai.llm.cache

Package	Description
com.tnsai.llm.cache	LLM response caching with semantic similarity and prompt caching support.

Classes in com.tnsai.llm.cache used by com.tnsai.llm.cache

Class	Description
CacheableContent	Wrapper for content that can be cached.
CacheableContent.Builder
CacheableContent.ContentBlock	A content block with optional cache control.
CacheControl	Cache control configuration for prompt caching.
CacheControl.Type	Cache control type.
CachedLLMClient	LLM client wrapper that adds semantic caching capabilities.
CachedLLMClient.Builder	Builder for CachedLLMClient.
CacheEntry	Represents a cached LLM response entry.
CacheUsage	Cache usage statistics from an LLM response.
EmbeddingProvider	Provides embeddings for text to enable semantic similarity search.
EmbeddingTask	The task an embedding is generated for.
InMemorySemanticCache	In-memory implementation of SemanticCache.
InMemorySemanticCache.Builder	Builder for InMemorySemanticCache.
PromptCachingClient	LLMClient wrapper that adds prompt caching support.
PromptCachingClient.Builder
SemanticCache	Semantic cache for LLM responses based on prompt similarity.
SemanticCache.CacheStats	Cache statistics.
SemanticCache.SimilarityResult	Result of a similarity search.