Uses of Class
com.tnsai.llm.cache.CachedLLMClient.Builder

Packages that use CachedLLMClient.Builder

Package	Description
com.tnsai.llm.cache	LLM response caching with semantic similarity and prompt caching support.

Uses of CachedLLMClient.Builder in com.tnsai.llm.cache

Methods in com.tnsai.llm.cache that return CachedLLMClient.Builder

Modifier and Type	Method	Description
CachedLLMClient.Builder	CachedLLMClient.Builder.cacheStreaming(boolean cache)	Whether to cache streaming responses.
CachedLLMClient.Builder	CachedLLMClient.Builder.highThreshold(double threshold)	Sets the high similarity threshold for direct cache hits.
CachedLLMClient.Builder	CachedLLMClient.Builder.lowThreshold(double threshold)	Sets the low similarity threshold.
CachedLLMClient.Builder	CachedLLMClient.Builder.withCache(SemanticCache cache)	Sets the semantic cache to use.
static CachedLLMClient.Builder	CachedLLMClient.wrap(com.tnsai.llm.LLMClient client)	Creates a builder to wrap the given LLM client.