Uses of Class
com.tnsai.llm.cache.PromptCachingClient.Builder
Packages that use PromptCachingClient.Builder
Package
Description
LLM response caching with semantic similarity and prompt caching support.
-
Uses of PromptCachingClient.Builder in com.tnsai.llm.cache
Methods in com.tnsai.llm.cache that return PromptCachingClient.BuilderModifier and TypeMethodDescriptionstatic PromptCachingClient.BuilderPromptCachingClient.builder()PromptCachingClient.Builder.cacheHistoryBreakpoints(int breakpoints) Sets the requested number of history breakpoints.PromptCachingClient.Builder.cacheSystemPrompt(boolean enabled) PromptCachingClient.Builder.cacheTools(boolean enabled) PromptCachingClient.Builder.client(com.tnsai.llm.LLMClient client) PromptCachingClient.Builder.minTokensForCaching(int tokens)