Package com.tnsai.llm.cache

Class PromptCachingClient.Builder

java.lang.Object

com.tnsai.llm.cache.PromptCachingClient.Builder

Enclosing class:

PromptCachingClient

public static class PromptCachingClient.Builder
extends Object

Constructor Summary

Constructors

Constructor	Description
Builder()

Method Summary

Modifier and Type	Method	Description
PromptCachingClient	build()
PromptCachingClient.Builder	cacheHistoryBreakpoints(int breakpoints)	Sets the requested number of history breakpoints.
PromptCachingClient.Builder	cacheSystemPrompt(boolean enabled)
PromptCachingClient.Builder	cacheTools(boolean enabled)
PromptCachingClient.Builder	client(com.tnsai.llm.LLMClient client)
PromptCachingClient.Builder	minTokensForCaching(int tokens)

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

Builder

public Builder()

Method Details

client

public PromptCachingClient.Builder client(com.tnsai.llm.LLMClient client)

cacheSystemPrompt

public PromptCachingClient.Builder cacheSystemPrompt(boolean enabled)

cacheTools

public PromptCachingClient.Builder cacheTools(boolean enabled)

cacheHistoryBreakpoints

public PromptCachingClient.Builder cacheHistoryBreakpoints(int breakpoints)

Sets the requested number of history breakpoints. The effective number per request is lower when tool caching also claims a marker: history + tool markers together never exceed Anthropic's 4-breakpoint limit (TAN-5922).

minTokensForCaching

public PromptCachingClient.Builder minTokensForCaching(int tokens)

build

public PromptCachingClient build()