Package com.tnsai.memory.strategy

Class TokenBudget.Builder

java.lang.Object
com.tnsai.memory.strategy.TokenBudget.Builder
Enclosing class:
TokenBudget
public static class TokenBudget.Builder extends Object
Builder for TokenBudget.

  • Constructor Details

    • Builder

      public Builder()

  • Method Details

    • totalContextWindow

      public TokenBudget.Builder totalContextWindow(int tokens)
      Sets the total context window size. Default: 8192

    • systemPromptReserve

      public TokenBudget.Builder systemPromptReserve(int tokens)
      Sets tokens reserved for system prompt. Default: 500

    • currentMessageEstimate

      public TokenBudget.Builder currentMessageEstimate(int tokens)
      Sets estimated tokens for current user message. Default: 500

    • toolDefinitionEstimate

      public TokenBudget.Builder toolDefinitionEstimate(int tokens)
      Sets estimated tokens for tool definitions. Default: 0

    • responseReserve

      public TokenBudget.Builder responseReserve(int tokens)
      Sets tokens reserved for LLM response. Default: 2000

    • preserveSystemPrompt

      public TokenBudget.Builder preserveSystemPrompt(boolean preserve)
      Whether to preserve system prompts when pruning. Default: true

    • preserveLastUserMessage

      public TokenBudget.Builder preserveLastUserMessage(boolean preserve)
      Whether to preserve the last user message when pruning. Default: true

    • minMessagesToKeep

      public TokenBudget.Builder minMessagesToKeep(int min)
      Minimum number of messages to keep. Default: 2

    • build

      public TokenBudget build()