Package com.tnsai.llm.routing
Class TaskBasedRouter.Builder
java.lang.Object
com.tnsai.llm.routing.TaskBasedRouter.Builder
- Enclosing class:
TaskBasedRouter
Builder for TaskBasedRouter.
-
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionbuild()classifier(TaskClassifier classifier) Uses a custom TaskClassifier.confidenceThreshold(double threshold) Sets the minimum confidence threshold for task classification.defaultClient(com.tnsai.llm.LLMClient client) Sets the default client for unmatched or low-confidence tasks.Assigns a client for a specific task type.withCommonSetup(com.tnsai.llm.LLMClient coding, com.tnsai.llm.LLMClient reasoning, com.tnsai.llm.LLMClient fast, com.tnsai.llm.LLMClient general) Convenience method to set up common task mappings.
-
Constructor Details
-
Builder
public Builder()
-
-
Method Details
-
forTask
Assigns a client for a specific task type. -
defaultClient
Sets the default client for unmatched or low-confidence tasks. -
classifier
Uses a custom TaskClassifier. -
confidenceThreshold
Sets the minimum confidence threshold for task classification. Below this threshold, default client is used. -
withCommonSetup
public TaskBasedRouter.Builder withCommonSetup(com.tnsai.llm.LLMClient coding, com.tnsai.llm.LLMClient reasoning, com.tnsai.llm.LLMClient fast, com.tnsai.llm.LLMClient general) Convenience method to set up common task mappings.- Parameters:
coding- Client for coding tasksreasoning- Client for math/reasoning tasksfast- Client for simple/fast tasksgeneral- Default client
-
build
-