Uses of Package
com.tnsai.llm.routing
Packages that use com.tnsai.llm.routing
-
Classes in com.tnsai.llm.routing used by com.tnsai.llm.routingClassDescriptionRoutes LLM requests based on required capabilities.Builder for CapabilityRouter.Routes LLM requests to the cheapest viable provider.Builder for CostBasedRouter.Cost statistics.LLM router with automatic fallback on failure.Builder for FallbackRouter.Routes LLM requests to the fastest available provider.Builder for LatencyBasedRouter.Latency statistics.Routes LLM requests to appropriate providers based on configurable strategies.Records for routing statistics.Routes LLM requests using round-robin load distribution.Builder for RoundRobinRouter.Routes LLM requests to the most appropriate model based on task type.Builder for TaskBasedRouter.Task routing statistics.Classifies user prompts into task types for intelligent model routing.Builder for TaskClassifier.Classification result with confidence score.Defines task types for intelligent model routing.