Uses of Class
com.tnsai.llm.routing.LatencyBasedRouter.Builder
Packages that use LatencyBasedRouter.Builder
-
Uses of LatencyBasedRouter.Builder in com.tnsai.llm.routing
Methods in com.tnsai.llm.routing that return LatencyBasedRouter.BuilderModifier and TypeMethodDescriptionLatencyBasedRouter.Builder.addClient(com.tnsai.llm.LLMClient client) static LatencyBasedRouter.BuilderLatencyBasedRouter.builder()Returns a builder for configuring the router.LatencyBasedRouter.Builder.maxLatencyMs(long maxLatencyMs) LatencyBasedRouter.Builder.requireCapability(Predicate<com.tnsai.llm.LLMCapabilities> filter) LatencyBasedRouter.Builder.requireFunctionCalling()LatencyBasedRouter.Builder.requireVision()