Package com.tnsai.agents.streaming

Class AgentStreamingSupport

java.lang.Object

com.tnsai.agents.streaming.AgentStreamingSupport

public class AgentStreamingSupport
extends Object

Handles streaming and event-based chat operations for an Agent.

This class extracts streaming/event concerns from the Agent class:

• Stream-based chat (streamChat)
• Event-based chat with callbacks (chatWithEvents)
• LLM invocation with progress events
• Tool call execution with events

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static interface	AgentStreamingSupport.StreamingContext	Context interface for accessing Agent internals needed for streaming.

Constructor Summary

Constructors

Constructor	Description
AgentStreamingSupport(AgentStreamingSupport.StreamingContext context)

Method Summary

Modifier and Type	Method	Description
String	chatWithEvents(String message, String sessionId)	Chat with events using session-based publisher.
String	chatWithEvents(String message, Consumer<TnsAIEvent> eventConsumer)	Chat with event callbacks for AG-UI integration.
String	chatWithEvents(String message, Consumer<TnsAIEvent> eventConsumer, ChatRetrievalContext retrievalContext)
Stream<String>	streamChat(String message)	Streams the LLM response token by token.
String	streamChatWithTools(String message, String requestSystemPrompt, Consumer<ChatChunk> handler)
String	streamChatWithTools(String message, String requestSystemPrompt, Consumer<ChatChunk> handler, ChatRetrievalContext retrievalContext)
String	streamChatWithTools(String message, Consumer<ChatChunk> handler)	Streams a response with full tool calling support via ChatChunk callbacks.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AgentStreamingSupport

public AgentStreamingSupport(AgentStreamingSupport.StreamingContext context)

Method Details

streamChat

public Stream<String> streamChat(String message)

Streams the LLM response token by token.

chatWithEvents

public String chatWithEvents(String message,
 Consumer<TnsAIEvent> eventConsumer)

Chat with event callbacks for AG-UI integration.

chatWithEvents

public String chatWithEvents(String message,
 Consumer<TnsAIEvent> eventConsumer,
 ChatRetrievalContext retrievalContext)

chatWithEvents

public String chatWithEvents(String message,
 String sessionId)

Chat with events using session-based publisher.

streamChatWithTools

public String streamChatWithTools(String message,
 Consumer<ChatChunk> handler)

Streams a response with full tool calling support via ChatChunk callbacks.

Combines streaming text output with tool execution in a multi-turn loop:

1. Stream LLM response via LLMClient.streamChatWithHandler(com.tnsai.llm.ChatRequest, java.util.function.Consumer<com.tnsai.llm.ChatChunk>)
2. If tool calls are received, execute them and emit TOOL_CALL chunks
3. Send tool results back to LLM and repeat until final text response

Parameters:

message - the user message

handler - callback receiving ChatChunk events

Returns:

the complete response string

streamChatWithTools

public String streamChatWithTools(String message,
 String requestSystemPrompt,
 Consumer<ChatChunk> handler)

streamChatWithTools

public String streamChatWithTools(String message,
 String requestSystemPrompt,
 Consumer<ChatChunk> handler,
 ChatRetrievalContext retrievalContext)