LLMStreamingFrameReceivedHandler

A functional interface for handling stream frames as they are received during the streaming process. The implementation of this interface provides a mechanism to perform real-time processing of streaming content, such as aggregation, transformation, or monitoring.

Functions

Link copied to clipboard
abstract suspend fun handle(eventContext: LLMStreamingFrameReceivedContext)

Handles individual stream frames as they are sent out during the streaming process.