Package-level declarations
Types
Represents the context for handling an after-stream event. This context is provided when streaming is complete.
Represents a functional interface for handling operations or logic that should occur after streaming from a large language model (LLM) is complete. The implementation of this interface provides a mechanism to perform custom logic or processing based on the provided inputs, such as the prompt, tools, model, and the completion of the stream.
Represents the context for handling streaming-specific events within the framework.
A handler responsible for managing the streaming flow of Large Language Model (LLM) responses. It allows customization of logic to be executed before streaming starts, during streaming frames, and after streaming completes.
Represents the context for handling an error event during streaming. This context is provided when an error occurs during streaming.
A functional interface for handling streaming errors. The implementation of this interface provides a mechanism to perform error handling or logging based on the provided error message and run ID.
Represents the context for handling individual stream frame events. This context is provided when stream frames are sent out during the streaming process.
A functional interface for handling stream frames as they are received during the streaming process. The implementation of this interface provides a mechanism to perform real-time processing of streaming content, such as aggregation, transformation, or monitoring.
Represents the context for handling a before-stream event. This context is provided when streaming is about to begin.
A functional interface implemented to handle logic that occurs before streaming from a large language model (LLM) begins. It allows preprocessing steps or validation based on the provided prompt, available tools, targeted LLM model, and a unique run identifier.