requestLLMStreaming
suspend fun AIAgentFunctionalContext.requestLLMStreaming(message: String, structureDefinition: StructureDefinition? = null): Flow<StreamFrame>(source)
Sends a message to a Large Language Model (LLM) and streams the LLM response. The message becomes part of the current prompt, and the LLM's response is streamed as it's generated.
Return
A flow of StreamFrame objects from the LLM response.
Parameters
message
The content of the message to be sent to the LLM.
structureDefinition
Optional structure to guide the LLM response.