requestLLMStreaming
fun requestLLMStreaming(message: String, structureDefinition: ERROR CLASS: Symbol not found for StructureDefinition??, executorService: ExecutorService? = null): Flow.Publisher<ERROR CLASS: Symbol not found for StreamFrame>(source)
Sends a request to the Language Learning Model (LLM) for streaming data.
Return
A Publisher that emits StreamFrame objects representing the streamed response from the LLM.
Parameters
message
The message or query to be sent to the LLM for processing.
structureDefinition
An optional parameter specifying the structured data definition for parsing or validating the response.
executorService
An optional executor service to be used for managing coroutine execution. Defaults to null, which will use the default executor service.