requestLLMStreaming

fun requestLLMStreaming(executorService: ExecutorService? = null): Flow.Publisher<ERROR CLASS: Symbol not found for StreamFrame>(source)

Sends a request to the language model and returns a streaming response as a Flow of StreamFrame.

Note: the returned Flow must be collected from a coroutine context by the caller.

Return

a flow of streaming frames from the language model

Parameters

executorService

an optional executor service used to start the streaming coroutine; if null, the default dispatcher is used