requestLLMStreaming

suspend fun requestLLMStreaming(definition: StructuredDataDefinition? = null): Flow<String>(source)

Streams the result of a request to a language model.

Return

a flow of strings that streams the responses from the language model.

Parameters

definition

an optional parameter to define a structured data format. When provided, it will be used in constructing the prompt for the language model request.