requestLLMStreaming

Streams the result of a request to a language model.

Return

a flow of StreamingFrame objects that streams the responses from the language model.

Parameters

definition

an optional parameter to define a structured data format. When provided, it will be used in constructing the prompt for the language model request.