diff --git a/changelog/4230.added.md b/changelog/4230.added.md new file mode 100644 index 000000000..0d7d1f124 --- /dev/null +++ b/changelog/4230.added.md @@ -0,0 +1 @@ +- Added support for streaming intermediate results from async function calls. Call `result_callback` multiple times with `properties=FunctionCallResultProperties(is_final=False)` to push incremental updates, then call it once more (with `is_final=True`, the default) to deliver the final result. Only valid for functions registered with `cancel_on_interruption=False`. diff --git a/changelog/4230.fixed.md b/changelog/4230.fixed.md new file mode 100644 index 000000000..3fc505224 --- /dev/null +++ b/changelog/4230.fixed.md @@ -0,0 +1 @@ +- Fixed duplicate LLM replies that could occur when multiple async function call results arrived while an LLM request was already queued.