pipecat/changelog/4425.added.md at 1bb0dc1d4f58ac4ebd3a0afd897534c81f84cb34

Files

Paul Kompfner 7d3726a74b feat: support new async-tool mechanism in AWS Nova Sonic

Add support to AWSNovaSonicLLMService for the new "async tool call"
mechanism activated by `cancel_on_interruption=False`, which includes:

- delivering results asynchronously
- delivering result streams
- cancelling running async tools

Note that the introduction of the new mechanism had actually caused a
regression in AWS Nova Sonic, which previously supported
`cancel_on_interruption=False` with the old mechanism (simply avoiding
discarding tool calls on interruptions).

Support for the other major realtime services (`GeminiLiveLLMService`,
`OpenAIRealtimeLLMService`) will follow in a separate PR — Gemini Live
in particular needs more work before it can support long-running tool
calls reliably.

2026-05-06 11:36:15 -04:00

374 B

Raw Blame History

Added support to AWSNovaSonicLLMService for the new "async tool call" mechanism activated by cancel_on_interruption=False, which includes delivering results asynchronously, delivering result streams, and cancelling running async tools. Support for the other major realtime services (GeminiLiveLLMService, OpenAIRealtimeLLMService) will be added in a follow-up PR.

374 B Raw Blame History

374 B

Raw Blame History