1005 B
1005 B
- Added first-class RTVI support for the UI Agent Protocol:
- Adds
ui-event,ui-snapshot, andui-cancel-taskclient-to-server messages, plusui-commandandui-taskserver-to-client messages, with paired*Data/*Messagepydantic models. - Adds built-in command payload models for
Toast,Navigate,ScrollTo,Highlight,Focus,Click,SetInputValue, andSelectText; matching default handlers live in@pipecat-ai/client-react. - Adds
RTVIProcessor.on_ui_messagefor inboundui-event,ui-snapshot, andui-cancel-taskmessages. - Adds five UI pipeline frames, mirroring the
client-messageframe-and-event pattern: downstream code pushesRTVIUICommandFrame/RTVIUITaskFramefor the observer to wrap into outboundUICommandMessage/UITaskMessageenvelopes, while the processor pushes inboundRTVIUIEventFrame,RTVIUISnapshotFrame, andRTVIUICancelTaskFramealongsideon_ui_message. - Bumps the RTVI
PROTOCOL_VERSIONfrom1.2.0to1.3.0.
- Adds