Files
pipecat/changelog
Mark Backman f1f5a986e8 Add UIWorker
UIWorker is an LLMContextWorker that observes and drives a client GUI over the
RTVI UI channel: it stores accessibility snapshots, auto-injects <ui_state> at
the start of each respond job, dispatches client events to @on_ui_event
handlers, sends UI commands back to the client, and surfaces fan-out work as
cancellable task cards via user_job_group(). The optional ReplyToolMixin exposes
a bundled reply tool.

The prompt_guide parameter auto-appends the UI wire-format guide to the LLM's
system instruction (default UI_STATE_PROMPT_GUIDE; override with a string or
disable with None), so the LLM can parse the injected <ui_state> / <ui_event>
messages without the app concatenating the guide by hand.
2026-05-21 23:20:40 -04:00
..
2026-05-18 14:40:56 +02:00
2026-05-20 17:57:43 -04:00
2026-05-20 17:57:43 -04:00
2026-05-20 17:57:43 -04:00
2026-05-19 18:33:58 -04:00
2026-05-19 17:31:07 -04:00
2026-05-20 09:08:47 -04:00
2026-05-20 12:18:03 -04:00
2026-05-21 23:20:40 -04:00