pipecat/changelog/3806.changed.2.md at 5c2ca0ce64d41f096bcfb7569dbda6480da31c13

Files

Mark Backman 907ff58d41 Align Ultravox Realtime service with OpenAI/Gemini patterns

- Add InterruptionFrame handling with stop_all_metrics()
- Add processing metrics (start/stop) at response boundaries
- Fix agent transcript handling for voice and text modalities:
  - Voice mode: push LLMTextFrame (append_to_context=False) and
    TTSTextFrame for deltas, skip duplicated final text
  - Text mode: push LLMTextFrame with proper response lifecycle,
    no TTSTextFrame (downstream TTS handles audio)
- Add output_medium parameter to AgentInputParams and OneShotInputParams
- Improve TTFB measurement using VAD speech end time
- Update example with user turn strategies and transcript events
- Add text-only output example (50a-ultravox-realtime-text.py)

2026-02-26 10:44:36 -05:00

121 B

Raw Blame History

Improved Ultravox TTFB measurement accuracy by using VAD speech end time instead of UserStoppedSpeakingFrame timing.

121 B Raw Blame History

121 B

Raw Blame History