Filipi Fuchter
11d0c3d46d
Refactoring SmallWebRTCRequestHandler.
2025-09-15 09:58:44 -03:00
Mark Backman
c873798ce5
fix: push BotStartedSpeakingFrame in HeyGenVideoService
2025-09-14 08:12:44 -04:00
Filipi Fuchter
95f72f6dce
Creating SmallWebRTCRequestHandler for managing peer connections.
2025-09-12 18:15:24 -03:00
Aleix Conchillo Flaqué
1b2a5df017
Merge pull request #2622 from pipecat-ai/mb/call-data-runner
...
Add to, from phone info and custom data to the development runner
2025-09-12 10:28:17 -07:00
Mark Backman
2f496ac74f
Add optional body parameter to WebsocketRunnerArguments
2025-09-12 11:28:12 -04:00
Mark Backman
e5ed0424e4
Remove to/from data from Plivo, as it will rely on body information
2025-09-12 11:10:03 -04:00
Paul Kompfner
786387722a
Fix an issue in AWSBedrockLLMService.run_inference—exceptions should propagate, just like with other LLM services
2025-09-12 11:09:32 -04:00
Mark Backman
99cfcb1d4e
Parsed custom data from Plivo extraHeaders
2025-09-12 08:11:30 -04:00
Mark Backman
d595676436
Add custom data handling for Twilio
2025-09-12 08:11:30 -04:00
Aleix Conchillo Flaqué
0190812ee8
Merge pull request #2639 from pipecat-ai/aleix/min-words-interruption-unit-test
...
MinWordsInterruptionStrategy unit test
2025-09-11 18:52:39 -07:00
Aleix Conchillo Flaqué
384814e640
Merge pull request #2456 from a6kme/patch-1
...
Only set last_frame_time when handling OutputAudioRawFrame
2025-09-11 16:56:25 -07:00
Aleix Conchillo Flaqué
ab4364b833
update CHANGELOG and fix formatting
2025-09-11 15:34:47 -07:00
Aleix Conchillo Flaqué
fafdadad3c
Merge pull request #2473 from TheNotary/adds-interim-transcription-frame-support
...
adds support to Azure STT for creating InterimTranscriptFrames
2025-09-11 15:33:38 -07:00
Aleix Conchillo Flaqué
0c30cc6ea6
Merge pull request #2547 from manishkjs/feat/google-tts-voice-cloning
...
feat: add voice cloning and speaking rate to GoogleTTSService
2025-09-11 14:32:21 -07:00
Aleix Conchillo Flaqué
c26d336e34
Merge pull request #2545 from pipecat-ai/aleix/aws-nova-sonic-pre-load-cue
...
AWSNovaSonicLLMService: pre-load audio cue in the constructor
2025-09-11 14:31:26 -07:00
Mark Backman
37b6198787
Merge pull request #2635 from pipecat-ai/mb/openai-tts-speed
2025-09-11 14:22:51 -07:00
kompfner
be28d3f93b
Merge pull request #2637 from pipecat-ai/pk/llm-context-evals-and-bug-fix
...
`LLMContext` evals and bug fix
2025-09-11 17:00:07 -04:00
marcus-daily
d2f210e960
Bundle Smart Turn v3 with Pipecat
2025-09-11 21:37:16 +01:00
Aleix Conchillo Flaqué
74b38b59d6
tests(utils): allow passing PipelineParams to run_test()
2025-09-11 13:02:21 -07:00
Paul Kompfner
aff11f5121
Fix missing import in llm_response_universal.py
2025-09-11 14:33:17 -04:00
Mark Backman
fafcd79870
OpenAITTSService: add speed arg
2025-09-11 13:53:52 -04:00
Aleix Conchillo Flaqué
0b21f8a6bd
FrameProcessor: add push_interruption_task_frame_and_wait()
2025-09-11 09:19:44 -07:00
Aleix Conchillo Flaqué
8249b014f0
frames: BotInterruptionFrame is deprecated, use InterruptionTaskFrame
2025-09-11 09:01:54 -07:00
Aleix Conchillo Flaqué
9d9f10ae0e
frames: StartInterruptionFrame is deprecated, use InterruptionFrame
2025-09-11 09:01:54 -07:00
Aleix Conchillo Flaqué
e27b23694d
frames: add new TaskFrame
...
TaskFrame is a base class for other frames that are meant to be sent to the
pipeline task.
2025-09-11 09:01:52 -07:00
marcus-daily
66ce5fe6bd
Ruff fixes
2025-09-11 16:04:56 +01:00
marcus-daily
a9b53dc800
Update inference session options
2025-09-11 16:04:56 +01:00
marcus-daily
818352a300
Formatting
2025-09-11 16:04:56 +01:00
marcus-daily
a2e76bcad8
Smart Turn V3 support
2025-09-11 16:04:56 +01:00
Mark Backman
8e8e42717b
Add to and from phone information to the development runner
2025-09-11 10:44:21 -04:00
kompfner
b31322e38e
Merge pull request #2619 from pipecat-ai/pk/aws-universal-context
...
Expand universal `LLMContext` support to AWS Bedrock
2025-09-11 09:33:08 -04:00
Jessie Wei
305108be9a
[TwilioFrameSerializer]: Add parameter validation
2025-09-10 23:00:15 +00:00
Jessie Wei
2e1f397d17
Support TwilioFrameSerializer region/edge settings to that the call is terminated successfully for regions other than default us1 region
2025-09-10 14:30:10 +00:00
James Hush
e8f60c7c6f
Handle missing rawResponse in transcription messages ( #2623 )
...
* Handle missing rawResponse in transcription messages
- Use message.get('rawResponse', {}) to safely access rawResponse field
- Default is_final to False when rawResponse is missing
- Add proper type annotations for better code clarity
- Minor import formatting cleanup
This prevents KeyError crashes when transcription messages from Daily's API
don't include the rawResponse field in edge cases.
* docs: add changelog line
2025-09-10 15:03:23 +08:00
Paul Kompfner
8ccd220a60
Add universal LLMContext support to AWSBedrockLLMService.run_inference()
2025-09-09 16:00:32 -04:00
Paul Kompfner
fe79de8f27
When converting universal LLMContext messages to AWS Bedrock expected format, automatically update non-initial "system"-role messages to "user"-role messages, as we do in other non-OpenAI LLM services
2025-09-09 15:50:03 -04:00
Paul Kompfner
75f9914f49
Add support for universal LLMContext to AWS Bedrock LLM service
2025-09-09 15:25:04 -04:00
Paul Kompfner
1c3e4e34e5
Minor fix to AWS Bedrock console logging to handle image messages in the context
2025-09-08 17:10:11 -04:00
Paul Kompfner
623c660027
Remove debugging comment
2025-09-08 17:01:51 -04:00
Paul Kompfner
a3e65ab3b5
The VisionImageRawFrame removal and corresponding VisionImageFrameAggregator deprecation will now happen in version 0.0.85
2025-09-08 17:01:47 -04:00
Paul Kompfner
f3a4b416df
Remove VisionImageRawFrame, which was previously being handled directly by the LLM services, and deprecate the associated VisionImageFrameAggregator.
...
Removing `VisionImageRawFrame` lets us simplify LLM services' logic, getting us closer to the idealized architecture where all they care about is handling context frames.
This change is in service of getting us closer to ready to deprecate usage of `OpenAILLMContext` and subclasses in favor of the universal `LLMContext`, at least for the traditional text-to-text LLMs.
Why remove `VisionImageRawFrame` rather than deprecate? It's "internal"—only created by `VisionImageFrameAggregator`—and never intended to be used directly by users (it would be difficult to use directly anyway).
Move the logic that was once in `VisionImageFrameAggregator` directly into the examples. Reasoning:
- If `UserImageRequester` is defined in the examples, it makes sense for `UserImageProcessor` to be too, as it’s the flip side of the same coin, so to speak
- The logic is now pretty trivial
- This kind of one-shot, history-less image-describing pipeline shouldn't be common at all; it's ok for it to live in examples rather than as a dedicated class
- In the short term, this enables us to create `LLMContext`s for services that support it and `OpenAILLMContext`s for services that don't yet (AWS)
This commit also adds missing translation from OpenAI-format image context messages to AWS format. Note that this isn't a wasted effort in the face of the upcoming migration to universal `LLMContext`—this work will be reused as it has to be implemented there too.
2025-09-08 17:00:08 -04:00
Aleix Conchillo Flaqué
d55133a44f
Merge pull request #2604 from alexyzhou/feature/livekit_video_and_bug_fix
...
Feature: Add support for livekit video stream and minor bug fixes
2025-09-08 13:51:14 -07:00
Paul Kompfner
e65385c151
Tweak the Mistral-specific context messages fixup logic to handle the (mostly academic) possibility of a "tool" message appearing at the end
2025-09-08 13:55:09 -04:00
Paul Kompfner
0bb7df7a6b
Remove stray debugging message
2025-09-08 13:38:26 -04:00
Paul Kompfner
daee1ddf3b
Apply additional fixups to context messages to meet Mistral-specific requirements
2025-09-08 11:26:58 -04:00
Adithya Suresh
d1f72c1c0b
Added usage metrics
2025-09-08 14:44:25 +10:00
Aleix Conchillo Flaqué
d7794abf21
audio(filters): deprecate NoisereduceFilter
2025-09-07 20:52:17 -07:00
Mark Backman
a537382816
Add OpenAIRealtimeLLMService, AzureRealtimeLLMService ( #2596 )
...
* Add OpenAI Realtime module
* Add foundational examples for OpenAI Realtime
* Add deprecation warning to OpenAIRealtimeBetaLLMService
* Add deprecation warning to AzureRealtimeBetaLLMService
* Update Changelog
2025-09-07 09:09:57 -04:00
TheNotary
7366b1aee0
adds missing InterimTranscriptionFrame import
2025-09-06 14:40:19 -05:00
Alex Zhou
d6432589f6
fix: fix format and lint by ruff
2025-09-06 10:50:47 +08:00
