James Hush
e8f60c7c6f
Handle missing rawResponse in transcription messages ( #2623 )
...
* Handle missing rawResponse in transcription messages
- Use message.get('rawResponse', {}) to safely access rawResponse field
- Default is_final to False when rawResponse is missing
- Add proper type annotations for better code clarity
- Minor import formatting cleanup
This prevents KeyError crashes when transcription messages from Daily's API
don't include the rawResponse field in edge cases.
* docs: add changelog line
2025-09-10 15:03:23 +08:00
Paul Kompfner
a3e65ab3b5
The VisionImageRawFrame removal and corresponding VisionImageFrameAggregator deprecation will now happen in version 0.0.85
2025-09-08 17:01:47 -04:00
Paul Kompfner
f3a4b416df
Remove VisionImageRawFrame, which was previously being handled directly by the LLM services, and deprecate the associated VisionImageFrameAggregator.
...
Removing `VisionImageRawFrame` lets us simplify LLM services' logic, getting us closer to the idealized architecture where all they care about is handling context frames.
This change is in service of getting us closer to ready to deprecate usage of `OpenAILLMContext` and subclasses in favor of the universal `LLMContext`, at least for the traditional text-to-text LLMs.
Why remove `VisionImageRawFrame` rather than deprecate? It's "internal"—only created by `VisionImageFrameAggregator`—and never intended to be used directly by users (it would be difficult to use directly anyway).
Move the logic that was once in `VisionImageFrameAggregator` directly into the examples. Reasoning:
- If `UserImageRequester` is defined in the examples, it makes sense for `UserImageProcessor` to be too, as it’s the flip side of the same coin, so to speak
- The logic is now pretty trivial
- This kind of one-shot, history-less image-describing pipeline shouldn't be common at all; it's ok for it to live in examples rather than as a dedicated class
- In the short term, this enables us to create `LLMContext`s for services that support it and `OpenAILLMContext`s for services that don't yet (AWS)
This commit also adds missing translation from OpenAI-format image context messages to AWS format. Note that this isn't a wasted effort in the face of the upcoming migration to universal `LLMContext`—this work will be reused as it has to be implemented there too.
2025-09-08 17:00:08 -04:00
Aleix Conchillo Flaqué
aa471a4ef5
update CHANGELOG with LiveKitTransport updates
2025-09-08 13:53:21 -07:00
Paul Kompfner
daee1ddf3b
Apply additional fixups to context messages to meet Mistral-specific requirements
2025-09-08 11:26:58 -04:00
Aleix Conchillo Flaqué
d7794abf21
audio(filters): deprecate NoisereduceFilter
2025-09-07 20:52:17 -07:00
Mark Backman
a537382816
Add OpenAIRealtimeLLMService, AzureRealtimeLLMService ( #2596 )
...
* Add OpenAI Realtime module
* Add foundational examples for OpenAI Realtime
* Add deprecation warning to OpenAIRealtimeBetaLLMService
* Add deprecation warning to AzureRealtimeBetaLLMService
* Update Changelog
2025-09-07 09:09:57 -04:00
Aleix Conchillo Flaqué
070690ec64
update CHANGELOG for 0.0.84
2025-09-05 18:22:50 -07:00
Aleix Conchillo Flaqué
f8b2ab6331
pyproject: update daily-python to 0.19.9
2025-09-05 18:14:57 -07:00
Mark Backman
2f44f88b08
LiveKitTransport: Add support to send DTMF
2025-09-05 18:23:04 -04:00
Mark Backman
fbe4338440
DTMF: Add support for native DTMF implementation where available
2025-09-05 18:16:56 -04:00
Paul Kompfner
ba5ebfa0ec
Fixed subtle CHANGELOG conflict after release of 0.0.83: universal LLMContext support for Anthropic didn't make that release. Also, some automatic Prettier fixes.
2025-09-04 13:04:11 -04:00
Paul Kompfner
c11b207c97
Add Anthropic to CHANGELOG list of services newly supporting runtime LLM switching
2025-09-04 13:03:06 -04:00
Aleix Conchillo Flaqué
65298ab792
update CHANGELOG with AWSBedrockLLMService fix
2025-09-04 09:24:55 -07:00
Aleix Conchillo Flaqué
ee3b023986
update CHANGELOG with OpenAIImageGenService fix
2025-09-04 09:20:02 -07:00
Ashot
daf7fed8b3
feat(asyncai): add multilingual TTS support
2025-09-04 13:58:50 +04:00
Aleix Conchillo Flaqué
f0baff94b2
update CHANGELOG for 0.0.83
2025-09-03 16:47:43 -07:00
Filipi Fuchter
99e237b1e2
Fixed an issue where messages received from the transport were always being resent.
2025-09-03 18:58:34 -03:00
Aleix Conchillo Flaqué
978f644f19
Merge pull request #2578 from pipecat-ai/aleix/user-speaking-frame
...
add UserSpeakingFrame and UserStartedSpeakingFrame/UserStopeedSpeakingFrame updates
2025-09-03 14:55:45 -07:00
Aleix Conchillo Flaqué
5a4c6b9618
BaseInputTransport: push UserStartedSpeakingFrame/UserStoppedSpeakingFrame upstream
2025-09-03 14:32:32 -07:00
Mark Backman
c64bc5a636
Merge pull request #2576 from joyceerhl/joyce/cerebras-default
...
fix: update default Cerebras model to GPT-OSS-120B
2025-09-03 14:10:28 -07:00
Joyce Er
eba006d39c
Fix nits
2025-09-03 14:07:49 -07:00
Joyce Er
a001f6f193
Switch to GPT-OSS-120B
2025-09-03 14:00:27 -07:00
Aleix Conchillo Flaqué
09d6ec1098
introduce and push UserSpeakingFrame upstream/downstream
2025-09-03 13:56:01 -07:00
Aleix Conchillo Flaqué
c71cec04d3
ParallelPipeline: wait for CancelFrame in all branches
2025-09-03 11:23:37 -07:00
Aleix Conchillo Flaqué
d19170d8b1
Merge pull request #2565 from pipecat-ai/aleix/reorganize-transports
...
transports: reorganize module
2025-09-03 08:52:49 -07:00
Paul Kompfner
def1cf1548
Update CHANGELOG with entry about expanded support among LLM services for new universal LLMContext
2025-09-03 09:07:57 -04:00
Aleix Conchillo Flaqué
aeb9f1ffca
transports: reorganize module
2025-09-02 17:31:39 -07:00
Filipi Fuchter
8fbd9b5af7
Added support for WhatsApp User-initiated Calls.
2025-09-02 18:05:00 -03:00
Aleix Conchillo Flaqué
ce7a0512f9
Merge pull request #2562 from pipecat-ai/aleix/ai-coustics-speech-enhancement
...
add ai-coustics speech enhancement filter
2025-09-02 13:13:28 -07:00
Aleix Conchillo Flaqué
fdcd14dd21
updated CHANGELOG with AICFilter and fix deprecations
2025-09-02 13:10:10 -07:00
Mark Backman
0386599163
Added Daily SIP room creation utility ( #2560 )
...
* Added Daily SIP room creation utility to configure() function
* Add sip_codecs to the DailyRoomSipParams
2025-09-02 14:12:04 -04:00
Filipi da Silva Fuchter
0d8ab7abca
Merge pull request #2552 from pipecat-ai/filipi/freeze_issues
...
Fixed an issue where the pipeline could freeze.
2025-09-02 14:43:08 -03:00
Filipi Fuchter
dea7c22020
Fixed an issue where the pipeline could freeze.
2025-09-02 13:58:41 -03:00
Mark Backman
d0c97d3602
Add mem0 changelog entry
2025-09-02 10:03:17 -04:00
Mark Backman
e1477e79f0
Merge pull request #2538 from rimelabs/rime-flush-audio-update
...
Use Rime’s official {"operation": "flush"} command in flush_audio() for proper text buffer flushing
2025-09-01 18:01:20 -07:00
Mark Backman
64486ef50b
Merge pull request #2536 from gladiaio/PLA-38-missing-config-parameters
...
Gladia - add missing config parameters
2025-09-01 12:42:10 -07:00
gokuljs
5f801743d0
Add changelog entry for RimeTTSService flush_audio API update
2025-09-01 22:16:02 +05:30
Fabrice Lamant
802c5d04f4
update changelog
2025-09-01 10:21:11 +02:00
Aleix Conchillo Flaqué
83b90da53a
Merge pull request #2537 from pipecat-ai/aleix/pipeline-task-cleanup-observers
...
PipelineTask: cleanup observers
2025-08-31 13:44:38 -07:00
Aleix Conchillo Flaqué
1f49de5cdf
Merge pull request #2542 from pipecat-ai/aleix/remove-stop-interruption-frame
...
frames: remove StopInterruptionFrame
2025-08-31 13:44:22 -07:00
Mark Backman
972546b24f
Add IVR navigation ( #2529 )
2025-08-29 20:08:17 -04:00
Aleix Conchillo Flaqué
bd7d9346b7
frames: remove StopInterruptionFrame
2025-08-29 16:40:01 -07:00
Aleix Conchillo Flaqué
b5a644dd6f
PipelineTask: cleanup observers
2025-08-29 10:54:36 -07:00
Aleix Conchillo Flaqué
f03deb6ecc
DailyTransport: remove send_dtmf() and write_dtmf()
2025-08-28 21:01:41 -07:00
Aleix Conchillo Flaqué
0e01ac8ef6
BaseOutputTransport: implement generic write_dtmf()
2025-08-28 21:01:41 -07:00
Aleix Conchillo Flaqué
a5c5e069ba
move pipecat.frames.frames.KeypadEntry to pipecat.audio.dtmf.types.KeypadEntry
2025-08-28 17:43:29 -07:00
Aleix Conchillo Flaqué
d67cece356
update CHANGELOG for 0.0.82
2025-08-28 13:02:47 -07:00
Paul Kompfner
189749b579
Add LLMRunFrame to trigger an LLM response, replacing context_aggregator.user().get_context_frame()
2025-08-28 09:53:33 -04:00
Aleix Conchillo Flaqué
16f57be72c
LLMConfigureOutputFrame: allow configuring LLM output
2025-08-27 16:23:27 -07:00
