kompfner
d293cee372
Merge pull request #2822 from pipecat-ai/pk/make-pause-processing-frames-more-robust
...
Make `pause_processing_frames()` and `pause_processing_system_frames(…
2025-10-10 10:16:27 -04:00
Mark Backman
0c102ce70b
Merge pull request #2826 from pipecat-ai/mb/deprecate-livekit-frame-serializer
...
Deprecate LivekitFrameSerializer
2025-10-10 10:01:45 -04:00
Mark Backman
3894d2a4b9
Deprecate LivekitFrameSerializer
2025-10-10 09:51:57 -04:00
Aleix Conchillo Flaqué
1f6b61c0db
Merge pull request #2828 from pipecat-ai/aleix/gemini-live-gemini-to-llm
...
google: rename google.gemini_live.gemini to google.gemini_live.llm
2025-10-10 06:42:51 -07:00
Aleix Conchillo Flaqué
8ee28b37cd
google: rename google.gemini_live.vertext to google.gemini_live.llm_vertex
2025-10-10 06:41:19 -07:00
Filipi da Silva Fuchter
e85e7e4d84
Merge pull request #2773 from pipecat-ai/filipi/krisp_viva
...
Added audio filter `KrispVivaFilter` using the Krisp VIVA SDK.
2025-10-10 09:51:15 -03:00
Filipi Fuchter
1b3afb5511
Added audio filter KrispVivaFilter using the Krisp VIVA SDK
2025-10-10 09:44:47 -03:00
Aleix Conchillo Flaqué
7cec013666
google: rename google.gemini_live.gemini to google.gemini_live.llm
2025-10-09 22:20:09 -07:00
Aleix Conchillo Flaqué
86127167fb
Merge pull request #2827 from pipecat-ai/aleix/openai-realtime-move
...
move openai_realtime to openai.realtime
2025-10-09 22:18:04 -07:00
Aleix Conchillo Flaqué
9935a68018
examples(19b): fix deprecations
2025-10-09 22:14:52 -07:00
Aleix Conchillo Flaqué
5679dde70f
ai_service: use openai.realtime.events instead of openai_realtime_beta.events
2025-10-09 22:14:46 -07:00
Aleix Conchillo Flaqué
d81b0f6368
update CHANGELOG with openai_realtime deprecation
2025-10-09 22:14:46 -07:00
Aleix Conchillo Flaqué
9698b008da
deprecate openai_realtime
2025-10-09 22:14:46 -07:00
Aleix Conchillo Flaqué
7b05c9283b
move openai.realtime.azure to azure.realtime.llm
2025-10-09 22:14:46 -07:00
Aleix Conchillo Flaqué
303dd2ec35
move openai.realtime.openai to openai.realtime.llm
2025-10-09 22:14:46 -07:00
Aleix Conchillo Flaqué
aa6e81648a
move openai_realtime to openai.realtime
2025-10-09 22:14:46 -07:00
Aleix Conchillo Flaqué
1a87870ef3
Merge pull request #2825 from pipecat-ai/aleix/aws-nova-sonic-move
...
move aws_nova_sonic to aws.nova_sonic
2025-10-09 18:37:46 -07:00
Aleix Conchillo Flaqué
aac4ce2d12
update CHANGELOG with aws_nova_sonic deprecation
2025-10-09 18:32:26 -07:00
Aleix Conchillo Flaqué
2a79b2c853
aws: deprecate aws_nova_sonic
2025-10-09 17:44:29 -07:00
Aleix Conchillo Flaqué
15bf5b1533
aws: move aws_nova_sonic to aws.nova_sonic
2025-10-09 17:35:47 -07:00
Aleix Conchillo Flaqué
cdc86db8ce
update CHANGELOG with GoogleVertexLLMService token fix
2025-10-09 16:58:22 -07:00
Aleix Conchillo Flaqué
9d2ad750b5
Merge pull request #2779 from LucasStringPay/patch-1
...
Ignore None value for 'completion_tokens' or similar for Gemini
2025-10-09 16:55:33 -07:00
Aleix Conchillo Flaqué
19ceb1a48f
Merge pull request #2817 from pipecat-ai/aleix/runner-download-folder
...
runner: add --folder argument to allow file downloads
2025-10-09 16:55:17 -07:00
Aleix Conchillo Flaqué
59217eae38
runner: add --folder argument to allow file downloads
2025-10-09 16:49:51 -07:00
Aleix Conchillo Flaqué
bea0aee835
Merge pull request #2824 from pipecat-ai/aleix/gemini-under-google
...
google: move gemini_live inside google service
2025-10-09 16:40:15 -07:00
Aleix Conchillo Flaqué
aeace9b9be
google: move gemini_live inside google service
2025-10-09 16:06:42 -07:00
Paul Kompfner
10069719e4
Make pause_processing_frames() and pause_processing_system_frames() more robust in FrameProcessor.
...
To understand this fix, let's look exclusively at `pause_processing_frames()` (`pause_processing_system_frames()` works the same way).
`pause_processing_frames()` works by setting a `__should_block_frames` flag, which is then read each time through the loop in the long-running `__process_frame_task_handler`. if `__should_block_frames` is `True`, it pauses processing frames until it's resumed.
Prior to this fix, the check for `__should_block_frames` was before `await self.__process_queue.get()`. The problem is that a lot of the time spent in the loop is waiting for a frame from the process queue. So if `pause_processing_frames()` is set at any time other than within `process_frame()` itself, it actually won't have an effect by the next frame, only on the frame *after* the next, which is later than intended.
Because thus far in the Pipecat codebase we've only ever called `pause_processing_frames()` and `pause_processing_system_frames()` from within `process_frame()`, this change should have no behavioral effect. But it will be helpful if we ever need to call it from anywhere else. I noticed this issue while developing a feature that did exactly that (though I later abandoned that code).
2025-10-09 15:57:31 -04:00
kompfner
046b76df60
Merge pull request #2820 from pipecat-ai/pk/gemini-live-vertex-support
...
Support Gemini Live + Vertex AI
2025-10-09 11:53:41 -04:00
Paul Kompfner
f2d9063984
Renames: remove "multimodal" from Gemini Live types
2025-10-09 10:58:36 -04:00
Paul Kompfner
99f008e927
Make a note in our examples that there's an issue with Gemini Live + Vertex around specifying a modality other than AUDIO
2025-10-08 21:03:07 -04:00
Paul Kompfner
2699f0c2a6
Fix tool calls when using Gemini Live + Vertex AI
2025-10-08 21:03:07 -04:00
Paul Kompfner
0b6dd98000
Make a note in our examples that there's an issue with Gemini Live + Vertex around using "google_search" alongside other tools
2025-10-08 21:03:07 -04:00
Paul Kompfner
a14fb20d15
Fix Gemini Live w/Vertex AI not being able to handle an empty list provided for "function_declarations"
2025-10-08 21:03:07 -04:00
Paul Kompfner
728361a6a7
Add GeminiVertexMultimodalLiveLLMService
2025-10-08 21:03:01 -04:00
kompfner
106db69e8e
Merge pull request #2816 from pipecat-ai/pk/gemini-live-await-ongoing-response-after-endframe
...
Implement ending `GeminiMultimodalLiveLLMService` gracefully (i.e. af…
2025-10-08 17:20:14 -04:00
Paul Kompfner
cf90071926
Format fix
2025-10-08 17:19:46 -04:00
Paul Kompfner
deaeb75a1f
Fix changelog after rebase (and add a missing item)
2025-10-08 17:16:31 -04:00
Paul Kompfner
a666327d70
Implement ending GeminiMultimodalLiveLLMService gracefully (i.e. after the bot is finished)
2025-10-08 17:13:04 -04:00
kompfner
13a0522546
Merge pull request #2804 from pipecat-ai/pk/gemini-live-session-resumption
...
Add (relatively spartan) reconnection logic to `GeminiMultimodalLiveLLMService`
2025-10-08 17:10:45 -04:00
Paul Kompfner
7da37a0d1f
Pull _connection_established_threshold and _max_consecutive_failures into file-level constants
2025-10-08 17:04:05 -04:00
Paul Kompfner
7efb22a323
Add (relatively spartan) reconnection logic to GeminiMultimodalLiveLLMService, leveraging the Gemini Live session resumption mechanism
2025-10-08 16:53:21 -04:00
kompfner
8084e2f909
Merge pull request #2776 from pipecat-ai/pk/gemini-live-gen-ai-library
...
Gemini Live service uses the `genai` library rather than WebSockets directly
2025-10-08 16:50:16 -04:00
Paul Kompfner
86127c6a6e
Add to the changelog the GeminiMultimodalLiveLLMService update to use google-genai
2025-10-08 16:46:41 -04:00
Paul Kompfner
402e019ae2
Make a bit of code clearer
2025-10-08 16:45:55 -04:00
Paul Kompfner
f09e4e238b
Fix some mishandling of enum values
2025-10-08 16:45:55 -04:00
Paul Kompfner
2921162b3b
Add deprecation warning around importing StartSensitivity and EndSensitivity from pipecat.services.gemini_multimodal_live.events
2025-10-08 16:45:55 -04:00
Paul Kompfner
ac1582c906
Let users directly use google-genai types rather than aliased re-exported types
2025-10-08 16:45:55 -04:00
Paul Kompfner
e4b01a5844
Bumping deprecation version of GeminiMultimodalLiveLLMService's base_url arg
2025-10-08 16:45:55 -04:00
Paul Kompfner
fa663abbbc
Add CHANGELOG entry for new GeminiMultimodalLiveLLMService configuration options
2025-10-08 16:45:55 -04:00
Paul Kompfner
d19e6111c3
Bumping deprecation version of GeminiMultimodalLiveLLMService's base_url arg
2025-10-08 16:45:55 -04:00
