Mark Backman
c8c13ecee2
fix: DeepgramSTTService await is_connected()
2025-11-05 21:42:15 -05:00
Paul Kompfner
61aec08794
CHANGELOG item ordering tweak
2025-11-05 15:29:58 -05:00
Paul Kompfner
75245e1daa
Fix a bug in GeminiLiveLLMService where in some circumstances it wouldn't respond after a tool call
2025-11-05 15:29:04 -05:00
Paul Kompfner
24365aeefe
CHANGELOG wording fix
2025-11-05 15:29:04 -05:00
Paul Kompfner
29ef0f419f
Add typing formalizing MCPClient support for registering tools on an LLMSwitcher in addition to an LLMService.
2025-11-05 15:29:01 -05:00
Paul Kompfner
a9d78bd956
Make it possible to get a ToolsSchema out of an MCPClient without passing in an LLM service.
...
This allows folks to use `MCPClient` alongside the pattern of passing in tools at LLM init time, a pattern supported by speech-to-speech services such as `GeminiLiveLLMService`.
2025-11-05 15:28:23 -05:00
Paul Kompfner
e6f881bb08
Remove the "needs alternate schema" mechanism in MCPClient, moving the necessary schema massaging into GeminiLLMAdapter instead.
...
This does a couple of things:
- Makes the `MCPClient` LLM agnostic, setting us up for some upcoming improvements (like making it possible to use with `LLMSwitcher`)
- Makes `GeminiLLMAdapter` more robust, as the schema massaging that was previously only done in `MCPClient` is useful for all tools, not just for MCP-provided ones
2025-11-05 15:28:23 -05:00
Paul Kompfner
bee4165ba4
Add LLMSwitcher.register_direct_function()
2025-11-05 15:28:19 -05:00
Aleix Conchillo Flaqué
d844829538
Revert "fix interruption task frame context ordering"
2025-11-05 12:14:03 -08:00
Mark Backman
11b101e8a6
Merge pull request #2974 from pipecat-ai/mb/language-mapping-improvements
...
Improve language checking in STT and TTS services
2025-11-05 14:59:41 -05:00
Mark Backman
9a96e4060c
Bumped the fastapi dependency to <0.122.0
2025-11-05 13:13:47 -05:00
Aleix Conchillo Flaqué
234aae3091
FrameProcessor: use finished_event for push_interruption_task_frame_and_wait
2025-11-05 09:38:17 -08:00
Aleix Conchillo Flaqué
c33b81bb92
PipelineTask: set finished_event InterruptionFrame is received
2025-11-05 09:37:55 -08:00
Mark Backman
2ee54c985f
Improve language checking in STT and TTS services
2025-11-05 12:26:52 -05:00
Thu Nguyen
76c336644a
Merge branch 'main' into feature/whisper-stt-probability-metrics
2025-11-06 00:24:34 +07:00
Thu Nguyen
dd8711dee1
Added changelog
2025-11-06 00:23:42 +07:00
Mark Backman
c18ff999a5
Update GoogleVertexLLMService default model to gemini-2.5-flash
2025-11-05 11:28:41 -05:00
Mark Backman
80d127aaa4
Refactor GoogleVertexLLMService to use GoogleLLMService as a base class
2025-11-05 09:33:02 -05:00
Mark Backman
01f3421052
Fix: support request data in SmallWebRTC
2025-11-04 17:14:29 -05:00
Aleix Conchillo Flaqué
38f27ad991
PipelineTask: load observers from PIPECAT_OBSERVER_FILES
2025-11-04 12:10:53 -08:00
Mark Backman
0c38585034
Merge pull request #2973 from pipecat-ai/mb/cartesia-sonic-3-languages
...
Add sonic-3 languages to Cartesia TTS services
2025-11-04 14:43:06 -05:00
Paul Kompfner
a82158045a
Fix Gemini Live session resumption. The problem was that we weren't properly ignoring send errors during reconnection.
2025-11-04 09:18:40 -05:00
Mark Backman
b1533ddfc4
Add sonic-3 languages to Cartesia TTS services
2025-11-04 07:57:04 -05:00
Paul Kompfner
87131850bc
GeminiLiveLLMService supports context-provided system instruction and tools
2025-11-03 10:30:46 -05:00
Aleix Conchillo Flaqué
62e45f466a
EndFrame: add reason field to indicate why pipeline is being ended
2025-11-02 00:45:27 -07:00
Aleix Conchillo Flaqué
e85e93b9b1
CancelFrame: add reason field to indicate why pipeline is being cancelled
2025-11-02 00:44:47 -07:00
shreyas-sarvam
d680ec2e69
Merge branch 'main' into sarvam/stt
2025-10-31 23:09:47 +05:30
Aleix Conchillo Flaqué
e3531a5f25
update CHANGELOG for 0.0.92. 🎃 "The Haunted Edition" 👻
2025-10-31 09:17:03 -07:00
Mark Backman
653e84321b
Add support for token properties in Daily util and development runner
2025-10-31 12:08:53 -04:00
Mark Backman
3585f724c4
Merge pull request #2952 from pipecat-ai/mb/add-daily-room-properties-to-runner
...
Add support for dailyRoomProperties when calling /start using the dev…
2025-10-31 12:04:42 -04:00
Mark Backman
5fe597d355
Add support for dailyRoomProperties when calling /start using the development runner
2025-10-31 12:01:03 -04:00
Aleix Conchillo Flaqué
67ab3773f6
Merge pull request #2949 from pipecat-ai/aleix/idle-timeout-observer
...
PipelineTask: add IdleFrameObserver to detect idle pipelines
2025-10-31 08:51:09 -07:00
Aleix Conchillo Flaqué
ed93e29850
PipelineTask: add IdleFrameObserver to detect idle pipelines
2025-10-31 08:45:56 -07:00
Mark Backman
7eb880c5e8
Add DeepgramHttpTTSService
2025-10-31 11:39:32 -04:00
Aleix Conchillo Flaqué
4fa0de6660
Merge pull request #2947 from pipecat-ai/aleix/rename-add-to-context
...
UserImageRawFrame: rename add_to_context to append_to_context
2025-10-31 08:29:49 -07:00
kompfner
396c1bcc13
Merge pull request #2946 from pipecat-ai/pk/deprecate-expect-stripped-words
...
Deprecate `expect_stripped_words` option from `LLMAssistantAggregatorParams`…
2025-10-31 09:57:20 -04:00
shreyas-sarvam
57f6ae9e50
Merge branch 'main' into sarvam/stt
2025-10-31 17:36:52 +05:30
Mark Backman
f820c20fa2
Add SpeechmaticsTTSService and SonioxSTTService changes to changelog
2025-10-31 07:41:17 -04:00
shreyas-sarvam
09a7e08cbf
Merge branch 'main' into sarvam/stt
2025-10-31 15:21:09 +05:30
Aleix Conchillo Flaqué
685d440206
UserImageRawFrame: rename add_to_context to append_to_context
2025-10-30 15:18:27 -07:00
Paul Kompfner
ac5734d0ed
Deprecate expect_stripped_words option from LLMAssistantAggregatorParams, when used with the newer LLMAssistantAggregator, which now handles word spacing automatically.
...
This commit does not change how it works in the older `LLMAssistantContextAggregator`.
2025-10-30 17:22:47 -04:00
Aleix Conchillo Flaqué
19f046a338
examples(foundational): add 12d-describe-image-moondream
2025-10-30 14:02:17 -07:00
Aleix Conchillo Flaqué
ec95618b94
don't tie UserImageRawFrame with function calls
2025-10-30 14:02:17 -07:00
Aleix Conchillo Flaqué
3b3a215155
examples(foundational): re-add 12-* but load image from file
2025-10-30 13:08:15 -07:00
Aleix Conchillo Flaqué
d7d409df60
examples(foundational): move 12-* to 14-*-video
2025-10-30 13:08:15 -07:00
Aleix Conchillo Flaqué
9c5690d670
LLMContext: added support for image messages with URLs
2025-10-30 13:08:15 -07:00
Aleix Conchillo Flaqué
e0933e20d2
deprecated UserResponseAggregator
2025-10-30 13:08:15 -07:00
Aleix Conchillo Flaqué
ce13155d26
vision(moondream): process VisionImageRawFrame
2025-10-30 13:08:15 -07:00
Aleix Conchillo Flaqué
817a485d94
frames: added VisionImageRawFrame
2025-10-30 13:08:15 -07:00
Aleix Conchillo Flaqué
b094418d1e
LLMContext: add create_image_message and create_audio_message
2025-10-30 13:08:13 -07:00
