James Hush
a39f8b4882
Remove extra code
2025-10-01 14:48:12 +08:00
James Hush
76fc36f621
Pre recorded message example
2025-10-01 14:43:36 +08:00
James Hush
c0878c5e09
Save progress
2025-10-01 13:58:32 +08:00
James Hush
c6a1013051
Pre-recorded message example
2025-10-01 13:52:58 +08:00
Aleix Conchillo Flaqué
feae3b6d2d
Merge pull request #2742 from pipecat-ai/aleix/deprecate-daily-update-remote-participants-frame
...
DailyTransport: deprecated DailyUpdateRemoteParticipantsFrame
2025-09-30 16:27:34 -07:00
Aleix Conchillo Flaqué
92d3be8975
DailyTransport: deprecated DailyUpdateRemoteParticipantsFrame
2025-09-30 16:26:48 -07:00
Aleix Conchillo Flaqué
0f53e1db2c
Merge pull request #2759 from pipecat-ai/aleix/dont-cancel-if-finished
...
PipelineTask: avoid cancellation if application is finished
2025-09-30 16:21:16 -07:00
Aleix Conchillo Flaqué
d398e8cc10
Merge pull request #2761 from pipecat-ai/aleix/rtvi-tail-updates
...
RTVI updates: audio levels and system logs
2025-09-30 13:55:17 -07:00
Aleix Conchillo Flaqué
e5f263d380
update CHANGELOG
2025-09-30 13:51:35 -07:00
Aleix Conchillo Flaqué
3a4c303c54
RTVIParams: add errors_enabled deprecation warnings
2025-09-30 13:49:51 -07:00
Mark Backman
54a1ef47d0
Merge pull request #2758 from pipecat-ai/mb/claude-sonnet-4.5
...
Update AnthropicLLMService to use claude-sonnet-4-5-20250929
2025-09-30 16:42:47 -04:00
Aleix Conchillo Flaqué
149ffa4f3c
RTVIObserver: add support system logs
2025-09-30 13:42:40 -07:00
Aleix Conchillo Flaqué
e5465034d9
RTVIObserver: add support for user/bot audio levels
2025-09-30 13:41:26 -07:00
Aleix Conchillo Flaqué
568c7c782d
rtvi: allow None RTVIProcessor and rename to send_rtvi_message()
2025-09-30 13:35:27 -07:00
Aleix Conchillo Flaqué
9851334221
rtvi: deprecate errors_enabled and always send errors
2025-09-30 13:31:30 -07:00
Aleix Conchillo Flaqué
e79c4fc99d
PipelineTask: avoid cancellation if application is finished
2025-09-30 13:18:25 -07:00
Aleix Conchillo Flaqué
55c321f4ff
Merge pull request #2751 from pipecat-ai/aleix/nova-sonic-disconnect-fix
...
AWSNovaSonicLLMService: add missing await
2025-09-30 13:12:22 -07:00
kompfner
a14a53a005
Merge pull request #2735 from pipecat-ai/pk/remove-openaillmcontext-usage
...
Remove remaining usage of `OpenAILLMContext` throughout the codebase …
2025-09-30 10:09:25 -04:00
Mark Backman
a71f937e8f
Update AnthropicLLMService to use claude-sonnet-4-5-20250929
2025-09-30 08:49:30 -04:00
Mark Backman
d0178edad0
Merge pull request #2753 from pipecat-ai/mb/quickstart-0.0.86
...
Quickstart: Update to 0.0.86, removing pytorch requirements
2025-09-29 09:43:33 -04:00
Mark Backman
795c5e55d9
Quickstart: Update to 0.0.86, removing pytorch requirements
2025-09-27 08:30:37 -04:00
Aleix Conchillo Flaqué
8f8d8ae0d8
AWSNovaSonicLLMService: add missing await
2025-09-26 15:58:05 -07:00
Vanessa Pyne
741f192d04
Merge pull request #2096 from pipecat-ai/vp-mcp-ex-nit
...
mcp examples: check for env vars needed for examples
2025-09-26 10:21:22 -05:00
Aleix Conchillo Flaqué
ee00ee5c57
Merge pull request #2744 from pipecat-ai/aleix/vad-analyzer-thread-executor
...
BaseInputTransport: create VAD thread in VADAnalyzer
2025-09-25 13:43:34 -07:00
Aleix Conchillo Flaqué
f53fd880dc
BaseInputTransport: create VAD thread in VADAnalyzer
...
We move the thread creation to the VADAnalyzer instead of the input
transport. This can potentially be useful if we need to analyze multiple audio
streams.
2025-09-25 13:41:20 -07:00
Aleix Conchillo Flaqué
de3461e4cc
Merge pull request #2743 from pipecat-ai/aleix/turn-analyzer-fixes
...
turn analyzer fixes
2025-09-25 13:40:43 -07:00
Aleix Conchillo Flaqué
7bafc3a1bb
BaseSmartTurn: process speech in a separate thread
2025-09-25 13:37:28 -07:00
Aleix Conchillo Flaqué
22ef61fe8d
BaseTurnAnalyzer: add BaseTurnParams base class for parameters
2025-09-25 13:37:09 -07:00
Aleix Conchillo Flaqué
7078fb53bd
Merge pull request #2738 from pipecat-ai/aleix/openai-cached-tokens-metrics
...
BaseOpenAILLMService: include cached tokens to metrics frame
2025-09-25 13:36:03 -07:00
Aleix Conchillo Flaqué
33447ad6f2
BaseOpenAILLMService: include cached tokens to metrics frame
2025-09-24 19:32:16 -07:00
Paul Kompfner
6faa50ae5b
Remove remaining usage of OpenAILLMContext throughout the codebase in favor of LLMContext, except for:
...
- Usage in classes that are already deprecated
- Usage related to realtime LLMs, which don't yet support `LLMContext`
- Usage in (soon-to-be-deprecated) code paths related to `OpenAILLMContext` itself and associated machinery
2025-09-24 16:35:03 -04:00
Aleix Conchillo Flaqué
3797f41c8c
Merge pull request #2734 from pipecat-ai/aleix/pipecat-0.0.86
...
update CHANGELOG for 0.0.86
2025-09-24 12:19:16 -07:00
Aleix Conchillo Flaqué
ff919b8c15
update CHANGELOG for 0.0.86
2025-09-24 11:28:14 -07:00
Aleix Conchillo Flaqué
cb048d6c7e
Merge pull request #2733 from pipecat-ai/aleix/tavus-missing-daily-callback
...
TavusTransport: add missing on_before_leave callback
2025-09-24 11:10:32 -07:00
Aleix Conchillo Flaqué
6c2c43ade0
Merge pull request #2724 from pipecat-ai/pk/update-natural-conversation-examples-with-universal-context
...
Update natural conversation examples with universal context
2025-09-24 11:07:50 -07:00
Aleix Conchillo Flaqué
f899c15b03
Merge pull request #2731 from pipecat-ai/pk/update-example-25-to-use-universal-context
...
Update example 25 to use universal `LLMContext`
2025-09-24 11:05:36 -07:00
Aleix Conchillo Flaqué
d10ef08775
Merge pull request #2727 from pipecat-ai/pk/strands-agents-needs-to-support-openaillmcontextframe-for-now
...
`StrandsAgentsProcessor` should still support `OpenAILLMContextFrame`…
2025-09-24 11:05:07 -07:00
Aleix Conchillo Flaqué
27a5af6fa1
Merge pull request #2728 from pipecat-ai/pk/fix-playht-in-env-example
...
Fix PlayHT env variable names in env.example
2025-09-24 11:04:55 -07:00
Aleix Conchillo Flaqué
4bff0a7c49
Merge pull request #2732 from pipecat-ai/pk/update-voicemail-detector-to-use-llm-context
...
Update `VoicemailDetector` to use universal `LLMContext`
2025-09-24 11:04:42 -07:00
Aleix Conchillo Flaqué
508f7d203d
Merge pull request #2729 from pipecat-ai/aleix/frame-processor-cancel-default-timeout
...
FrameProcessor: timeout when cancelling tasks
2025-09-24 10:55:52 -07:00
Filipi da Silva Fuchter
0f87d5342c
Merge pull request #2266 from pipecat-ai/filipi/hey_gen_transport
...
HeyGen implementation for Pipecat - HeyGenTransport
2025-09-24 14:35:50 -03:00
Filipi Fuchter
f6164e3bde
HeyGen implementation for Pipecat - HeyGenTransport.
2025-09-24 14:33:56 -03:00
Aleix Conchillo Flaqué
1a0fb55d0f
TavusTransport: add missing on_before_leave callback
2025-09-24 10:18:56 -07:00
Paul Kompfner
6d0beef944
Update VoicemailDetector to use universal LLMContext
2025-09-24 12:58:42 -04:00
Paul Kompfner
b9fd6b873b
Update comment in example 07b to reference LLMContext rather than OpenAILLMContext
2025-09-24 12:49:34 -04:00
Paul Kompfner
dea0f1791f
Update OpenAILLMAdapter.get_messages_for_logging() to truncate "input_audio" message data
2025-09-24 12:41:41 -04:00
Paul Kompfner
da66c38795
Update example 25 to use universal LLMContext
2025-09-24 12:37:29 -04:00
Paul Kompfner
912f8b96f0
Fix PlayHT env variable names in env.example
2025-09-24 11:24:35 -04:00
Aleix Conchillo Flaqué
f9eb447d82
FrameProcessor: timeout when cancelling tasks
2025-09-24 08:24:28 -07:00
Paul Kompfner
65f5fe8588
StrandsAgentsProcessor should still support OpenAILLMContextFrame until that frame has been deprecated
2025-09-24 11:05:27 -04:00
Paul Kompfner
817c77f3fe
Update SmallWebRTCTransport to pass a sender ID in the "on_app_message" event
2025-09-24 10:24:59 -04:00
Paul Kompfner
8896179b00
Update another "natural conversation" example to use universal LLMContext. Note that this one had to also be fixed in various ways, as it wasn't working.
2025-09-24 09:55:11 -04:00
Filipi da Silva Fuchter
463752360b
Merge pull request #2726 from pipecat-ai/mb/twilio-serializer-cleanup
...
Fixup for TwilioFrameSerializer
2025-09-24 10:45:38 -03:00
Paul Kompfner
66b7977a62
Make SmallWebRTCTransport adhere to the expected "on_app_message" event signature
2025-09-24 09:34:28 -04:00
Mark Backman
468de68aec
Fixup for TwilioFrameSerializer
2025-09-24 09:32:46 -04:00
Mark Backman
c4762c1a92
Merge pull request #2627 from jessieweiyi/main
...
Support TwilioFrameSerializer region/edge settings. Close #2625 .
2025-09-24 09:13:10 -04:00
Aleix Conchillo Flaqué
7f4d3a2f02
pyproject: updated sentry to 2.38.0
2025-09-23 19:12:03 -07:00
Jessie Wei
88614b312f
Merge branch 'pipecat-ai:main' into main
2025-09-24 10:23:52 +10:00
Jessie Wei
5b4655f45a
chore: Update per review comments
2025-09-24 00:22:56 +00:00
Aleix Conchillo Flaqué
d7c8f8df53
update CHANGELOG with AudioBufferProcessor fixes
2025-09-23 15:42:01 -07:00
Aleix Conchillo Flaqué
2571cb2e69
tests: fix formatting
2025-09-23 15:28:07 -07:00
Aleix Conchillo Flaqué
15782be27c
Merge pull request #2676 from golbin/main
...
Fix audio buffer flush and silence handling
2025-09-23 15:27:31 -07:00
Aleix Conchillo Flaqué
997e4b66c6
Merge pull request #2722 from pipecat-ai/aleix/strands-agents-update-and-evals
...
examples: update Strands Agents with universal context and add evals
2025-09-23 15:21:41 -07:00
Paul Kompfner
6ccbfd9b57
Update "natural conversation" examples to use universal LLMContext
2025-09-23 16:20:16 -04:00
Paul Kompfner
677f69971c
Add filters in 22b and 22c examples to prevent function call results triggering the "statement judge" LLM from running unnecessarily, and with the wrong system prompt, which would result in garbled output statements comprised of both LLMs outputs combined
2025-09-23 16:14:58 -04:00
Paul Kompfner
678dd22b8e
Add missing sender argument to a few "on_app_message" handlers in examples
2025-09-23 15:29:20 -04:00
kompfner
0bba02028d
Merge pull request #2721 from pipecat-ai/pk/update-persistent-storage-examples-to-use-universal-llmcontext
...
Update persistent conversation storage examples to use universal `LLM…
2025-09-23 15:18:21 -04:00
Aleix Conchillo Flaqué
620b1f785c
examples: update Strands Agents with universal context and add evals
2025-09-23 11:37:57 -07:00
Paul Kompfner
780e91eb91
Update persistent conversation storage examples to use universal LLMContext.
...
Note that `LLMContext` doesn't have a `get_messages_for_persistent_storage()`; the messages are already in the "standard" format so they can be used directly for storage.
2025-09-23 14:16:35 -04:00
Aleix Conchillo Flaqué
667569ef47
Merge pull request #2708 from pipecat-ai/aleix/base-output-transport-only-push-if-send-successful
...
BaseOutputTransport: only push downstream if transport write successful
2025-09-23 11:10:29 -07:00
Aleix Conchillo Flaqué
17ea0afa6f
StrandsAgentsProcessor: more formatting fixes
2025-09-23 11:05:14 -07:00
Aleix Conchillo Flaqué
3fc5214c15
BaseOutputTransport: only push downstream if transport write successful
...
Fixes #2589
2025-09-23 11:04:37 -07:00
kompfner
1636c48ab9
Merge pull request #2720 from pipecat-ai/pk/update-changelog-with-additional-llmcontext-support
...
Update CHANGELOG with additional `LLMContext` support
2025-09-23 13:46:20 -04:00
Paul Kompfner
c3a2fa100c
Update CHANGELOG with additional LLMContext support
2025-09-23 13:45:49 -04:00
kompfner
8649368337
Merge pull request #2719 from pipecat-ai/pk/update-more-examples-to-use-universal-llmcontext
...
Update more examples to use universal `LLMContext`. Specifically, upd…
2025-09-23 13:44:20 -04:00
Aleix Conchillo Flaqué
781366627c
updated CHANGELOG with Strands Agents
2025-09-23 10:41:35 -07:00
Aleix Conchillo Flaqué
f6b4db42ef
pyproject: add strands-agents
2025-09-23 10:39:06 -07:00
Aleix Conchillo Flaqué
ed64716219
StrandsAgentsProcessor: fix formatting
2025-09-23 10:38:31 -07:00
Aleix Conchillo Flaqué
5c22b2e1de
Merge pull request #2610 from adithyaxx/add-strands-processor
...
Add native Strands Agents support to Pipecat
2025-09-23 10:33:22 -07:00
Paul Kompfner
d4b1e1ab41
Update more examples to use universal LLMContext. Specifically, update examples we didn't update before because they weren't using ToolsSchema for their tool definitions, which is a requirement for using LLMContext.
...
NOTE: oops! Turns out some of these files had *already* been updated to use universal `LLMContext` even though they weren't yet using `ToolsSchema`. This commit should fix those examples.
2025-09-23 12:41:35 -04:00
Mark Backman
fafe0cc4a3
Merge pull request #2718 from lshaun/fix-openai-deprecation-warning
...
update imports to avoid deprecated module
2025-09-23 12:29:16 -04:00
Mark Backman
40c82a8530
Merge pull request #2716 from pipecat-ai/mb/add-11labs-stt
...
Add ElevenLabsSTTService
2025-09-23 12:21:08 -04:00
lshaun
98d3686861
update imports to avoid deprecated module
2025-09-23 15:58:09 +00:00
kompfner
88337fc21f
Merge pull request #2717 from pipecat-ai/pk/mem0-support-univeral-context
...
Add support for universal `LLMContext` to `Mem0MemoryService`
2025-09-23 11:54:55 -04:00
kompfner
928c0ef1b4
Merge pull request #2715 from pipecat-ai/pk/langchain-processor-support-univeral-context
...
Add support for universal `LLMContext` to `LangchainProcessor`
2025-09-23 11:54:44 -04:00
kompfner
1f005e7075
Merge pull request #2714 from pipecat-ai/pk/gated-openai-llm-context-aggregator-support-univeral-context
...
Add support for universal `LLMContext` to `GatedOpenAILLMContextAggre…
2025-09-23 11:54:26 -04:00
kompfner
2cee6229ae
Merge pull request #2713 from pipecat-ai/pk/log-observer-support-univeral-context
...
Add support for universal `LLMContext` to `LLMLogObserver`
2025-09-23 11:54:11 -04:00
Aleix Conchillo Flaqué
10e9371f49
Merge pull request #2712 from pipecat-ai/aleix/pipeline-runner-signals-windows
...
PipelineRunner: use signal.signal() on Windows
2025-09-23 08:28:26 -07:00
Paul Kompfner
e21ab89509
Add support for universal LLMContext to Mem0MemoryService
2025-09-23 10:35:54 -04:00
Mark Backman
cbce2075eb
Add ElevenLabsSTTService
2025-09-23 10:27:31 -04:00
Paul Kompfner
97868175e6
Add support for universal LLMContext to LangchainProcessor
2025-09-23 10:00:48 -04:00
Paul Kompfner
99731ca40a
Add support for universal LLMContext to GatedOpenAILLMContextAggregator, renaming it to GatedLLMContextAggregator in the process
2025-09-23 09:52:13 -04:00
Paul Kompfner
f96cbcce22
Add support for universal LLMContext to LLMLogObserver
2025-09-23 09:30:14 -04:00
kompfner
a19b9f70c0
Merge pull request #2706 from pipecat-ai/pk/update-examples-to-use-universal-llm-context
...
Update examples, wherever possible, to use `LLMContext` and associate…
2025-09-23 09:20:39 -04:00
Filipi da Silva Fuchter
9b4f1bdf39
Merge pull request #2705 from tzookb/tzookb/latency-logging
...
update UserBotLatencyLogObserver to have logging in functions that can be overidden
2025-09-23 09:46:20 -03:00
Filipi Fuchter
6b2bf8de64
Fixing the ruff format and making the methods sync.
2025-09-23 09:41:50 -03:00
Filipi da Silva Fuchter
33481c6614
Merge pull request #2672 from pipecat-ai/filipi/pcc_small_webrtc_2
...
Monitoring the peer connection while it is in the *connecting* state.
2025-09-23 08:32:16 -03:00
Filipi Fuchter
a5776b20ad
Monitoring the peer connection while it is in the *connecting* state.
2025-09-23 08:30:17 -03:00
Filipi da Silva Fuchter
e286e015cf
Merge pull request #2687 from pipecat-ai/memory_leak
...
Improving memory cleanup
2025-09-23 08:13:05 -03:00
Filipi Fuchter
a7bfac8d68
Mentioning the memory cleanups in the changelog.
2025-09-23 08:09:31 -03:00
Filipi Fuchter
1647b5b665
Created a new example using the video processor to make it easier to investigate memory leaks.
2025-09-23 08:05:28 -03:00
Filipi Fuchter
eaecefe675
Refactoring how we are reading the image bytes inside the base llm.
2025-09-23 08:05:15 -03:00
Filipi Fuchter
7c569b3863
Calling task_done when reading the audio from the queue.
2025-09-23 08:04:06 -03:00
Filipi Fuchter
8bf6a4c66f
Improving memory cleanup inside the SmallWebRTCTransport.
2025-09-23 08:03:55 -03:00
Filipi Fuchter
1df3660186
Not storing anymore the last frames received to display them in the idle processor.
2025-09-23 08:03:35 -03:00
Aleix Conchillo Flaqué
75c0b089e0
PipelineRunner: use signal.signal() on Windows
2025-09-22 22:38:12 -07:00
Aleix Conchillo Flaqué
d8f3d4dd32
Merge pull request #1874 from nischalj10/patch-1
...
added deepwiki badge for weekly repo refresh
2025-09-22 17:44:08 -07:00
Aleix Conchillo Flaqué
c5e53bb84f
Merge pull request #2707 from pipecat-ai/aleix/daily-transport-deprecated-mistake
...
DailyTransport: remove deprecated note and double registration
2025-09-22 17:01:09 -07:00
Aleix Conchillo Flaqué
b04e494373
DailyTransport: remove deprecated note and double registration
2025-09-22 16:45:58 -07:00
Jessie Wei
392293d55f
Merge branch 'pipecat-ai:main' into main
2025-09-23 07:48:45 +10:00
Paul Kompfner
272532a3ea
Update examples, wherever possible, to use LLMContext and associated machinery instead of OpenAILLMContext and associated machinery.
...
With all these examples updated, we no longer need dedicated examples illustrating `LLMContext`, so they're removed.
Here’s where we *don’t* yet use `LLMContext` and associated machinery:
- Realtime services: OpenAI Realtime, Gemini Live, and AWS Nova Sonic (support coming soon)
- `GoogleLLMOpenAIBetaService` (it’s deprecated, so we didn’t bother adding support)
- `LLMLogObserver` (support coming soon)
- `GatedOpenAILLMContextAggregator` (support coming soon)
- `LangchainProcessor` (support coming soon)
- `Mem0MemoryService` (support coming soon)
- Examples that use LLM-specific tools definitions as opposed to `ToolsSchema` (these will be updated soon)
- Examples that rely `GoogleLLMContext.upgrade_to_google` (TBD what to do with these)
Examples that use `LLMLogObserver`:
- 30-
Examples that use `GatedOpenAILLMContextAggregator`:
- 22-
Examples that use `LangchainProcessor`:
- 07b-
Examples that use `Mem0MemoryService`:
- 37-
Examples that need updating to use `ToolsSchema`:
- 15-
- 15a-
- 20a-
- 20c-
- 20d-
- 22b-
- 22c-
- 33-
- 36-
Examples that use `GoogleLLMContext.upgrade_to_google`:
- 22d-
- 25-
2025-09-22 16:21:35 -04:00
Tzook Bar Noy
3d04f565ec
update latency observer logging to be in unique funcs, so others could extend and overwrite
2025-09-22 15:38:29 -04:00
Filipi da Silva Fuchter
d0477edb6a
Merge pull request #2696 from pipecat-ai/filipi/inworld_default_temperature
...
Changing InworldTTSService default temperature to 1.1
2025-09-22 09:33:52 -03:00
Filipi Fuchter
326bfe4239
Removing the temperature from InworldTTSService example.
2025-09-22 09:30:53 -03:00
Aleix Conchillo Flaqué
3cb78d839d
examples(foundational): update comment in 45-before-and-afet-events.py
2025-09-20 10:33:52 -07:00
Aleix Conchillo Flaqué
9129e44c05
Merge pull request #2697 from pipecat-ai/aleix/frame-processor-before-after-events
...
FrameProcessor: add before/after events for processed/pushed frames
2025-09-20 10:26:37 -07:00
Aleix Conchillo Flaqué
ec664e2d33
examples(foundational): added 45-before-and-afet-events.py
2025-09-20 10:23:49 -07:00
Aleix Conchillo Flaqué
3d88b42e0b
FrameProcessor: add before/after events for processed/pushed frames
2025-09-19 20:47:21 -07:00
Aleix Conchillo Flaqué
2289409b4c
Merge pull request #2699 from pipecat-ai/aleix/daily-on-before-leave
...
DailyTransport: rename on_before_leave to on_before_disconnect
2025-09-19 20:38:46 -07:00
Aleix Conchillo Flaqué
b1551b0d6b
DailyTransport: rename on_before_leave to on_before_disconnect
2025-09-19 19:21:31 -07:00
Mark Backman
7cb5c951f4
Merge pull request #2689 from pipecat-ai/mb/foundational-smart-turn
...
Update quickstart and foundational examples to use smart-turn v3
2025-09-19 15:39:14 -07:00
mattie ruth backman
a2cb5ab8e1
Add Changelong entry
2025-09-19 17:46:29 -04:00
mattie ruth backman
cad3104d56
Fix _handle_send_text to use default options if not provided
2025-09-19 17:46:29 -04:00
mattie ruth backman
d8a2a917a2
Deprecate append-to-text handling in favor of new send-text with support for toggling skip-tts while handling the text
2025-09-19 17:46:29 -04:00
chadbailey59
3984cb58a2
cleared input and process events when pausing ( #2698 )
2025-09-19 16:44:43 -05:00
chadbailey59
9027a96a07
Add remote participant updates to DailyTransport ( #2694 )
...
* add remote participant updates to DailyTransport
* cleanup
* cleanup
* ruff cleanup again
2025-09-19 16:03:34 -05:00
Aleix Conchillo Flaqué
6abac3e3e5
Merge pull request #2673 from pipecat-ai/aleix/sync-event-handlers
...
introduce synchronous event handlers
2025-09-19 13:40:43 -07:00
Aleix Conchillo Flaqué
077b949bb2
BaseObject: run each handler for the same event in a separate task
2025-09-19 13:32:39 -07:00
Aleix Conchillo Flaqué
3a6c9786e8
LiveKitTransport: added synchronous before_disconnect event
2025-09-19 13:32:39 -07:00
Aleix Conchillo Flaqué
492da16cc9
DailyTransport: added synchronous on_before_disconnect event
2025-09-19 13:32:39 -07:00
Aleix Conchillo Flaqué
a698c4064b
BaseObject: allow synchronous event handlers
2025-09-19 13:32:39 -07:00
Filipi Fuchter
9e098b5f79
Changing InworldTTSService default temperature to 1.1
2025-09-19 17:03:53 -03:00
Mark Backman
7df7395dd1
Merge pull request #2692 from pipecat-ai/mb/lazy-load-smallwebrtc-request
...
Lazy load SmallWebRTCRequest, SmallWebRTCRequestHandler in runner
2025-09-19 10:43:43 -07:00
Mark Backman
0885bc9cdf
Lazy load SmallWebRTCRequest, SmallWebRTCRequestHandler in runner
2025-09-19 13:28:01 -04:00
vipyne
889dc19a27
mcp examples: check for env vars needed for examples
2025-09-19 12:09:50 -05:00
Mark Backman
4bc41466b7
Bump quickstart pipecat-ai version to require smart-turn v3, add local smart-turn dep, update quickstart
2025-09-19 08:03:06 -04:00
Mark Backman
9ab8ddee79
Update quickstart and foundational examples to use smart-turn v3
2025-09-18 23:54:18 -04:00
Aleix Conchillo Flaqué
0204f6a95d
Merge pull request #2686 from pipecat-ai/aleix/silero-vad-v6
...
audio(vad): update Silero VAD model to v6
2025-09-18 20:31:10 -07:00
Mark Backman
b0bf653f04
Merge pull request #2679 from pipecat-ai/mb/gladia-remove-confidence
...
GladiaSTTService: deprecate confidence arg
2025-09-18 17:41:33 -07:00
Mark Backman
e8a676eb36
GladiaSTTService: deprecate confidence arg
2025-09-18 20:38:53 -04:00
Mark Backman
ca96eef1f3
Merge pull request #2680 from pipecat-ai/mb/dial-in-session-id
...
DailyTransport sip_call_transfer now automatically receives session_id
2025-09-18 17:36:51 -07:00
Mark Backman
8e1637d6c7
DailyTransport sip_call_transfer now automatically receives session_id
2025-09-18 20:34:14 -04:00
Filipi da Silva Fuchter
367200c0ad
Merge pull request #2682 from pipecat-ai/filipi/smallwebrtc_leak
...
Smallwebrtc memory leak
2025-09-18 18:56:08 -03:00
Filipi Fuchter
766e1948a6
Mentioning the fix in the changelog.
2025-09-18 18:43:33 -03:00
Aleix Conchillo Flaqué
f369683b8b
audio(vad): update Silero VAD model to v6
2025-09-18 14:06:37 -07:00
Aleix Conchillo Flaqué
461025d1cc
Merge pull request #2684 from pipecat-ai/aleix/readme-whisker
...
README: add whisker debugger
2025-09-18 13:27:35 -07:00
Aleix Conchillo Flaqué
ac88706f38
README: add whisker debugger
2025-09-18 13:22:54 -07:00
Filipi Fuchter
93a89449b8
Adding warnings in case queue grows.
2025-09-18 16:43:57 -03:00
Filipi Fuchter
199bf72945
Preventing memory growth if we are not consuming the track.
2025-09-18 16:16:10 -03:00
Filipi Fuchter
d20e4125f6
Updating aiortc to the latest version.
2025-09-18 15:22:46 -03:00
Filipi Fuchter
c1baed642e
Script to monitor memory usage.
2025-09-18 14:43:42 -03:00
Mark Backman
33ef68573f
Merge pull request #2662 from pelguetat/fix-vertex-ai-global-location-support
...
feat: add support for global location in Vertex AI base URL
2025-09-18 10:25:10 -07:00
Pablo Elgueta
3c1b41df13
docs: add changelog entry for global location support
...
- Document the new global location support in GoogleVertexLLMService
- Explain the difference between regional and global API hosts
- Follow Keep a Changelog format
2025-09-18 17:39:03 +01:00
Jin Kim
58f70e7e0d
Add tests for audio buffer processor flush alignment
2025-09-18 22:19:32 +09:00
kompfner
fca4ecc73c
Merge pull request #2675 from pipecat-ai/pk/service-switcher-logic-simplification
...
Simplify a bit of logic in `ServiceSwitcher`
2025-09-18 09:17:22 -04:00
Jin Kim
d0b573e44f
Fix audio buffer flush and silence handling
2025-09-18 19:40:45 +09:00
Paul Kompfner
cfa333508b
Simplify a bit of logic in ServiceSwitcher
2025-09-17 21:03:38 -04:00
Mark Backman
9e7260393a
Merge pull request #2671 from pipecat-ai/mb/fix-asyncai-ttstextframe
...
fix: AsyncAITTSService wasn't pushing TTSTextFrames
2025-09-17 14:06:41 -07:00
Mark Backman
073b585c52
fix: AsyncAITTSService wasn't pushing TTSTextFrames
2025-09-17 16:54:18 -04:00
Aleix Conchillo Flaqué
81c2e51bec
Merge pull request #2669 from pipecat-ai/aleix/interruption-task-frame-wait-fixes
...
interruption task frame wait fixes
2025-09-17 13:47:57 -07:00
Aleix Conchillo Flaqué
42344125b1
tests: add unit tests for push_interruption_task_frame_and_wait()
2025-09-17 13:38:22 -07:00
Aleix Conchillo Flaqué
db5bcfaa51
FrameProcessor: fix push_interruption_task_frame_and_wait()
2025-09-17 13:38:21 -07:00
kompfner
615239b7d2
Merge pull request #2646 from pipecat-ai/pk/service-switcher-unit-tests
...
`ServiceSwitcher` unit tests (ended up being much more than that)
2025-09-17 16:30:18 -04:00
Paul Kompfner
27f1e9dd69
Update CHANGELOG with a description of the recently-fixed ServiceSwitcher bugs
2025-09-17 16:27:12 -04:00
Paul Kompfner
bd760deff2
Update comment with more detail for posterity
2025-09-17 16:19:31 -04:00
Paul Kompfner
8bc3c89140
Fix a bug preventing usage of multiple ServiceSwitchers in a pipeline
2025-09-17 16:09:18 -04:00
Paul Kompfner
2cd2567a37
Add a unit tests validating that multiple ServiceSwitchers can be used in the same pipeline (currently failing)
2025-09-17 16:04:30 -04:00
Paul Kompfner
5b55988846
Denote a couple of variables are private with a leading underscore
2025-09-17 15:38:28 -04:00
Paul Kompfner
a12392182c
Simplify, undoing the change allowing controlling ServiceSwitcher with immediate frames (SystemFrames). Service switcher frames are ControlFrames, which are easier to reason about. We can always build the immediate option later if needed (i.e. if there's sufficient user pull for it)
2025-09-17 15:35:02 -04:00
Paul Kompfner
b814b70e1e
Allow controlling ServiceSwitcher with either immediate frames (SystemFrames) or in-order frames (ControlFrames).
...
Immediate is the "default", i.e. has the more obvious name (e.g. `ManuallySwitchServiceFrame` v `ManuallySwitchServiceControlFrame`), since that's *probably* what users will want to reach for. Also, the immediate frames are more likely to behave like what we had before the last few commits, where the service switch would always "jump the queue" by having an immediate effect once it hit the `ServiceSwitcher` in the pipeline, jumping ahead of frames in front of it destined for the service.
2025-09-17 15:35:02 -04:00
Paul Kompfner
a1f84e1b50
Remove extraneous unit tests
2025-09-17 15:35:02 -04:00
Paul Kompfner
0839b48da8
Fix an issue where the upstream ServiceSwitcherFilter wouldn't get updated with the current active service
2025-09-17 15:35:02 -04:00
Paul Kompfner
de51637b77
Update ServiceSwitcher so that ServiceSwitcherFrames (which might update the currently active service) are processed and have an effect at the expected time. We should be able to, for example, queue:
...
- A text frame
- A `ManuallySwitchServiceFrame` (which is a `ServiceSwitcherFrame`)
- Another text frame
And expect that the first text frame be handled by the initially active service and the second text frame be handled by the newly active one.
Previously, the `ManuallySwitchServiceFrame` would have an effect too early, causing both text frames to be handled by the newly active service. Why? Because the frame filtering condition was being updated *directly* by the `ServiceSwitcher`, which is upstream from the services it's switching between. It could therefore update the filters *before* the services received the prior frames.
2025-09-17 15:35:02 -04:00
Paul Kompfner
e1b1dc16ec
Add unit tests for ServiceSwitcher
2025-09-17 15:35:02 -04:00
Mark Backman
1fe27eb0a2
Merge pull request #2660 from pipecat-ai/mb/fix-user-idle-processor-cancel-task
...
fix: clean up how UserIdleProcessor handles return False
2025-09-16 14:48:59 -07:00
Mark Backman
d7e1389497
fix: clean up how UserIdleProcessor handles return False
2025-09-16 17:44:06 -04:00
Aleix Conchillo Flaqué
8c7230aa8f
Merge pull request #2668 from pipecat-ai/aleix/livekit-update
...
livekit package update
2025-09-16 14:43:18 -07:00
Aleix Conchillo Flaqué
2cf71239b0
examples(01b): use TTSSpeakFrame instead of TextFrame
2025-09-16 17:18:45 -04:00
Aleix Conchillo Flaqué
ec2c62e32b
pyproject: update to livekit 1.0.13
...
Fixes #2643
2025-09-16 17:18:44 -04:00
Mark Backman
38ce85e9a0
Merge pull request #2667 from zytegalaxy/mcp-serverparameters-typefix
...
fix: replace `Tuple` type with `TypeAlias` for server params in MCP client
2025-09-16 14:14:59 -07:00
Mark Backman
2279e5a899
Merge pull request #2663 from pipecat-ai/mb/websockets-15
...
Add support for websockets 15.0
2025-09-16 14:08:36 -07:00
Mark Backman
cce6eb5d87
Merge pull request #2666 from pipecat-ai/mb/update-38b-local-turn-model
...
38b: Update bundled ONNX smart-turn model
2025-09-16 14:05:12 -07:00
mehrdad
c2b98ae557
fix(lint): fix space format issue
2025-09-16 13:44:15 -07:00
Filipi da Silva Fuchter
727eb12b16
Merge pull request #2648 from pipecat-ai/filipi/pcc_small_webrtc
...
Creating SmallWebRTCRequestHandler for managing peer connections.
2025-09-16 16:37:04 -03:00
mehrdad
ba96bd05d3
fix: replace Tuple type with TypeAlias for server params in MCP client
2025-09-16 11:44:25 -07:00
Mark Backman
8ead309f8d
38b: Update bundled ONNX smart-turn model
2025-09-16 13:17:14 -04:00
Mark Backman
fad0e55c64
Add websockets-base optional dependency and use for DRY pyproject.toml
2025-09-16 11:24:38 -04:00
Mark Backman
74b1af56a0
Update uv.lock
2025-09-16 11:21:49 -04:00
Mark Backman
6924850ec4
Add support for websockets 15.0
2025-09-16 11:21:49 -04:00
marcus-daily
dfe7815dc5
Smart Turn v3: removing torch and torchaudio deps
2025-09-16 16:02:41 +01:00
Pablo Elgueta
69f0a75882
feat: add support for global location in Vertex AI base URL
...
- Update _get_base_url method to handle 'global' location case
- Use 'aiplatform.googleapis.com' for global locations
- Use '{location}-aiplatform.googleapis.com' for regional locations
- Maintains backward compatibility with existing regional endpoints
2025-09-16 10:28:22 -03:00
Mark Backman
cca90791c4
Merge pull request #2652 from pipecat-ai/mb/fix-audio-buffer-processor-has-audio
...
fix: AudioBufferProcessor has_audio returns based on user or bot audi…
2025-09-15 18:43:59 -07:00
Mark Backman
f2a5d408de
fix: AudioBufferProcessor has_audio returns based on user or bot audio existing
2025-09-15 21:35:35 -04:00
Aleix Conchillo Flaqué
044c6eba46
Merge pull request #2655 from pipecat-ai/aleix/add-on-pipeline-finalized
...
PipelineTask: add on_pipeline_finished event
2025-09-15 15:32:04 -07:00
Aleix Conchillo Flaqué
db71089f5e
PipelineTask: add on_pipeline_finished event
...
This deprecates `on_pipeline_stopped`, `on_pipeline_ended` and
`on_pipeline_cancelled`.
2025-09-15 15:28:33 -07:00
Aleix Conchillo Flaqué
f861f5066f
Merge pull request #2654 from pipecat-ai/aleix/unify-on-client-disconnected
...
transports: on_client_disconnected only if remote client disconnects
2025-09-15 15:18:57 -07:00
kompfner
81cede2c60
Merge pull request #2653 from pipecat-ai/pk/llm-context-adapting-tests
...
`LLMContext`-adapting unit tests
2025-09-15 16:38:46 -04:00
kompfner
7603203230
Merge pull request #2644 from pipecat-ai/pk/run-inference-unit-tests
...
`run_inference` unit tests
2025-09-15 16:26:10 -04:00
Aleix Conchillo Flaqué
8569b61598
transports: on_client_disconnected only if remote client disconnects
2025-09-15 11:35:40 -07:00
Paul Kompfner
fe42187dc1
Implement LLMService.create_llm_specific_message() so that users don't need to just know what value of llm to provide to the LLMSpecificMessage constructor
2025-09-15 14:15:22 -04:00
Paul Kompfner
999e88c942
Add unit tests for AWSBedrockLLMAdapter.get_llm_invocation_params(), focusing on messages specifically
2025-09-15 12:08:21 -04:00
Paul Kompfner
c04df2f28b
Add unit tests for AnthropicLLMAdapter.get_llm_invocation_params(), focusing on messages specifically
2025-09-15 11:55:48 -04:00
Paul Kompfner
100ef0ab5c
Add unit tests for GeminiLLMAdapter.get_llm_invocation_params(), focusing on messages specifically
2025-09-15 11:38:23 -04:00
Paul Kompfner
42886d7105
Add unit tests for OpenAILLMAdapter.get_llm_invocation_params(), focusing on messages specifically. Also, fix a bug in OpenAILLMAdapter (found thanks to the unit tests) where it wasn't "unwrapping" LLMSpecificMessages.
2025-09-15 11:17:11 -04:00
Mark Backman
22cbba002a
Merge pull request #2651 from pipecat-ai/mb/heygen-bot-speaking-frame
...
fix: push BotStartedSpeakingFrame in HeyGenVideoService
2025-09-15 08:02:25 -07:00
Filipi Fuchter
0a043154f2
Removing not used import.
2025-09-15 10:46:43 -03:00
Filipi Fuchter
5e322eba9e
Supporting both single and multiple connection modes.
2025-09-15 10:43:46 -03:00
Filipi Fuchter
11d0c3d46d
Refactoring SmallWebRTCRequestHandler.
2025-09-15 09:58:44 -03:00
Mark Backman
c873798ce5
fix: push BotStartedSpeakingFrame in HeyGenVideoService
2025-09-14 08:12:44 -04:00
Filipi Fuchter
95f72f6dce
Creating SmallWebRTCRequestHandler for managing peer connections.
2025-09-12 18:15:24 -03:00
Aleix Conchillo Flaqué
d8cd28bb8b
Merge pull request #2640 from pipecat-ai/aleix/pipecat-0.0.85
...
update CHANGELOG for 0.0.85
2025-09-12 11:06:41 -07:00
Aleix Conchillo Flaqué
c2df6c8aee
update CHANGELOG for 0.0.85
2025-09-12 11:03:32 -07:00
Aleix Conchillo Flaqué
82478be861
scripts(evals): add 19b-openai-realtime-text
2025-09-12 11:03:32 -07:00
Aleix Conchillo Flaqué
0f2b7bc01b
examples(foundational): fix 19b-openai-realtime-beta-text
2025-09-12 11:03:32 -07:00
Aleix Conchillo Flaqué
1b2a5df017
Merge pull request #2622 from pipecat-ai/mb/call-data-runner
...
Add to, from phone info and custom data to the development runner
2025-09-12 10:28:17 -07:00
Mark Backman
2f496ac74f
Add optional body parameter to WebsocketRunnerArguments
2025-09-12 11:28:12 -04:00
Mark Backman
22633a63b0
Update changelog
2025-09-12 11:15:03 -04:00
Mark Backman
e5ed0424e4
Remove to/from data from Plivo, as it will rely on body information
2025-09-12 11:10:03 -04:00
Paul Kompfner
786387722a
Fix an issue in AWSBedrockLLMService.run_inference—exceptions should propagate, just like with other LLM services
2025-09-12 11:09:32 -04:00
Paul Kompfner
9f82c6b4a4
Add unit tests for run_inference
2025-09-12 11:07:11 -04:00
Mark Backman
99cfcb1d4e
Parsed custom data from Plivo extraHeaders
2025-09-12 08:11:30 -04:00
Mark Backman
d595676436
Add custom data handling for Twilio
2025-09-12 08:11:30 -04:00
Aleix Conchillo Flaqué
0190812ee8
Merge pull request #2639 from pipecat-ai/aleix/min-words-interruption-unit-test
...
MinWordsInterruptionStrategy unit test
2025-09-11 18:52:39 -07:00
Aleix Conchillo Flaqué
2a24061bbb
examples(07ad): remove deprecated user_continuous_stream
2025-09-11 18:50:00 -07:00
Aleix Conchillo Flaqué
89f7e7d199
update CHANGELOG with BaseOutputTransport fix
2025-09-11 16:58:44 -07:00
Aleix Conchillo Flaqué
384814e640
Merge pull request #2456 from a6kme/patch-1
...
Only set last_frame_time when handling OutputAudioRawFrame
2025-09-11 16:56:25 -07:00
Aleix Conchillo Flaqué
ab4364b833
update CHANGELOG and fix formatting
2025-09-11 15:34:47 -07:00
Aleix Conchillo Flaqué
fafdadad3c
Merge pull request #2473 from TheNotary/adds-interim-transcription-frame-support
...
adds support to Azure STT for creating InterimTranscriptFrames
2025-09-11 15:33:38 -07:00
Aleix Conchillo Flaqué
05dc2fa916
updated CHANGELOG.md with GoogleTTSService updates
2025-09-11 14:36:21 -07:00
Aleix Conchillo Flaqué
0c30cc6ea6
Merge pull request #2547 from manishkjs/feat/google-tts-voice-cloning
...
feat: add voice cloning and speaking rate to GoogleTTSService
2025-09-11 14:32:21 -07:00
Aleix Conchillo Flaqué
c26d336e34
Merge pull request #2545 from pipecat-ai/aleix/aws-nova-sonic-pre-load-cue
...
AWSNovaSonicLLMService: pre-load audio cue in the constructor
2025-09-11 14:31:26 -07:00
Mark Backman
37b6198787
Merge pull request #2635 from pipecat-ai/mb/openai-tts-speed
2025-09-11 14:22:51 -07:00
kompfner
3c271da94c
Merge pull request #2633 from pipecat-ai/pk/uv-readme-updates
...
Updating the README to reflect that:
2025-09-11 17:07:41 -04:00
kompfner
be28d3f93b
Merge pull request #2637 from pipecat-ai/pk/llm-context-evals-and-bug-fix
...
`LLMContext` evals and bug fix
2025-09-11 17:00:07 -04:00
marcus-daily
d2f210e960
Bundle Smart Turn v3 with Pipecat
2025-09-11 21:37:16 +01:00
Aleix Conchillo Flaqué
57add41971
tests: add unit test for MinWordsInterruptionStrategy
2025-09-11 13:07:30 -07:00
Aleix Conchillo Flaqué
74b38b59d6
tests(utils): allow passing PipelineParams to run_test()
2025-09-11 13:02:21 -07:00
kompfner
dac58deffc
Merge pull request #2636 from pipecat-ai/pk/uv-lock-update-for-smart-turn-v3
...
uv.lock update for Smart Turn v3
2025-09-11 14:35:36 -04:00
Paul Kompfner
aff11f5121
Fix missing import in llm_response_universal.py
2025-09-11 14:33:17 -04:00
Paul Kompfner
a4023d3915
Update evals to include examples that exercise the universal LLMContext
2025-09-11 14:32:56 -04:00
Paul Kompfner
d6543d244d
uv.lock update for Smart Turn v3
2025-09-11 14:07:17 -04:00
Mark Backman
fafcd79870
OpenAITTSService: add speed arg
2025-09-11 13:53:52 -04:00
Paul Kompfner
6a717fbbd1
Updating the README to reflect that:
...
- various dependencies that previously didn't work with Python 3.13 now seem to
- ultravox isn't fully supported on macOS
2025-09-11 12:27:43 -04:00
Aleix Conchillo Flaqué
9b3f6927c2
Merge pull request #2621 from pipecat-ai/aleix/interruption-task-frame
...
interruption task frame
2025-09-11 09:22:35 -07:00
Aleix Conchillo Flaqué
0b21f8a6bd
FrameProcessor: add push_interruption_task_frame_and_wait()
2025-09-11 09:19:44 -07:00
Aleix Conchillo Flaqué
8249b014f0
frames: BotInterruptionFrame is deprecated, use InterruptionTaskFrame
2025-09-11 09:01:54 -07:00
Aleix Conchillo Flaqué
9d9f10ae0e
frames: StartInterruptionFrame is deprecated, use InterruptionFrame
2025-09-11 09:01:54 -07:00
Aleix Conchillo Flaqué
e27b23694d
frames: add new TaskFrame
...
TaskFrame is a base class for other frames that are meant to be sent to the
pipeline task.
2025-09-11 09:01:52 -07:00
marcus-daily
66ce5fe6bd
Ruff fixes
2025-09-11 16:04:56 +01:00
marcus-daily
a9b53dc800
Update inference session options
2025-09-11 16:04:56 +01:00
marcus-daily
818352a300
Formatting
2025-09-11 16:04:56 +01:00
marcus-daily
3e9fc7be19
Update onnxruntime version
2025-09-11 16:04:56 +01:00
marcus-daily
a2e76bcad8
Smart Turn V3 support
2025-09-11 16:04:56 +01:00
Mark Backman
8e8e42717b
Add to and from phone information to the development runner
2025-09-11 10:44:21 -04:00
kompfner
b31322e38e
Merge pull request #2619 from pipecat-ai/pk/aws-universal-context
...
Expand universal `LLMContext` support to AWS Bedrock
2025-09-11 09:33:08 -04:00
Jessie Wei
305108be9a
[TwilioFrameSerializer]: Add parameter validation
2025-09-10 23:00:15 +00:00
Aleix Conchillo Flaqué
908325484d
Merge pull request #2614 from pipecat-ai/aleix/readme-client-sdks-table
...
README: update clients' table
2025-09-10 10:21:18 -07:00
Mark Backman
dd6ff789c7
Merge pull request #2628 from pipecat-ai/mb/fix-13-push-frame
...
fix: 13 foundational examples now push frames from TranscriptionLogger
2025-09-10 09:13:04 -07:00
Mark Backman
f4938e0fad
fix: 13 foundational examples now push frames from TranscriptionLogger
2025-09-10 10:40:10 -04:00
Jessie Wei
2e1f397d17
Support TwilioFrameSerializer region/edge settings to that the call is terminated successfully for regions other than default us1 region
2025-09-10 14:30:10 +00:00
James Hush
e8f60c7c6f
Handle missing rawResponse in transcription messages ( #2623 )
...
* Handle missing rawResponse in transcription messages
- Use message.get('rawResponse', {}) to safely access rawResponse field
- Default is_final to False when rawResponse is missing
- Add proper type annotations for better code clarity
- Minor import formatting cleanup
This prevents KeyError crashes when transcription messages from Daily's API
don't include the rawResponse field in edge cases.
* docs: add changelog line
2025-09-10 15:03:23 +08:00
Paul Kompfner
fedb8a201f
Update 12d example to use LLMContext, now that AWS Bedrock supports it
2025-09-09 16:24:13 -04:00
Paul Kompfner
8ccd220a60
Add universal LLMContext support to AWSBedrockLLMService.run_inference()
2025-09-09 16:00:32 -04:00
Paul Kompfner
fe79de8f27
When converting universal LLMContext messages to AWS Bedrock expected format, automatically update non-initial "system"-role messages to "user"-role messages, as we do in other non-OpenAI LLM services
2025-09-09 15:50:03 -04:00
Paul Kompfner
176573c342
Add to CHANGELOG AWS Bedrock's support for universal LLMContext
2025-09-09 15:31:56 -04:00
Paul Kompfner
75f9914f49
Add support for universal LLMContext to AWS Bedrock LLM service
2025-09-09 15:25:04 -04:00
Paul Kompfner
f4d6715e32
Add foundational example using AWS Bedrock with universal LLMContext
2025-09-09 10:49:51 -04:00
kompfner
38f6e33f97
Merge pull request #2598 from pipecat-ai/pk/deprecate-vision-image-raw-frame
...
Remove `VisionImageRawFrame`, which was previously being handled dire…
2025-09-08 17:13:28 -04:00
Paul Kompfner
1c3e4e34e5
Minor fix to AWS Bedrock console logging to handle image messages in the context
2025-09-08 17:10:11 -04:00
Paul Kompfner
623c660027
Remove debugging comment
2025-09-08 17:01:51 -04:00
Paul Kompfner
a3e65ab3b5
The VisionImageRawFrame removal and corresponding VisionImageFrameAggregator deprecation will now happen in version 0.0.85
2025-09-08 17:01:47 -04:00
Paul Kompfner
f3a4b416df
Remove VisionImageRawFrame, which was previously being handled directly by the LLM services, and deprecate the associated VisionImageFrameAggregator.
...
Removing `VisionImageRawFrame` lets us simplify LLM services' logic, getting us closer to the idealized architecture where all they care about is handling context frames.
This change is in service of getting us closer to ready to deprecate usage of `OpenAILLMContext` and subclasses in favor of the universal `LLMContext`, at least for the traditional text-to-text LLMs.
Why remove `VisionImageRawFrame` rather than deprecate? It's "internal"—only created by `VisionImageFrameAggregator`—and never intended to be used directly by users (it would be difficult to use directly anyway).
Move the logic that was once in `VisionImageFrameAggregator` directly into the examples. Reasoning:
- If `UserImageRequester` is defined in the examples, it makes sense for `UserImageProcessor` to be too, as it’s the flip side of the same coin, so to speak
- The logic is now pretty trivial
- This kind of one-shot, history-less image-describing pipeline shouldn't be common at all; it's ok for it to live in examples rather than as a dedicated class
- In the short term, this enables us to create `LLMContext`s for services that support it and `OpenAILLMContext`s for services that don't yet (AWS)
This commit also adds missing translation from OpenAI-format image context messages to AWS format. Note that this isn't a wasted effort in the face of the upcoming migration to universal `LLMContext`—this work will be reused as it has to be implemented there too.
2025-09-08 17:00:08 -04:00
Aleix Conchillo Flaqué
aa471a4ef5
update CHANGELOG with LiveKitTransport updates
2025-09-08 13:53:21 -07:00
Aleix Conchillo Flaqué
d55133a44f
Merge pull request #2604 from alexyzhou/feature/livekit_video_and_bug_fix
...
Feature: Add support for livekit video stream and minor bug fixes
2025-09-08 13:51:14 -07:00
Aleix Conchillo Flaqué
0f1cf81691
README: update clients' table
2025-09-08 12:08:32 -07:00
kompfner
ac4d335799
Merge pull request #2613 from pipecat-ai/pk/mistral-message-fixups
...
Apply additional fixups to context messages to meet Mistral-specific …
2025-09-08 13:59:54 -04:00
Paul Kompfner
e65385c151
Tweak the Mistral-specific context messages fixup logic to handle the (mostly academic) possibility of a "tool" message appearing at the end
2025-09-08 13:55:09 -04:00
Paul Kompfner
0bb7df7a6b
Remove stray debugging message
2025-09-08 13:38:26 -04:00
Paul Kompfner
daee1ddf3b
Apply additional fixups to context messages to meet Mistral-specific requirements
2025-09-08 11:26:58 -04:00
Adithya Suresh
d1f72c1c0b
Added usage metrics
2025-09-08 14:44:25 +10:00
Aleix Conchillo Flaqué
1cccb97ccf
Merge pull request #2608 from pipecat-ai/aleix/deprecate-noisereducefilter
...
audio(filters): deprecate NoisereduceFilter
2025-09-07 20:54:09 -07:00
Aleix Conchillo Flaqué
d7794abf21
audio(filters): deprecate NoisereduceFilter
2025-09-07 20:52:17 -07:00
Aleix Conchillo Flaqué
6a6a63a532
Merge pull request #2607 from pipecat-ai/aleix/scripts-evals-improve-eval-prompt
...
scripts(evals): allow user to talk and only eval when needed
2025-09-07 20:49:43 -07:00
Mark Backman
6edb6fed41
Merge pull request #2606 from pipecat-ai/mb/quickstart-lockfile
...
Remove uv.lock from quickstart
2025-09-07 06:10:14 -07:00
Mark Backman
a537382816
Add OpenAIRealtimeLLMService, AzureRealtimeLLMService ( #2596 )
...
* Add OpenAI Realtime module
* Add foundational examples for OpenAI Realtime
* Add deprecation warning to OpenAIRealtimeBetaLLMService
* Add deprecation warning to AzureRealtimeBetaLLMService
* Update Changelog
2025-09-07 09:09:57 -04:00
Aleix Conchillo Flaqué
46deaada70
scripts(evals): allow user to talk and only eval when needed
2025-09-06 19:19:08 -07:00
TheNotary
7366b1aee0
adds missing InterimTranscriptionFrame import
2025-09-06 14:40:19 -05:00
Mark Backman
dbc52bc6b0
Remove uv.lock from quickstart
2025-09-06 11:13:50 -04:00
Alex Zhou
d6432589f6
fix: fix format and lint by ruff
2025-09-06 10:50:47 +08:00
Alex Zhou
13b73d4406
feat: Add support for pipecat video stream; fix the bug of duplicate participants when connecting; fix the bug of RTVI messages sent via livekit messages;
2025-09-06 10:41:33 +08:00
Aleix Conchillo Flaqué
85d8282f7e
Merge pull request #2602 from pipecat-ai/aleix/pipecat-0.0.84
...
update CHANGELOG for 0.0.84
2025-09-05 19:35:26 -07:00
Aleix Conchillo Flaqué
070690ec64
update CHANGELOG for 0.0.84
2025-09-05 18:22:50 -07:00
Aleix Conchillo Flaqué
b9c96fd623
Merge pull request #2601 from pipecat-ai/aleix/daily-python-0.19.9
...
pyproject: update daily-python to 0.19.9
2025-09-05 18:21:49 -07:00
Aleix Conchillo Flaqué
f8b2ab6331
pyproject: update daily-python to 0.19.9
2025-09-05 18:14:57 -07:00
Mark Backman
ea3f7e3c34
Merge pull request #2600 from pipecat-ai/mb/livekit-dtmf
...
LiveKitTransport: Add support to send DTMF
2025-09-05 15:25:32 -07:00
Mark Backman
2f44f88b08
LiveKitTransport: Add support to send DTMF
2025-09-05 18:23:04 -04:00
Mark Backman
25747a001b
Merge pull request #2599 from pipecat-ai/mb/fix-daily-dtmf
...
DTMF: Add support for native DTMF implementation where available
2025-09-05 15:20:05 -07:00
Mark Backman
fbe4338440
DTMF: Add support for native DTMF implementation where available
2025-09-05 18:16:56 -04:00
Filipi da Silva Fuchter
64b4c65728
Merge pull request #2595 from pipecat-ai/filipi/heygen_quality
...
Improving HeyGen example video quality.
2025-09-05 17:19:25 -03:00
kompfner
29442969a9
Merge pull request #2597 from pipecat-ai/pk/fix-anthropic-tool-less-usage
...
Fix Anthropic tool-less usage
2025-09-05 15:30:29 -04:00
Paul Kompfner
dc2e1d4ad3
Fix Anthropic tool-less usage
2025-09-05 11:47:31 -04:00
Filipi Fuchter
5477dfcbea
Improving HeyGen example video quality.
2025-09-05 11:30:01 -03:00
kompfner
516f0e08ab
Merge pull request #2590 from pipecat-ai/pk/gemini-multimodal-live-doesnt-support-llm-context
...
Raise an error when attempting to use Gemini Multimodal Live with uni…
2025-09-05 09:22:33 -04:00
Paul Kompfner
246f9f3325
Raise an error when attempting to use Gemini Multimodal Live with universal LLMContext. This is exactly the same error we already have for the other s2s models, AWS Nova Sonic and OpenAI Realtime, it was just missing from this service.
2025-09-04 16:47:08 -04:00
Manish Kumar
4699ee8d86
docs: add docstring for voice_cloning_key and update CHANGELOG
2025-09-04 22:45:51 +05:30
kompfner
3d850e8cc5
Merge pull request #2574 from pipecat-ai/pk/expand-universal-llm-context-support-to-anthropic
...
Expand universal `LLMContext` support to Anthropic
2025-09-04 13:09:44 -04:00
Paul Kompfner
6e734a37f9
Fix a bug in AWSBedrockLLMService.run_inference(); it was expecting the wrong format for the system instruction
2025-09-04 13:04:15 -04:00
Paul Kompfner
f72ca2fd7d
Remove unnecessary system_instruction argument from run_inference() methods
2025-09-04 13:04:15 -04:00
Paul Kompfner
0826d72f74
Add deprecation warning for using enable_prompt_caching_beta param
2025-09-04 13:04:15 -04:00
Paul Kompfner
ba5ebfa0ec
Fixed subtle CHANGELOG conflict after release of 0.0.83: universal LLMContext support for Anthropic didn't make that release. Also, some automatic Prettier fixes.
2025-09-04 13:04:11 -04:00
Paul Kompfner
dc3412b2df
Bump a deprecation to 0.0.84, as 0.0.83 just shipped
2025-09-04 13:03:06 -04:00
Paul Kompfner
b2e9fd9341
Rename Anthropic enable_prompt_caching_beta parameter to just enable_prompt_caching
2025-09-04 13:03:06 -04:00
Paul Kompfner
c11b207c97
Add Anthropic to CHANGELOG list of services newly supporting runtime LLM switching
2025-09-04 13:03:06 -04:00
Paul Kompfner
d6205027cf
Trivial cleanup
2025-09-04 13:03:06 -04:00
Paul Kompfner
986160c077
Fix a bug where the Anthropic adapter's merge-consecutive-messages-with-the-same-role logic was unintentionally affecting the source LLMContext's messages, resulting in more and more duplication of text with each inference
2025-09-04 13:03:06 -04:00
Paul Kompfner
b56ff86fee
Minor refactor of AnthropicLLMAdapter cache-control-marker-adding logic (without really changing its behavior)
2025-09-04 13:03:06 -04:00
Paul Kompfner
5c574eaad9
Add support for universal LLMContext to Anthropic LLM service
2025-09-04 13:03:06 -04:00
Paul Kompfner
2df231143a
Add foundational example using Anthropic with universal LLMContext
2025-09-04 13:03:06 -04:00
Aleix Conchillo Flaqué
e3597801d4
AWSNovaSonicLLMService: pre-load audio cue in the constructor
2025-09-04 09:31:39 -07:00
Aleix Conchillo Flaqué
65298ab792
update CHANGELOG with AWSBedrockLLMService fix
2025-09-04 09:24:55 -07:00
Aleix Conchillo Flaqué
b609b02614
Merge pull request #2568 from ezisezis/fix-bedrock-timeouts
...
fix timeout handling in AWSBedrockLLMService
2025-09-04 09:23:28 -07:00
Aleix Conchillo Flaqué
f2b50c14d2
Merge pull request #2573 from pipecat-ai/vp-minor-fixes-07s
...
example 07s: minor typo updates
2025-09-04 09:21:32 -07:00
Aleix Conchillo Flaqué
ee3b023986
update CHANGELOG with OpenAIImageGenService fix
2025-09-04 09:20:02 -07:00
Aleix Conchillo Flaqué
0d9e1190d7
Merge pull request #2583 from sassanh/main
...
fix: openai image generator now initiates URLImageRawFrame with correct order of arguments
2025-09-04 09:17:51 -07:00
Mark Backman
595a7c7fbe
Merge pull request #2587 from pipecat-ai/mb/update-quickstart-0.0.83
...
Update quickstart pyproject to use 0.0.83
2025-09-04 07:42:56 -07:00
Mark Backman
586586f743
Update quickstart pyproject to use 0.0.83
2025-09-04 10:36:58 -04:00
Mark Backman
a1c6ad539d
Merge pull request #2585 from ashotbagh/feat/asyncai-multilingual-support
...
feat(asyncai): add multilingual TTS support
2025-09-04 05:03:45 -07:00
Ashot
daf7fed8b3
feat(asyncai): add multilingual TTS support
2025-09-04 13:58:50 +04:00
Adithya Suresh
446d99d194
Bug fixes
2025-09-04 17:08:16 +10:00
Adithya Suresh
cbdbdee4c0
Initial StrandsAgentsProcessor implementation
2025-09-04 16:58:58 +10:00
Sassan Haradji
a26647c433
fix: openai image generator now initiates URLImageRawFrame with correct order of arguments
2025-09-04 06:09:57 +03:30
Aleix Conchillo Flaqué
0fab56fc13
Merge pull request #2577 from pipecat-ai/aleix/pipecat-0.0.83
...
update CHANGELOG for 0.0.83
2025-09-03 16:49:24 -07:00
Aleix Conchillo Flaqué
f0baff94b2
update CHANGELOG for 0.0.83
2025-09-03 16:47:43 -07:00
Aleix Conchillo Flaqué
d146170fd6
Merge pull request #2580 from pipecat-ai/mb/add-cerebras-evals
...
Add 14k (CerebrasLLMService) to release evals
2025-09-03 15:08:28 -07:00
Filipi da Silva Fuchter
001a2d36e5
Merge pull request #2579 from pipecat-ai/filipi/input_message
...
Creating InputTransportMessageUrgentFrame
2025-09-03 19:01:07 -03:00
Filipi Fuchter
99e237b1e2
Fixed an issue where messages received from the transport were always being resent.
2025-09-03 18:58:34 -03:00
Aleix Conchillo Flaqué
978f644f19
Merge pull request #2578 from pipecat-ai/aleix/user-speaking-frame
...
add UserSpeakingFrame and UserStartedSpeakingFrame/UserStopeedSpeakingFrame updates
2025-09-03 14:55:45 -07:00
Aleix Conchillo Flaqué
5a4c6b9618
BaseInputTransport: push UserStartedSpeakingFrame/UserStoppedSpeakingFrame upstream
2025-09-03 14:32:32 -07:00
Mark Backman
977a57c8fb
Add 14k (CerebrasLLMService) to release evals
2025-09-03 17:11:38 -04:00
Mark Backman
c64bc5a636
Merge pull request #2576 from joyceerhl/joyce/cerebras-default
...
fix: update default Cerebras model to GPT-OSS-120B
2025-09-03 14:10:28 -07:00
Joyce Er
eba006d39c
Fix nits
2025-09-03 14:07:49 -07:00
Joyce Er
a001f6f193
Switch to GPT-OSS-120B
2025-09-03 14:00:27 -07:00
Aleix Conchillo Flaqué
09d6ec1098
introduce and push UserSpeakingFrame upstream/downstream
2025-09-03 13:56:01 -07:00
Aleix Conchillo Flaqué
f56be9315a
Merge pull request #2572 from pipecat-ai/aleix/deepgram-disconnect-task
...
ParallePipeline: wait for CancelFrame in all branches
2025-09-03 13:10:55 -07:00
Mark Backman
8e5880b2e7
Merge pull request #2575 from pipecat-ai/mb/fix-foundational-frame-direction
...
fix: Specify frame direction in 06a push_frame
2025-09-03 12:46:10 -07:00
Joyce Er
d8ac6f2c1a
fix: update default Cerebras model to Qwen 3 32B
2025-09-03 12:23:36 -07:00
Mark Backman
052ffe8712
fix: Specify frame direction in 06a push_frame
2025-09-03 15:07:05 -04:00
Aleix Conchillo Flaqué
b52296450c
DeepgramSTTService: remove raising CancelledError
2025-09-03 11:24:02 -07:00
Aleix Conchillo Flaqué
c71cec04d3
ParallelPipeline: wait for CancelFrame in all branches
2025-09-03 11:23:37 -07:00
vipyne
83f64ecd3b
example 07s: minor typo updates
2025-09-03 12:11:07 -05:00
Aleix Conchillo Flaqué
d19170d8b1
Merge pull request #2565 from pipecat-ai/aleix/reorganize-transports
...
transports: reorganize module
2025-09-03 08:52:49 -07:00
Mark Backman
8b95d74193
Merge pull request #2571 from pipecat-ai/mb/fix-docs-0.0.83
...
Fix docs generation before 0.0.83 release
2025-09-03 08:52:20 -07:00
Mark Backman
3c4694a8f1
Fix docs generation before 0.0.83 release
2025-09-03 11:31:14 -04:00
kompfner
b9748b1228
Merge pull request #2563 from pipecat-ai/pk/expand-universal-llm-context-support-to-more-llms
...
Expand universal `LLMContext` support to more LLMs
2025-09-03 11:20:26 -04:00
Paul Kompfner
def1cf1548
Update CHANGELOG with entry about expanded support among LLM services for new universal LLMContext
2025-09-03 09:07:57 -04:00
Paul Kompfner
9b216116f1
Remove supports_universal_context gate from OpenAI-library-based LLM services. It's no longer needed, as they all now support universal LLMContext.
2025-09-03 09:07:18 -04:00
Paul Kompfner
7cb372ebb9
Add support for universal LLMContext to Together.ai LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
6838bc1e51
Add a few missing LLMContext type hints
2025-09-03 09:07:18 -04:00
Paul Kompfner
e04f42167e
Add support for universal LLMContext to SambaNova LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
91a3f63e28
Add support for universal LLMContext to Qwen LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
b24eb76559
Add QWEN_API_KEY to env.example
2025-09-03 09:07:18 -04:00
Paul Kompfner
d9ea02595b
Add support for universal LLMContext to Ollama LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
5bc0e49baa
Add support for universal LLMContext to Perplexity LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
ec138b97d9
Add support for universal LLMContext to OpenRouter LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
0c32cc29a7
Add support for universal LLMContext to OpenPipe LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
d740bab99e
Add support for universal LLMContext to NVIDIA NIM LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
ac62183eb6
Add NVIDIA_API_KEY to env.example
2025-09-03 09:07:18 -04:00
Paul Kompfner
34f823bcac
Add support for universal LLMContext to Groq LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
b4e1051066
Add support for universal LLMContext to Grok LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
d8882bc381
Add support for universal LLMContext to Google Vertex AI LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
da18d0a562
Add support for universal LLMContext to Fireworks AI LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
f8e13a82cf
Fix Fireworks AI function calling example
2025-09-03 09:07:18 -04:00
Paul Kompfner
2b00d37e94
Add support for universal LLMContext to DeepSeek LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
2dbd17da4d
Fix Cerebras function calling example
2025-09-03 09:07:18 -04:00
Paul Kompfner
d45fbd5455
Add support for universal LLMContext to Cerebras LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
b22bdff6d0
Add support for universal LLMContext to Azure LLM service
2025-09-03 09:07:18 -04:00
Paul Kompfner
2b286365e0
Add MISTRAL_API_KEY to env.example
2025-09-03 09:07:18 -04:00
Eduards Klavins
0a3e98857e
fix timeout handling in AWSBedrockLLMService
2025-09-03 11:52:30 +03:00
Aleix Conchillo Flaqué
aeb9f1ffca
transports: reorganize module
2025-09-02 17:31:39 -07:00
Filipi da Silva Fuchter
7f1100bd4c
Merge pull request #2513 from pipecat-ai/filipi/whatsapp
...
Support for the new WhatsApp Cloud API
2025-09-02 18:06:59 -03:00
Filipi Fuchter
8fbd9b5af7
Added support for WhatsApp User-initiated Calls.
2025-09-02 18:05:00 -03:00
Filipi Fuchter
49c1f0bd08
Fixed SmallWebRTCTransport to not use mid to decide if the transceiver should be sendrecv or not.
2025-09-02 18:04:51 -03:00
Aleix Conchillo Flaqué
ce7a0512f9
Merge pull request #2562 from pipecat-ai/aleix/ai-coustics-speech-enhancement
...
add ai-coustics speech enhancement filter
2025-09-02 13:13:28 -07:00
Aleix Conchillo Flaqué
fdcd14dd21
updated CHANGELOG with AICFilter and fix deprecations
2025-09-02 13:10:10 -07:00
Mark Backman
0386599163
Added Daily SIP room creation utility ( #2560 )
...
* Added Daily SIP room creation utility to configure() function
* Add sip_codecs to the DailyRoomSipParams
2025-09-02 14:12:04 -04:00
Corvin Jaedicke
c1ce3d7d2b
bumped aic-sdk version to v1.0.1 with minor changes
2025-09-02 11:11:29 -07:00
Corvin Jaedicke
8ecece2d9c
Add AIC SDK audio filter
2025-09-02 11:11:29 -07:00
Filipi da Silva Fuchter
0d8ab7abca
Merge pull request #2552 from pipecat-ai/filipi/freeze_issues
...
Fixed an issue where the pipeline could freeze.
2025-09-02 14:43:08 -03:00
Filipi Fuchter
dea7c22020
Fixed an issue where the pipeline could freeze.
2025-09-02 13:58:41 -03:00
Mark Backman
cfe11267f4
Merge pull request #2546 from pipecat-ai/mb/update-changelog-mem0
...
Add mem0 changelog entry
2025-09-02 07:22:52 -07:00
Mark Backman
d0c97d3602
Add mem0 changelog entry
2025-09-02 10:03:17 -04:00
Mark Backman
37e1551abc
Merge pull request #2555 from pipecat-ai/mb/update-uv-lock-quickstart
2025-09-02 04:19:15 -07:00
Mark Backman
e1477e79f0
Merge pull request #2538 from rimelabs/rime-flush-audio-update
...
Use Rime’s official {"operation": "flush"} command in flush_audio() for proper text buffer flushing
2025-09-01 18:01:20 -07:00
Mark Backman
547b126d98
Update required pipecat-ai version for quickstart
2025-09-01 20:52:44 -04:00
Mark Backman
447e3b28eb
Update uv.lock for quickstart
2025-09-01 20:52:12 -04:00
gokuljs
472efa2971
ruff format fix
2025-09-02 04:25:28 +05:30
Mark Backman
64486ef50b
Merge pull request #2536 from gladiaio/PLA-38-missing-config-parameters
...
Gladia - add missing config parameters
2025-09-01 12:42:10 -07:00
gokuljs
5f801743d0
Add changelog entry for RimeTTSService flush_audio API update
2025-09-01 22:16:02 +05:30
Fabrice Lamant
802c5d04f4
update changelog
2025-09-01 10:21:11 +02:00
Aleix Conchillo Flaqué
83b90da53a
Merge pull request #2537 from pipecat-ai/aleix/pipeline-task-cleanup-observers
...
PipelineTask: cleanup observers
2025-08-31 13:44:38 -07:00
Aleix Conchillo Flaqué
1f49de5cdf
Merge pull request #2542 from pipecat-ai/aleix/remove-stop-interruption-frame
...
frames: remove StopInterruptionFrame
2025-08-31 13:44:22 -07:00
Manish Kumar
2ee481d541
feat: add voice cloning and speaking rate to GoogleTTSService
2025-08-30 23:04:59 +05:30
Mark Backman
7cf099eae7
Merge pull request #2541 from parshvadaftari/user/parshva/update_mem0
...
Update mem0 integration
2025-08-30 05:11:31 -07:00
Mark Backman
93a8ea3cb2
Merge pull request #2543 from pipecat-ai/mb/docs-extensions
...
Add Extensions to ref docs generation
2025-08-30 04:20:03 -07:00
Aleix Conchillo Flaqué
776aafddfb
Merge pull request #2534 from pipecat-ai/aleix/pyright-1.1.404
...
pyproject: update pyright and ruff
2025-08-29 19:55:54 -07:00
Mark Backman
d56762262a
Fix docs build errors
2025-08-29 20:24:35 -04:00
Mark Backman
bbcf35d657
Add Extensions to reference docs generation
2025-08-29 20:17:34 -04:00
Mark Backman
972546b24f
Add IVR navigation ( #2529 )
2025-08-29 20:08:17 -04:00
Aleix Conchillo Flaqué
8b351f5bec
pyproject: update pyright and ruff
2025-08-29 17:02:13 -07:00
Aleix Conchillo Flaqué
bd7d9346b7
frames: remove StopInterruptionFrame
2025-08-29 16:40:01 -07:00
Aleix Conchillo Flaqué
81325be4f3
Merge pull request #2540 from pipecat-ai/aleix/dtmf-tones-slower
...
audio(dtmf): use longer tones and longer gaps
2025-08-29 15:15:01 -07:00
Aleix Conchillo Flaqué
399f8de6ef
audio(dtmf): use longer tones and longer gaps
2025-08-29 15:10:20 -07:00
parshvadaftari
60c070e077
update mem0 integration for reduced latency and better performance
2025-08-30 02:27:36 +05:30
gokuljs
e3f2faabf7
Merge branch 'main' of github.com:rimelabs/pipecat into rime-flush-audio-update
2025-08-30 01:18:50 +05:30
Aleix Conchillo Flaqué
b5a644dd6f
PipelineTask: cleanup observers
2025-08-29 10:54:36 -07:00
gokuljs
e06bd6049e
update flush operation in flush audio function under rime tts
2025-08-29 21:27:14 +05:30
Fabrice Lamant
25b595e125
add suggestions
2025-08-29 14:51:20 +02:00
Fabrice Lamant
edc8cc1e69
remove sample_rate from GladiaInputParams
2025-08-29 14:00:00 +02:00
Fabrice Lamant
633dd69dee
feat: add logging for pipecat version and session url
2025-08-29 13:47:16 +02:00
Fabrice Lamant
1a1d5a1081
feat: add missing config params
2025-08-29 13:46:44 +02:00
Aleix Conchillo Flaqué
c1b8d2acab
Merge pull request #2532 from pipecat-ai/aleix/universal-dtmf-support
...
Universal DTMF support
2025-08-28 21:04:13 -07:00
Aleix Conchillo Flaqué
ea368e4c5f
scripts(dtmf): added generate_dtmf.sh to generate DTMF wav files
2025-08-28 21:01:41 -07:00
Aleix Conchillo Flaqué
f03deb6ecc
DailyTransport: remove send_dtmf() and write_dtmf()
2025-08-28 21:01:41 -07:00
Aleix Conchillo Flaqué
0e01ac8ef6
BaseOutputTransport: implement generic write_dtmf()
2025-08-28 21:01:41 -07:00
Aleix Conchillo Flaqué
5787743ab3
audio(dtmf): added DTMF audio files and load_dtmf_audio()
2025-08-28 21:01:41 -07:00
Aleix Conchillo Flaqué
79be0695dd
make sure warnings are always displayed
2025-08-28 17:43:29 -07:00
Aleix Conchillo Flaqué
a5c5e069ba
move pipecat.frames.frames.KeypadEntry to pipecat.audio.dtmf.types.KeypadEntry
2025-08-28 17:43:29 -07:00
Aleix Conchillo Flaqué
77c34076f7
Merge pull request #2531 from pipecat-ai/aleix/pipecat-0.0.82
...
update CHANGELOG for 0.0.82
2025-08-28 13:04:41 -07:00
Aleix Conchillo Flaqué
d67cece356
update CHANGELOG for 0.0.82
2025-08-28 13:02:47 -07:00
Aleix Conchillo Flaqué
275c8b59c5
MistralLLMService: fix build_chat_completion_params()
2025-08-28 12:04:14 -07:00
Aleix Conchillo Flaqué
5ebcea2a3b
scripts(eval): change "result" function call parameter
2025-08-28 11:38:59 -07:00
Aleix Conchillo Flaqué
64f2135ddc
examples(14f): use default models
2025-08-28 11:38:59 -07:00
kompfner
a74231f036
Merge pull request #2515 from pipecat-ai/pk/llm-run-frame
...
Add `LLMRunFrame` to trigger an LLM response, replacing `context_aggr…
2025-08-28 10:01:00 -04:00
Paul Kompfner
189749b579
Add LLMRunFrame to trigger an LLM response, replacing context_aggregator.user().get_context_frame()
2025-08-28 09:53:33 -04:00
Aleix Conchillo Flaqué
e384ca949e
Merge pull request #2512 from pipecat-ai/aleix/textframe-skip-tts
...
TextFrame: add skip_tts field
2025-08-27 16:26:03 -07:00
Aleix Conchillo Flaqué
eb248fedc1
add skip_tts to LLMFullResponseStartFrame/LLMFullResponseEndFrame
2025-08-27 16:23:27 -07:00
Aleix Conchillo Flaqué
16f57be72c
LLMConfigureOutputFrame: allow configuring LLM output
2025-08-27 16:23:27 -07:00
Aleix Conchillo Flaqué
5803936838
TextFrame: add skip_tts field
...
This lets a text frame bypass TTS while still being included in the LLM
context. Useful for cases like structured text that isn’t meant to be spoken but
should still contribute to context.
2025-08-27 16:23:27 -07:00
Aleix Conchillo Flaqué
d9837dd1e5
Merge pull request #2527 from pipecat-ai/aleix/daily-python-0.19.8
...
pyproject: update daily-python to 0.19.8
2025-08-27 16:22:49 -07:00
Aleix Conchillo Flaqué
e48c9fc3e2
pyproject: update daily-python to 0.19.8
2025-08-27 16:00:36 -07:00
Aleix Conchillo Flaqué
3c4454a33e
Merge pull request #2526 from pipecat-ai/aleix/pipeline-task-wait-for-startframe
...
PipelineTask: wait for StartFrame to reach end of pipeline
2025-08-27 15:57:10 -07:00
Aleix Conchillo Flaqué
2a0780e6ef
PipelineTask: wait for StartFrame to reach end of pipeline
...
Fixes #2498
2025-08-27 14:23:09 -07:00
Aleix Conchillo Flaqué
5e121346fb
Merge pull request #2516 from pipecat-ai/aleix/rtvi-client-version-check
...
RTVIProcessor: make check sure client version is set
2025-08-27 14:02:14 -07:00
Aleix Conchillo Flaqué
2bdca8d22c
RTVIProcessor: make check sure client version is set
2025-08-27 13:36:11 -07:00
Aleix Conchillo Flaqué
1f5888bcf7
Merge pull request #2517 from pipecat-ai/aleix/unify-get-messages-for-logging
...
unify get_messages_for_logging()
2025-08-27 12:49:36 -07:00
Mark Backman
3d09f9a2af
Merge pull request #2524 from pipecat-ai/mb/cartesia-speed
...
Cartesia: update speed InputParam
2025-08-27 12:47:29 -07:00
Aleix Conchillo Flaqué
cd3563bb16
unify get_messages_for_logging()
...
Some implementations were returing a list and some were returning a JSON
string. They should all return a list and the user would decide if it wants to
transform that into JSON.
2025-08-27 12:45:24 -07:00
Aleix Conchillo Flaqué
3e79ef4118
Merge pull request #2525 from pipecat-ai/aleix/daily-fix-send-dtmf
...
DailyTransport: fix sending DTMF tones
2025-08-27 12:44:27 -07:00
Aleix Conchillo Flaqué
2613da1a1f
PipelineTask: increase CANCEL_TIMEOUT_SECS to 20
2025-08-27 11:50:48 -07:00
Aleix Conchillo Flaqué
41d40f9a11
DailyTransport: make sure we have a client before joining/leaving
2025-08-27 11:50:48 -07:00
Aleix Conchillo Flaqué
74af2b6aa4
DailyTransport: fix sending DTMF tones
2025-08-27 11:50:48 -07:00
Mark Backman
f7d9f32b0f
Cartesia: update speed InputParam
2025-08-27 13:34:28 -04:00
Mark Backman
6074af60ef
Merge pull request #2521 from pipecat-ai/mb/update-quickstart-pcc-docker
...
Update quickstart to use pcc docker command
2025-08-27 08:13:31 -07:00
Mark Backman
7ef6893c0d
Merge pull request #2523 from sam-s10s/fix/connection-none
...
Speechmatics TTS connection issue
2025-08-27 08:09:46 -07:00
Sam Sykes
cc5557e051
changelog
2025-08-27 16:07:31 +01:00
Sam Sykes
06f7a92c99
fix to finally statement
2025-08-27 14:43:07 +01:00
Mark Backman
61a333ccae
Update quickstart to use pcc docker command
2025-08-26 21:29:13 -04:00
Mark Backman
fc3d84dff7
Merge pull request #2501 from pipecat-ai/mb/aws-tts-more-flexible-auth
...
Support additional authentication mechanisms for AWS services
2025-08-26 18:05:37 -07:00
Mark Backman
86a37d8cea
Add changelog entry for SentryMetrics missing import fix
2025-08-26 21:00:16 -04:00
Mark Backman
3f66acf9f1
Merge pull request #2520 from geluso/bugfix-missing-asyncio-import
...
add missing import asyncio
2025-08-26 17:59:25 -07:00
Mark Backman
facfaa2dd4
AWSBedrockLLMService: Allow setting auth credentials via env vars
2025-08-26 20:59:12 -04:00
Mark Backman
8250c381d1
AWSPollyTTSService: allow setting auth credentials through provider chain
2025-08-26 20:58:02 -04:00
Steve Geluso
32f9e48865
add missing import asyncio
2025-08-26 17:40:11 -07:00
Filipi Fuchter
76eef837b6
Removing watchdog from SarvamTTSService.
2025-08-26 18:44:58 -03:00
Filipi Fuchter
c9aaa463b7
Mentioning the recent SarvamTTSService changes in the changelog.
2025-08-26 18:44:58 -03:00
pratham-sarvam
6d582e41b7
Added Sarvam TTS Websocket Implementation ( #2356 )
...
* Added Sarvam TTS Websocket Implementation
* Addressed some of the comments on PR
* added change voice logic
* added changes from main
* pushing text frames and added flush audio
* updated docs string for better docs
* Addressed comments and added some improvements
* pushed optional args down
* removed new line
* made aiohttp session mandatory in http service
* added push frame and removed unused function
* removed pong message
* added disconnecting logic
---------
Co-authored-by: vinayak-sarvam <vinayak@sarvam.ai >
2025-08-26 18:10:26 -03:00
kompfner
ca29f62bff
Merge pull request #2510 from pipecat-ai/pk/fix-set-tools-types
...
Update types for tools in `LLMSetToolsFrame` and `LLMContextAggregato…
2025-08-26 14:12:21 -04:00
Aleix Conchillo Flaqué
0dced68c3c
Merge pull request #2511 from pipecat-ai/aleix/end-of-pipline-warning
...
PipelineTask: warn if CancelFrame doesn't reach the end
2025-08-26 11:02:26 -07:00
Aleix Conchillo Flaqué
8ab81d289a
PipelineTask: warn if CancelFrame doesn't reach the end
2025-08-26 10:36:33 -07:00
Paul Kompfner
f457d00760
Update types for tools in LLMSetToolsFrame and LLMContextAggregator.set_tools(), for two reason:
...
1. `ToolsSchema` has been supported in `LLMSetToolsFrame` for a while but wasn't properly reflected in these type hints
2. The new universal `LLMContext` expects tools to be either a `ToolsSchema` or `NOT_GIVEN`.
2025-08-26 11:32:21 -04:00
kompfner
f5118c4412
Merge pull request #2440 from pipecat-ai/pk/prototype-llm-failover-attempt-4
...
Support for runtime LLM switching
2025-08-26 09:55:03 -04:00
Paul Kompfner
a79fe40162
Fix a typo in the CHANGELOG
2025-08-26 09:51:48 -04:00
Paul Kompfner
dcb4949e20
Move ServiceSwitcherFrame and ManuallySwitchServiceFrame to frames.py
2025-08-26 09:47:37 -04:00
Paul Kompfner
8b543e558d
Add CHANGELOG entry describing LLMService.run_inference()
2025-08-26 09:47:32 -04:00
Paul Kompfner
8181962236
Add CHANGELOG entry describing LLM switcher
2025-08-26 09:46:51 -04:00
Paul Kompfner
98dc891640
Move CHANGELOG log entry from 0.0.81 to Unreleased
2025-08-26 09:45:49 -04:00
Paul Kompfner
71de0da570
ServiceSwitchers are now controlled using frames rather than with direct method calls
2025-08-26 09:44:15 -04:00
Paul Kompfner
b40c8bb81d
Refactor LLMSwitcher into a base ServiceSwitcher and an LLMSwitcher that subclasses it
2025-08-26 09:44:15 -04:00
Paul Kompfner
43f1b59b86
Convert LLM generate_summary() methods to the more generic run_inference()
2025-08-26 09:44:15 -04:00
Paul Kompfner
a0a2bb3aa4
In GeminiLLMAdapter, when translating from the universal LLMContext format, only pull out the first "system" message as the system instruction, and convert subsequent ones into "user" messages. This is a more correct thing to do than simply drop subsequent "system" messages, especially when potentially sharing a context between multiple LLMs.
2025-08-26 09:44:15 -04:00
Paul Kompfner
04a50df3d5
Add LLMSwitcher, with LLMSwitcherStrategyManual as the first supported switching strategy
2025-08-26 09:44:15 -04:00
Paul Kompfner
8c0edffaff
Fix bug in AWS Bedrock conversation summarization. It was using an out-of-date pattern (the _client property no longer exists)
2025-08-26 09:44:15 -04:00
Paul Kompfner
fe6063fdbe
Introduce an affordance to LLMService for generating a summary of a conversation directly (i.e. without going through the pipeline).
...
This abstraction will allow us to update Pipecat Flows to avoid reaching into LLM service internals to generate summaries.
In addition to being a helpful refactor to remove a fragile part of Pipecat Flows, this change helps set the stage for supporting the upcoming `LLMSwitcher`, where the “active” LLM will only be determined at runtime—today, Pipecat Flows needs to know ahead of time what type of LLM it’s working with, to load an LLM-specific “adapter” that does the work of generating summaries, among other things.
2025-08-26 09:44:15 -04:00
Paul Kompfner
195146adb2
Bump deprecation warning version, as this commit is not expected to ship until version 0.0.82.
2025-08-26 09:44:15 -04:00
Paul Kompfner
cab9e18cc9
Port recent change to LLMAssistantContextAggregator to universal LLMAssistantAggregator
2025-08-26 09:44:15 -04:00
Paul Kompfner
baef688e4e
Port recent changes to LLMUserContextAggregator to universal LLMUserAggregator
2025-08-26 09:44:15 -04:00
Paul Kompfner
f1f43fe500
After a rebase, rename foundational examples showing usage of universal context to avoid naming conflict with a recently-added example.
2025-08-26 09:44:15 -04:00
Paul Kompfner
73b63f8d35
Remove unnecessary import
2025-08-26 09:44:15 -04:00
Paul Kompfner
0c14b33e92
Deprecate GoogleLLMOpenAIBetaService
2025-08-26 09:44:15 -04:00
Paul Kompfner
09beaccaf0
Assorted minor improvements after code review
2025-08-26 09:44:15 -04:00
Paul Kompfner
40557a1aae
Remove TODO comment
2025-08-26 09:44:15 -04:00
Paul Kompfner
ecc4cc4a79
Add support for universal LLMContext to RTVIObserver
2025-08-26 09:44:15 -04:00
Paul Kompfner
37be8805f4
ruff
2025-08-26 09:44:15 -04:00
Paul Kompfner
93c7e64995
Add missing PERPLEXITY_API_KEY in env.example
2025-08-26 09:44:15 -04:00
Paul Kompfner
9de2bd61a9
Add supports_universal_context for OpenAILLMService subclasses so that we can gradually roll out support for universal LLMContext in a controlled manner.
...
Also update `get_chat_completions()` implementations with the new argument type.
2025-08-26 09:44:15 -04:00
Paul Kompfner
566af71862
Add CHANGELOG entry for the universal LLMContext machinery
2025-08-26 09:44:15 -04:00
Paul Kompfner
12064bd6e6
Add a bit of helpful info in an error message
2025-08-26 09:44:15 -04:00
Paul Kompfner
a962459151
Change LLMContextAggregatorPair.create(context) to LLMContextAggregatorPair(context)
2025-08-26 09:44:15 -04:00
Paul Kompfner
8fc76a29bc
Raise errors when trying to use universal LLMContext with LLM services that don't yet support it
2025-08-26 09:44:15 -04:00
Paul Kompfner
e3019261a5
Fix classes that subclass BaseLLMAdapter by adding placeholder stuff until support for universal LLMContext machinery comes to all LLM services
2025-08-26 09:44:15 -04:00
Paul Kompfner
fa1f6f1c51
In LLMContext, normalize an empty provided ToolsSchema to NOT_GIVEN
2025-08-26 09:44:15 -04:00
Paul Kompfner
337f00c16c
Minor fix: add a type annotation
2025-08-26 09:44:15 -04:00
Paul Kompfner
d50922cdcd
Update Google adapter to handle possibility of system message in standard format being provided as a list of text parts rather than just a string.
2025-08-26 09:44:15 -04:00
Paul Kompfner
47f5ca6265
Update Gemini adapter to be able to handle LLMSpecificMessages containing Google-formatted messages
2025-08-26 09:44:15 -04:00
Paul Kompfner
2eddb6ffda
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Remove outdated comment
2025-08-26 09:44:15 -04:00
Paul Kompfner
560a6f2247
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Make `LLMContext.add_audio_frames_message()` respect the OpenAI standard format
2025-08-26 09:44:15 -04:00
Paul Kompfner
59ecb19000
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Add support for LLM-specific messages in the universal `LLMContext`, to enable using LLM-specific functionality while still using the universal LLM context
2025-08-26 09:44:15 -04:00
Paul Kompfner
cfb094b3c8
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Make it so that tools in `LLMContext` are guaranteed to be either a `ToolsSchema` or `NOT_GIVEN`
2025-08-26 09:44:15 -04:00
Paul Kompfner
1f7e8e001b
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Update some types to also allow for universal `LLMContext`
2025-08-26 09:44:15 -04:00
Paul Kompfner
688b136141
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Add to Google LLM service support for universal LLM context
2025-08-26 09:44:15 -04:00
Paul Kompfner
809c4c1bc5
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Add to OpenAI LLM service support for universal LLM context
2025-08-26 09:44:15 -04:00
Paul Kompfner
81ca5e6601
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Formatting fix + dead import cleanup
2025-08-26 09:44:15 -04:00
Paul Kompfner
ebc49d2252
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Add a "universal" alias for `OpenAILLMContextAssistantTimestampFrame`: `LLMContextAssistantTimestampFrame`
2025-08-26 09:44:15 -04:00
Paul Kompfner
ff8d158e18
[WIP] Universal (LLM-agnostic) context machinery to support runtime LLM switching.
...
- Added universal `LLMContext` and associated context aggregators.
2025-08-26 09:44:15 -04:00
Aleix Conchillo Flaqué
37980b0854
Merge pull request #2504 from pipecat-ai/aleix/cartesia-fix-timeout-reconnection
...
CartesiaTTSService: reconnect on Cartesia's timeout
2025-08-25 15:24:31 -07:00
Aleix Conchillo Flaqué
39ebc2c9c1
CartesiaTTSService: reconnect on Cartesia's timeout
2025-08-25 14:09:03 -07:00
Aleix Conchillo Flaqué
ab61d09ec1
Merge pull request #2502 from pipecat-ai/aleix/pipecat-0.0.81
...
update CHANGELOG for 0.0.81
2025-08-25 09:28:21 -07:00
Aleix Conchillo Flaqué
e4afc0a13c
update CHANGELOG for 0.0.81
2025-08-25 08:22:28 -07:00
Mark Backman
dde3d2395b
Merge pull request #2491 from pipecat-ai/mb/update-quickstart
2025-08-23 06:34:37 -07:00
Aleix Conchillo Flaqué
30b36c3d6e
Merge pull request #2497 from pipecat-ai/aleix/pipeline-task-fix-cancellation
...
PipelineTask: handle cancellations gracefully
2025-08-22 22:37:12 -07:00
Mark Backman
de4dfc3ed4
Update deployment steps
2025-08-23 00:19:26 -04:00
Aleix Conchillo Flaqué
a0128516ff
PipelineTask: handle cancellations gracefully
2025-08-22 19:04:31 -07:00
Aleix Conchillo Flaqué
db3b8c7325
Merge pull request #2496 from pipecat-ai/aleix/release-evals-always-provide-eval-prompt
...
scripts(evals): always require an eval prompt
2025-08-22 18:11:33 -07:00
Aleix Conchillo Flaqué
9273ec0f25
scripts(evals): always require an eval prompt
2025-08-22 16:57:47 -07:00
Mark Backman
8dfa1187be
Merge pull request #2402 from pipecat-ai/mb/voicemail-detection
...
Add voicemail detection
2025-08-22 14:51:13 -07:00
Mark Backman
e17fd580c6
Update README
2025-08-22 15:56:56 -04:00
mattie ruth backman
3e3d50a855
Fix issue with request images from the camera introduced in smallwebrtctransport
2025-08-22 15:02:33 -04:00
Mark Backman
402661ae03
Prevent user speaking frames from entering the classifier branch after a conversation is detected
2025-08-22 14:09:45 -04:00
Mark Backman
69c6a95b8a
Simplify frames in the NotifierGate
2025-08-22 14:09:45 -04:00
Mark Backman
4d49210a73
Rename system_prompt to custom_system_prompt; improve dev ex for classification prompt requirements
2025-08-22 14:09:45 -04:00
Aleix Conchillo Flaqué
5f8a22ef2f
Merge pull request #2493 from pipecat-ai/aleix/runner-task-asyncio-cancellation
...
PipelineRunner/PipelineTask: fix asyncio task cancellation
2025-08-22 09:13:58 -07:00
Aleix Conchillo Flaqué
606ad0826a
Merge pull request #2492 from pipecat-ai/aleix/wait-for-task-deprecated
...
FrameProcessor: wait_for_task is now deprecated
2025-08-22 09:13:34 -07:00
Mark Backman
57028255ee
Update changelog, mention text LLMs only
2025-08-22 12:12:17 -04:00
Mark Backman
87ebbab758
Only set/clear voicemail_event when voicemail is detected
2025-08-22 12:12:17 -04:00
Mark Backman
bd401e8d6f
Rename TTSBuffer to TTSGate
2025-08-22 12:12:17 -04:00
Mark Backman
f0dfab23e7
Cleanup
2025-08-22 12:12:17 -04:00
Mark Backman
fbc907c371
Change path to extensions
2025-08-22 12:12:17 -04:00
Mark Backman
40b5ef485d
Add base NotifierGate class and ClassifierGate, ConversationGate subclasses
2025-08-22 12:12:17 -04:00
Mark Backman
b30af3e155
Tests specify USER_SPEAKS_FIRST or BOT_SPEAKS_FIRST
2025-08-22 12:12:17 -04:00
Mark Backman
446bb5cddf
Refactor callback to event
2025-08-22 12:12:17 -04:00
Mark Backman
1c1ee94074
Add 44 to evals, update evals to support user speaking first
2025-08-22 12:12:17 -04:00
Mark Backman
ac30083b45
Add CHANGELOG entry
2025-08-22 12:12:17 -04:00
Mark Backman
ce579d4266
Make on_voicemail_detected callback required, cleanup logging
2025-08-22 12:12:17 -04:00
Mark Backman
5a07b30c7a
Class name changes, add TTSStarted/StoppedFrame to the TTSBuffer
2025-08-22 12:12:17 -04:00
Mark Backman
9da33f3897
Handle multiple user inputs from the user when a voicemail is detected; add a configurable timeout to emitting the callback
2025-08-22 12:12:17 -04:00
Mark Backman
5ca82ec61e
Final docstrings, comments, and cleanup
2025-08-22 12:12:17 -04:00
Mark Backman
0067c7df47
Add aggregation to classifier LLM output and validate prompt
2025-08-22 12:12:17 -04:00
Mark Backman
ab03db5b0c
Updated prompt, add custom system_prompt input
2025-08-22 12:12:17 -04:00
Mark Backman
238d6bf9ab
Add buffering logic
2025-08-22 12:12:17 -04:00
Mark Backman
90ae85bab2
More updates—added new voicemail module
2025-08-22 12:12:17 -04:00
Mark Backman
29e09b2053
POC demo in progress
2025-08-22 12:12:17 -04:00
mattie ruth backman
bad9977e8c
PR feedback and more explicit about only supporting exporting 1 video
2025-08-22 11:24:22 -04:00
mattie ruth backman
b987579d54
update smallWebRTC screen support to support the utils format for listening to screenshares
2025-08-22 11:24:22 -04:00
mattie ruth backman
40f1f4ff11
Add support to smallWebRTCTransport for receiving screenshare videos
2025-08-22 11:24:22 -04:00
Aleix Conchillo Flaqué
a3ad31d0f6
README: recommended python version is 3.12
2025-08-21 23:50:00 -07:00
Aleix Conchillo Flaqué
8044c4170d
PipelineRunner/PipelineTask: fix asyncio task cancellation
2025-08-21 23:50:00 -07:00
Aleix Conchillo Flaqué
bc51e7abc6
FrameProcessor: wait_for_task is now deprecated
2025-08-21 21:17:47 -07:00
Aleix Conchillo Flaqué
256ecf4d71
Merge pull request #2490 from pipecat-ai/aleix/speechmatics-exceptions
...
Speechmatics exception handling
2025-08-21 19:48:43 -07:00
Aleix Conchillo Flaqué
c16969c4f5
Merge pull request #2489 from pipecat-ai/aleix/daily-python-0.19.7
...
pyproject: update daily-python to 0.19.7
2025-08-21 19:48:31 -07:00
Mark Backman
8ef64d8c8d
Update quickstart, make it deployable
2025-08-21 22:32:34 -04:00
Aleix Conchillo Flaqué
4947d08733
GladiaSTTService: update loggin levels
2025-08-21 18:42:23 -07:00
Aleix Conchillo Flaqué
b61846534d
SpeechmaticsSTTService: improve exception handling and loggin
2025-08-21 18:42:23 -07:00
Aleix Conchillo Flaqué
8f01cd220a
pyproject: update daily-python to 0.19.7
2025-08-21 18:40:01 -07:00
Aleix Conchillo Flaqué
3abaaf80e0
Merge pull request #2487 from pipecat-ai/aleix/watchdog-timers-removal
...
remove watchdog timers and specific asyncio implementations
2025-08-21 18:37:35 -07:00
Aleix Conchillo Flaqué
13890fa021
github(tests): use python 3.12 to run unit tests/coverage
2025-08-21 18:09:56 -07:00
Aleix Conchillo Flaqué
802af28888
update pytest-asyncio to 1.1.0
2025-08-21 18:09:56 -07:00
Aleix Conchillo Flaqué
24a628c85e
remove watchdog timers and specific asyncio implementations
...
Watchdog timers have been removed. They were introduced in 0.0.72 to help
diagnose pipeline freezes. Unfortunately, they proved ineffective since they
required developers to use Pipecat-specific queues, iterators, and events to
correctly reset the timer, which limited their usefulness and added friction.
2025-08-21 18:09:56 -07:00
Mark Backman
ddab95835b
Merge pull request #2474 from pipecat-ai/mb/add-frames-pipeline-idle
...
Add UserStarted/StoppedSpeakingFrames to idle_timeout_frames
2025-08-21 03:45:46 -07:00
Mark Backman
cb13f4b4cb
Add user speaking and transcription frames to idle_timeout_frames
2025-08-21 06:43:10 -04:00
Aleix Conchillo Flaqué
4793277d34
Merge pull request #2480 from pipecat-ai/aleix/replace-asyncio-waitfor
...
replace asyncio.wait_for for wait_for2.wait_for
2025-08-20 17:43:32 -07:00
Aleix Conchillo Flaqué
28c729cc36
replace asyncio.wait_for for wait_for2.wait_for
2025-08-20 15:26:57 -07:00
Aleix Conchillo Flaqué
4d07c7b77c
Merge pull request #2479 from pipecat-ai/aleix/simplify-dtmf-aggregator
...
DTMFAggregator: no need for interruption task
2025-08-20 15:15:35 -07:00
Aleix Conchillo Flaqué
4ff0567025
BaseObject: allow keyword arguments
2025-08-20 15:14:31 -07:00
Aleix Conchillo Flaqué
1377dec01b
DTMFAggregator: no need for interruption task
...
Now that system frames are queued there's no need to have an additional task to
push a `BotInterruptionFrame`.
2025-08-20 14:35:04 -07:00
Aleix Conchillo Flaqué
42f4d73a63
Merge pull request #2478 from pipecat-ai/aleix/fix-wait-for2-import
...
timeout: fix wait_for2 import
2025-08-20 14:29:19 -07:00
Aleix Conchillo Flaqué
f1c1ebf852
timeout: fix wait_for2 import
2025-08-20 14:24:16 -07:00
Aleix Conchillo Flaqué
eb6d43f6cb
Merge pull request #2476 from pipecat-ai/aleix/add-asyncio-timeout
...
implement custom asyncio.wait_for()
2025-08-20 14:20:22 -07:00
Aleix Conchillo Flaqué
f387776985
add custom asyncio.wait_for()
...
This patch uses `wait_for2` package to implement `asyncio.wait_for()` for
Python < 3.12.
In Python 3.12, `asyncio.wait_for()` is implemented in terms of
`asyncio.timeout()` which fixed a bunch of issues. However, this was never
backported (because of the lack of `async.timeout()`) and there are still many
remainig issues, specially in Python 3.10, in `async.wait_for()`.
See https://github.com/python/cpython/pull/98518
2025-08-20 14:09:05 -07:00
Aleix Conchillo Flaqué
5286591826
Merge pull request #2464 from pipecat-ai/aleix/frame-processor-updates
...
various frame processor updates
2025-08-20 10:11:49 -07:00
Aleix Conchillo Flaqué
6831e63ec9
PipelineTask: use PipelineSource/PipelineSink and remove tasks
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
12bcb7db64
ParallelPipeline: use PipelineSource/PipelineSink and remove tasks
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
1b48b1d860
Pipeline: allow passing user source and sink processors
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
d161e2767f
FrameProcessor: allow pausing/resuming system frames
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
4e3af00b6d
tests: try to use default SleepFrame time
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
4015aedb86
tests: fix unit tests
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
75a6ee839b
BaseObserver: added new on_process_frame
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
13ce02c896
FrameProcessor: add new entry_processors() method
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
2fd5885dc3
pipeline: implement processors property
2025-08-20 07:40:21 -07:00
Aleix Conchillo Flaqué
d743586bfb
BasePipeline: move processors_with_metrics() to FrameProcessor
2025-08-20 07:40:21 -07:00
Aleix Conchillo Flaqué
8051017895
pipeline: wrap with pipelines, use direct mode and reduce tasks
2025-08-20 07:40:21 -07:00
Aleix Conchillo Flaqué
dc7bf98ce5
Pipeline: improve performance by using direct mode
2025-08-20 07:40:21 -07:00
Aleix Conchillo Flaqué
609a43a191
FrameProcessor: added processors/next/previous properties
2025-08-20 07:40:19 -07:00
Aleix Conchillo Flaqué
4fb04422d9
FrameProcessor: remove unused set_parent/get_parent
2025-08-20 07:40:02 -07:00
Mark Backman
2f74a7e674
Merge pull request #2469 from pipecat-ai/mb/11labs-text-normalization
...
Add apply_text_normalization to ElevenLabs TTS services
2025-08-19 18:21:33 -07:00
Mark Backman
5205f56087
Add apply_text_normalization to ElevenLabs TTS services
2025-08-19 21:19:00 -04:00
Mark Backman
694c792af3
Merge pull request #2470 from pipecat-ai/mb/11labs-settings-reconnect
...
Update ElevenLabsTTSService: update runtime configuration
2025-08-19 18:18:14 -07:00
TheNotary
48b3ad8f8f
adds support for creating InterimTranscriptFrames for Azure speech services
2025-08-19 17:00:42 -05:00
Mark Backman
406e82a842
Merge pull request #2438 from pipecat-ai/mb/delete-old-docs
...
Remove stale docs
2025-08-19 12:22:54 -07:00
Mark Backman
837de5f893
Merge pull request #2468 from pipecat-ai/mb/fix-mistral-docs-errors
...
Fix Mistral docstrings build errors
2025-08-19 12:22:26 -07:00
Mark Backman
10b9b1da2f
Merge pull request #2471 from pipecat-ai/mb/add-13j
...
Add foundational 13j for Azure STT
2025-08-19 12:10:03 -07:00
Mark Backman
7854a2ec83
Add foundational 13j for Azure STT
2025-08-19 14:36:31 -04:00
Mark Backman
ac7c69078f
Merge pull request #2442 from pipecat-ai/mb/retry-completion
...
retry_on_timeout: Anthropic, AWS Bedrock
2025-08-19 11:23:43 -07:00
Mark Backman
c9b4356ea6
Update changelog
2025-08-19 14:21:18 -04:00
Mark Backman
b3e4421191
Add retry_on_timeout to AWSBedrockLLMService
2025-08-19 14:20:35 -04:00
Mark Backman
84058c3948
Add retry_on_timeout to AnthropicLLMService
2025-08-19 14:20:35 -04:00
Mark Backman
aebc781419
Update ElevenLabsTTSService to update when voice_settings change
2025-08-19 13:51:10 -04:00
Mark Backman
4160446f4c
Update ElevenLabsTTSService: reconnect on model and language changes
2025-08-19 11:32:54 -04:00
Mark Backman
05a14af184
Fix Mistral docstrings build errors
2025-08-19 10:31:03 -04:00
Filipi da Silva Fuchter
89d2ef2bde
Merge pull request #2465 from pipecat-ai/filipi/heygen_changing_log_level
...
Changing heygen log level to trace.
2025-08-19 07:50:11 -03:00
Filipi Fuchter
f550015efb
Changing heygen log level to trace.
2025-08-18 18:00:25 -03:00
Abhishek
8bbdc7c8d1
Only set last_frame_time when handling OutputAudioRawFrame
...
We don't want to set `last_frame_time` on other frames like `HeartBeatFrame`, `LLMGeneratedTextFrame`, `InterruptionFrames` so that we can calculate `diff_time` and compare it against `vad_stop_secs` properly
2025-08-16 16:25:14 +05:30
Mark Backman
8fa44863fb
Merge pull request #2455 from pipecat-ai/vp-log-line
...
log: add Disconnected from ElevenLabs debug log
2025-08-15 14:12:28 -07:00
vipyne
088cb56922
log: add Disconnected from ElevenLabs debug log
2025-08-15 15:05:07 -05:00
Aleix Conchillo Flaqué
a789e5feea
Merge pull request #2451 from pipecat-ai/aleix/audio-buffer-processor-overlap
...
AudioBufferProcessor: fix overlap when buffer size is set
2025-08-14 15:31:50 -07:00
Aleix Conchillo Flaqué
16ca44131c
Merge pull request #2452 from pipecat-ai/aleix/runner-daily-direct-handlesigint
...
Runner: set handle_sigint to True for Daily direct
2025-08-14 15:25:05 -07:00
Mark Backman
418860cf26
Merge pull request #2450 from pipecat-ai/mb/fix-openai-changelog-entry
...
fix: Move OpenAI retry changelog entry to the correct release
2025-08-14 15:23:00 -07:00
Aleix Conchillo Flaqué
e2fc8b3dce
Runner: set handle_sigint to True for Daily direct
2025-08-14 14:55:52 -07:00
Aleix Conchillo Flaqué
8b641089f8
AudioBufferProcessor: fix overlap when buffer size is set
2025-08-14 14:44:08 -07:00
Mark Backman
d36ed755ce
fix: Move OpenAI retry changelog entry to the correct release
2025-08-14 17:34:35 -04:00
Mark Backman
7aaf64fe55
Merge pull request #2447 from pipecat-ai/mb/update-foundational-readme
...
Improve the foundational example README
2025-08-14 09:51:01 -07:00
Mark Backman
5f52008974
Improve the foundational example README
2025-08-14 11:29:04 -04:00
Mark Backman
d520677b23
Merge pull request #2408 from pipecat-ai/mb/add-mistral-llm
...
Add MistralLLMService
2025-08-14 08:19:18 -07:00
Mark Backman
42bd1e9d40
Add Mistral to README and pyproject.toml
2025-08-14 11:15:52 -04:00
Mark Backman
7f0494aa04
Override build_chat_completion_params for Mistral
2025-08-14 10:32:18 -04:00
Mark Backman
b7ae2989ac
Add foundational 14w-function-calling.py
2025-08-14 10:00:46 -04:00
Mark Backman
2b2b0f8121
Add MistralLLMService
2025-08-14 09:57:14 -04:00
Mark Backman
5ca33a2b00
Merge pull request #2445 from pipecat-ai/mb/fix-changelog-asyncai
...
fix: Changelog for Async AI bugfix
2025-08-14 06:48:08 -07:00
Mark Backman
938dcb613d
fix: Changelog for Async AI bugfix
2025-08-14 09:13:03 -04:00
Mark Backman
bc748cf9d0
Merge pull request #2444 from ashotbagh/fix/asyncai-force-flush
...
fix(asyncai): force flush WS TTS to eliminate stalls
2025-08-14 06:10:16 -07:00
Ashot
3b55d16a49
fix(asyncai): force flush WS TTS to eliminate stalls
2025-08-14 16:34:34 +04:00
Mark Backman
d7f31e0cbd
Merge pull request #2387 from pipecat-ai/mb/retry-chat-completion
...
Retry chat completions for OpenAILLMService and its subclasses
2025-08-13 14:39:40 -07:00
Mark Backman
c662a2d820
Merge pull request #2437 from pipecat-ai/mb/19-english
...
Foundational 19: Respond in English
2025-08-13 11:57:24 -07:00
Mark Backman
2c220ca54e
Remove stale docs
2025-08-13 14:11:41 -04:00
Mark Backman
89f0ff17c0
Merge pull request #2430 from pipecat-ai/aleix/pipecat-0.0.80
...
update CHANGELOG for 0.0.80
2025-08-13 09:41:43 -07:00
Mark Backman
b5465364fa
Foundational 19: Respond in English
2025-08-13 12:37:13 -04:00
Aleix Conchillo Flaqué
c024eb7b8c
update CHANGELOG for 0.0.80
2025-08-13 11:46:24 -04:00
Mark Backman
608570e89d
Merge pull request #2433 from pipecat-ai/mb/openai-realtime-text-modality
...
fix: Add text support to OpenAIRealtimeBetaLLMService
2025-08-13 08:41:33 -07:00
Mark Backman
3ad61a8a04
Remove stray - in changelog
2025-08-13 11:39:59 -04:00
Mark Backman
4c4bae2db6
Remove unnessecary messages from 19 and 19b examples
2025-08-13 11:39:59 -04:00
Mark Backman
901b6b5913
Add foundational 19b
2025-08-13 11:37:38 -04:00
Mark Backman
71cd0f1c87
fix: Add text support to OpenAIRealtimeBetaLLMService
2025-08-13 11:37:36 -04:00
Filipi da Silva Fuchter
a2a419e6db
Merge pull request #2435 from pipecat-ai/filipi/small_webrtc_end_pipeline
...
Fixed an issue where `SmallWebRTCTransport` ended before TTS finished.
2025-08-13 11:58:33 -03:00
Filipi Fuchter
bbbbdc459a
Fixed an issue where SmallWebRTCTransport ended before TTS finished.
2025-08-13 11:46:51 -03:00
Mark Backman
d203528dad
Merge pull request #2333 from yohan-altrium/fix/2277-azure-tts-ssml-reserved-characters
...
Fixes 2277 - SSML reserved characters causes Azure TTS to fail
2025-08-13 06:27:30 -07:00
Yohan Liyanage
4bcca7956e
Refactors the code based on PR comments and adds the relevant changelog entry.
2025-08-13 16:34:33 +05:30
Aleix Conchillo Flaqué
68a4cf4c68
Merge pull request #2427 from pipecat-ai/aleix/base-watchdog-priority-queue
...
WatchdogPriorityQueue: this is now a base class
2025-08-12 18:25:59 -07:00
Aleix Conchillo Flaqué
0508ddddfb
WatchdogPriorityQueue: fix watchdog sentinel insertion
...
We now force each inserted item in the priority queue to be a tuple and the
actual value to be last in the tuple. All the previous values in the tuple also
need to be numeric.
2025-08-12 17:40:58 -07:00
Mark Backman
8714c9137f
Code review fixes
2025-08-12 17:49:13 -04:00
Mark Backman
4c029fcfa7
Update OpenAILLMService subclasses to use the new build_chat_completion_params function
2025-08-12 17:48:51 -04:00
Mark Backman
5c86f8e687
Add timeout/retry logic and refactor parameter building in BaseOpenAILLMService
...
- Add timeout (default 5.0s) and retry_on_timeout parameters to constructor
- Implement timeout/retry logic in get_chat_completions using asyncio.wait_for
- Extract build_chat_completion_params() as public method for subclass customization
2025-08-12 17:48:51 -04:00
Mark Backman
54a4d8a9f8
Merge pull request #2422 from thsunkid/thu/fix-set-lang-in-base-whisper
...
Fix: assigns string code instead of Language enum to BaseWhisperSTTService._language
2025-08-12 11:57:46 -07:00
Mark Backman
38af514d95
Merge pull request #2407 from pipecat-ai/mb/add-gemini-tts
...
Add GeminiTTSService
2025-08-12 11:56:45 -07:00
Aleix Conchillo Flaqué
6aa80c0b8e
Merge pull request #2424 from pipecat-ai/aleix/system-frame-queues-fix
...
FrameProcessor: fix race condition on FrameProcessorQueue
2025-08-12 11:56:00 -07:00
Mark Backman
e720573e60
Added 07n-interruptible-gemini
2025-08-12 14:54:49 -04:00
Mark Backman
541a43905b
Add GeminiTTSService
2025-08-12 14:52:20 -04:00
Aleix Conchillo Flaqué
707df913cd
FrameProcessor: fix race condition on FrameProcessorQueue
...
We need to increment the counters before the await otherwise we could go to a
different task that could add an item with the same counter.
Also, we need to handle non-frame items as well.
2025-08-12 11:48:22 -07:00
Aleix Conchillo Flaqué
3f3d757581
tests: added WatchdogQueue and WatchdogPriorityQueue unit tests
2025-08-12 11:48:22 -07:00
Aleix Conchillo Flaqué
7c781ce816
WatchdogPriorityQueue: make WatchdogPriorityCancelSentinel public
2025-08-12 11:34:31 -07:00
Aleix Conchillo Flaqué
f3efc9da00
WatchdogQueue: make WatchdogQueueCancelSentinel public
2025-08-12 11:34:31 -07:00
Mark Backman
827a70104d
Merge pull request #2425 from pipecat-ai/mb/runner-add-exotel
...
Add Exotel support to the development runner
2025-08-12 10:36:54 -07:00
Mark Backman
a40327305c
Add Exotel support to the development runner
2025-08-12 13:21:18 -04:00
Thu Nguyen
168af44429
Fix: assigns string code instead of Language enum to _language attr of BaseWhisperSTTService
2025-08-12 20:27:26 +07:00
Mark Backman
5f8433476c
Merge pull request #2397 from gladiaio/PLA-37-GladiaSTTService-minor-tweaks
...
feat: add minor tweaks to GladiaSTTService
2025-08-12 04:59:40 -07:00
Fabrice Lamant
6a6fea74f5
fix: set default region to none
2025-08-12 13:31:51 +02:00
Mark Backman
91b557ecbf
Merge pull request #2419 from pipecat-ai/mb/fix-lockfile-workflow
2025-08-12 03:39:54 -07:00
Mark Backman
be85291414
Merge pull request #2420 from pipecat-ai/mb/runner-handle-sigint-default
2025-08-12 03:39:29 -07:00
Fabrice Lamant
09f171b69d
fix: only pass region if set
2025-08-12 12:05:38 +02:00
Aleix Conchillo Flaqué
929fd98958
Merge pull request #2416 from pipecat-ai/aleix/release-evals-vision
...
scripts(evals): add vision support
2025-08-11 20:08:08 -07:00
Aleix Conchillo Flaqué
1cfbfcaf11
scripts(evals): add vision support
2025-08-11 20:06:24 -07:00
Mark Backman
cd5a3c13bd
Development runner: handle_sigint defaults to False
2025-08-11 22:06:56 -04:00
Mark Backman
9b871b0cc5
Update uv.lock, remove lockfile workflow, update CONTRIBUTING with dependency guidance
2025-08-11 21:39:25 -04:00
Mark Backman
0d499a8aa3
Merge pull request #2409 from pipecat-ai/mb/refactor-playht-http
...
Refactor PlayHTHttpTTSService to use aiohttp
2025-08-11 18:20:58 -07:00
Mark Backman
45292ab13d
Merge pull request #2411 from pipecat-ai/mb/fix-websocket-service-retry
...
fix: WebsocketService retry logic incorrectly handling ConnectionClos…
2025-08-11 18:17:50 -07:00
Mark Backman
be6ea0dbf6
Code review feedback
2025-08-11 21:17:04 -04:00
Aleix Conchillo Flaqué
fb18ae174e
Merge pull request #2417 from pipecat-ai/aleix/release-evals-15-series
...
scripts(evals): add multilinguag support and 15 series
2025-08-11 17:14:47 -07:00
Mark Backman
c4506523ab
Refactor PlayHTHttpTTSService to use aiohttp
2025-08-11 19:58:25 -04:00
Aleix Conchillo Flaqué
b360cb31dc
scripts(evals): add multilinguag support and 15 series
2025-08-11 15:21:14 -07:00
Aleix Conchillo Flaqué
07f104199c
Merge pull request #2415 from pipecat-ai/aleix/moondream-2025-01-09
...
MoondreamService: update to revision 2025-01-09
2025-08-11 15:10:35 -07:00
Aleix Conchillo Flaqué
bc1949b4bf
MoondreamService: update to revision 2025-01-09
2025-08-11 14:54:04 -07:00
Aleix Conchillo Flaqué
2035dd8b39
Merge pull request #2403 from pipecat-ai/aleix/system-frame-queue-priority-fix
...
FrameProcessor: fix system frame higher priorty and use a PriortyQueue
2025-08-11 13:57:57 -07:00
Aleix Conchillo Flaqué
24c8189327
Merge pull request #2405 from pipecat-ai/aleix/frame-processor-direct-mode
...
FrameProcessor: introduce direct mode
2025-08-11 13:57:34 -07:00
Mark Backman
998ac32627
Merge pull request #2413 from captaincaius/fix-stt-mute-filter-vad-frames-20250810
...
Add VADUserStartSpeakingFrame VADUserStopSpeakingFrame to STTMuteFilter (fix #2412 )
2025-08-11 13:54:34 -07:00
Aleix Conchillo Flaqué
50645c1c4f
README: recommend python 3.11-3.12
...
Python 3.11 has significant performance improvements compared to 3.10 which
makes Pipecat's asyncio heavy use specially better.
2025-08-11 13:53:08 -07:00
Aleix Conchillo Flaqué
8ce29ee8f2
FrameProcessor: fix system frame higher priorty and use a PriortyQueue
2025-08-11 13:53:08 -07:00
Captain Caius
7b8aeef4cc
update changelog
2025-08-11 12:45:54 -07:00
Aleix Conchillo Flaqué
6a24457f0e
FrameProcessor: introduce direct mode
...
Direct mode avoids creating internal queues and tasks and processes frames right
away. This might be useful for some very simple processors.
2025-08-11 09:26:31 -07:00
Aleix Conchillo Flaqué
2c01c2b5b3
Merge pull request #2404 from pipecat-ai/aleix/examples-22-simplify-main-pipeline
...
examples(foundational): update 22 series with simple main pipelines
2025-08-11 09:14:39 -07:00
Aleix Conchillo Flaqué
1c2e114fa2
examples(foundational): update 22 series with simple main pipelines
2025-08-11 09:13:09 -07:00
Filipi da Silva Fuchter
0f137e36c2
Merge pull request #2399 from pipecat-ai/filipi/heygen_latency
...
Improving the latency of the `HeyGenVideoService`.
2025-08-11 09:13:10 -03:00
Filipi Fuchter
b7f12a96f1
Improving the latency of the HeyGenVideoService.
2025-08-11 09:11:17 -03:00
Filipi da Silva Fuchter
3331f71e17
Merge pull request #2398 from pipecat-ai/filipi/ttfb_metrics_video_services
...
Added TTFB metrics for `HeyGenVideoService` and `TavusVideoService`.
2025-08-11 09:09:27 -03:00
Filipi Fuchter
55d200e2d1
Added TTFB metrics for HeyGenVideoService and TavusVideoService.
2025-08-11 09:07:21 -03:00
Captain Caius
3fae00e067
Add VADUserStartSpeakingFrame VADUserStopSpeakingFrame to STTMuteFilter
2025-08-10 19:35:04 -07:00
Mark Backman
78cdefd191
Merge pull request #2410 from smokyabdulrahman/issue-2373
...
Support endpoint_id for AzureSTTService
2025-08-10 16:43:29 -07:00
Mark Backman
42502a4f3b
fix: WebsocketService retry logic incorrectly handling ConnectionClosedOK exception
2025-08-10 19:35:05 -04:00
Abdulrahman Alrahma
fc67cc3302
Support endpoint_id for AzureSTTService
2025-08-10 22:24:47 +01:00
Aleix Conchillo Flaqué
241ab19228
update uv.lock with numba dependency
2025-08-08 15:12:55 -07:00
Mark Backman
c08e8ec8fb
Merge pull request #2391 from pipecat-ai/mb/readme-local-dev
...
Update README with local dev setup for contributors
2025-08-08 11:15:58 -07:00
Mark Backman
eb9bc9644e
Merge pull request #2400 from pipecat-ai/mb/pin-numba-0.61.2
...
fix: pin numba to >=0.61.2
2025-08-08 11:15:22 -07:00
Mark Backman
3a306dae90
fix: pin numba to >=0.61.2
2025-08-08 10:52:47 -04:00
Fabrice Lamant
e503ea7466
feat: add minor tweaks to GladiaSTTService
2025-08-08 10:21:52 +02:00
Mark Backman
c42cc8254f
Update README with local dev setup for contributors
2025-08-07 22:07:35 -04:00
Aleix Conchillo Flaqué
a8e21f7d5d
Merge pull request #2395 from pipecat-ai/aleix/examples-15-inherit-parallel-pipeline
...
examples(foundational): move 15/15a logic into its own processor
2025-08-07 17:59:28 -07:00
Aleix Conchillo Flaqué
c6ef8de578
scripts(evals): fix 14v-function-calling-openai.py
2025-08-07 17:57:47 -07:00
Aleix Conchillo Flaqué
fc571fba42
examples(foundational): move 15/15a logic into its own processor
2025-08-07 17:57:47 -07:00
Mark Backman
0502ee2b5a
Merge pull request #2394 from pipecat-ai/mb/uv-lock
...
Update uv.lock
2025-08-07 15:25:38 -07:00
Mark Backman
9ec047094b
Update uv.lock
2025-08-07 18:24:47 -04:00
Mark Backman
d991c106c8
Merge pull request #2393 from pipecat-ai/mb/openai-dep
...
fix: pin openai package upper bound to <=1.99.1
2025-08-07 15:19:05 -07:00
Mark Backman
312fb23c89
fix: pin openai package upper bound to <=1.99.1
2025-08-07 18:00:25 -04:00
Aleix Conchillo Flaqué
4d7f21d44e
Merge pull request #2392 from pipecat-ai/aleix/avoid-using-tts-say
...
deprecate TTSService.say() method
2025-08-07 13:55:49 -07:00
Aleix Conchillo Flaqué
ec25d0a7c9
examples(foundational): fix 20a-persistent-context-openai
2025-08-07 13:48:32 -07:00
Aleix Conchillo Flaqué
2b8218deaa
examples(foundational): use TTSSpeakFrame instead of TTSService.say()
2025-08-07 13:48:32 -07:00
Aleix Conchillo Flaqué
11119430cd
TTSService: deprecate say() method
2025-08-07 13:48:32 -07:00
kompfner
9ca79232c1
Merge pull request #2380 from pipecat-ai/pk/deprecate-llm-messages-frame
...
Deprecate `LLMMessagesFrame`, `LLMUserResponseAggregator`, and `LLMAssistantResponseAggregator`
2025-08-07 15:13:01 -04:00
Paul Kompfner
9ea06c33f7
Bump deprecation version of LLMMessagesFrame, LLMUserResponseAggregator, and LLMAssistantResponseAggregator (the deprecation slipped past the 0.0.78 release)
2025-08-07 14:56:50 -04:00
Paul Kompfner
30a1dd202e
Move deprecation of LLMMessagesFrame, LLMUserResponseAggregator, and LLMAssistantResponseAggregator into the next release in the changelog
2025-08-07 14:55:11 -04:00
Paul Kompfner
809ab0b7b6
Improve printed deprecation warning
2025-08-07 14:45:35 -04:00
Paul Kompfner
2b5db9c562
Remove redundant deprecation warning in docstring
2025-08-07 14:45:35 -04:00
Paul Kompfner
b4a886b59f
Remove redundant deprecation warning in docstring
2025-08-07 14:45:35 -04:00
Paul Kompfner
07eb00722b
Fix langchain unit test
2025-08-07 14:45:35 -04:00
Paul Kompfner
96652b8fba
Add new deprecations to changelog
2025-08-07 14:45:30 -04:00
Paul Kompfner
df1fcf0c68
Remove unused import
2025-08-07 14:43:37 -04:00
Paul Kompfner
711f740d9e
Update UserResponseAggregator to avoid using the now-deprecated LLMUserResponseAggregator
2025-08-07 14:43:37 -04:00
Paul Kompfner
a0bda98c20
Update langchain to avoid using the now-deprecated LLMMessagesFrame, LLMUserResponseAggregator, and LLMAssistantResponseAggregator
2025-08-07 14:43:37 -04:00
Paul Kompfner
1c1bae35ab
Mention deprecation in docstring for LLMMessagesFrame
2025-08-07 14:43:37 -04:00
Paul Kompfner
56c52c2cf2
Deprecate LLMUserResponseAggregator and LLMAssistantResponseAggregator, which depend on the now-deprecated LLMMessagesFrame.
2025-08-07 14:43:37 -04:00
Paul Kompfner
740aee1a1a
Fix an issue in AnthropicLLMContext where we would never initialize turns_above_cache_threshold if we were upgrading from an OpenAILLMContext.
...
I noticed this when working on 22c-natural-conversation-mixed-llms.py
2025-08-07 14:43:37 -04:00
Paul Kompfner
f0391c3280
Progress on updating foundational examples to avoid using the newly-deprecated LLMMessagesFrame.
...
Skipping over 07b-interruptible-langchain.py for now, as it requires deeper changes involving `LLMUserResponseAggregator` and `LLMAssistantResponseAggregator`.
2025-08-07 14:43:37 -04:00
Paul Kompfner
64e48e4660
Deprecate LLMMessagesFrame.
...
The same functionality can be achieved using either:
- `LLMMessagesUpdateFrame` with the desired messages, with `run_llm` set to `True`
- `OpenAILLMContextFrame` with a new context initialized with the desired messages
2025-08-07 14:43:37 -04:00
Paul Kompfner
b8147bdbbd
Add missing Deepgram key to env.example
2025-08-07 14:43:37 -04:00
Aleix Conchillo Flaqué
315e45d41b
Merge pull request #2389 from pipecat-ai/aleix/pipecat-0.0.78
...
update CHANGELOG for 0.0.78
2025-08-07 11:34:27 -07:00
Aleix Conchillo Flaqué
c057139c48
update CHANGELOG for 0.0.78
2025-08-07 11:14:54 -07:00
Mark Backman
c61e07132d
Merge pull request #2390 from pipecat-ai/mb/optionally-ignore-emulated-speech
...
feat: Add option to ignore emulated user speech while the bot is spea…
2025-08-07 11:14:46 -07:00
Mark Backman
a5f5e418a8
feat: Add option to ignore emulated user speech while the bot is speaking
2025-08-07 14:08:11 -04:00
Mark Backman
31acfaa091
Merge pull request #2388 from pipecat-ai/14v-adding-openai-stt-tts-llm-functioncalling
...
14v adding OpenAI stt tts llm functioncalling
2025-08-07 10:22:35 -07:00
Mark Backman
69541c8835
Linting fix, plus update eval suite with 14v and others, tiny fix for 14m, too
2025-08-07 13:20:45 -04:00
Varun Singh
af94620839
Add OpenAI function calling example with Pipecat
...
Introduces a new example script demonstrating how to use OpenAI's function calling capabilities within a Pipecat pipeline. The example integrates OpenAI STT, TTS, and LLM services, registers a weather function, and sets up a pipeline for real-time audio interaction over WebRTC.
2025-08-07 13:20:45 -04:00
Filipi da Silva Fuchter
cec8a74293
Merge pull request #2386 from pipecat-ai/filipi/parallel_pipeline
...
Only push the StartFrame when all parallel pipelines have processed it
2025-08-07 14:20:30 -03:00
Filipi Fuchter
228a55ac1e
Only push the StartFrame when all parallel pipelines have processed it.
2025-08-07 14:18:21 -03:00
Vanessa Pyne
ab9831daf0
Merge pull request #2382 from pipecat-ai/vp-trace-ignore-message
...
log: warning -> trace for elevenlabs tts unavailable context
2025-08-07 09:35:57 -05:00
Vanessa Pyne
e8c3f5dea6
Update src/pipecat/services/elevenlabs/tts.py
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-08-07 09:23:33 -05:00
Mark Backman
4288b5e780
Merge pull request #2381 from pipecat-ai/aleix/runner-args-pipeline-idle-timeout
...
allow specifying PipelineTask idle timeout to runner arguments
2025-08-07 04:47:08 -07:00
Mark Backman
23343dd7e7
Remove idle_timeout_secs from quickstart
2025-08-07 07:44:21 -04:00
Mark Backman
88de5dd415
Merge pull request #2383 from pipecat-ai/aleix/riva-stt-iterator-exception
...
properly handle concurrent.futures.CancelledError
2025-08-07 04:39:56 -07:00
Mark Backman
33f87589d1
Merge pull request #2384 from pipecat-ai/aleix/release-evals-soniox-inworld-asyncai
...
scripts(evals): added soniox, inworld and asyncai
2025-08-07 04:35:18 -07:00
Aleix Conchillo Flaqué
7ed14ad91f
scripts(evals): added soniox, inworld and asyncai
2025-08-06 23:14:50 -07:00
Aleix Conchillo Flaqué
86c6141580
DailyTransport: handle future cancellation
2025-08-06 23:03:20 -07:00
Aleix Conchillo Flaqué
c97643c797
RivaSTTService: always use WatchdogQueue
2025-08-06 23:00:03 -07:00
Aleix Conchillo Flaqué
434d346079
RivaSTTService: handle future cancellation
2025-08-06 22:59:52 -07:00
vipyne
64ae8d2394
log: warning -> trace for elevenlabs tts unavailable context
2025-08-06 22:40:47 -05:00
Aleix Conchillo Flaqué
786f24c9db
examples(foundational): use RunnerArgs.pipeline_idle_timeout_secs
2025-08-06 19:38:06 -07:00
Aleix Conchillo Flaqué
38951aab56
scripts(evals): use RunnerArguments.pipeline_idle_timeout_secs
2025-08-06 19:37:29 -07:00
Aleix Conchillo Flaqué
ed8b0655a8
scripts(evals): fix runner eval cancellation
...
We need to call asyncio.gather() just once, not for every cancelled task.
2025-08-06 19:36:42 -07:00
Aleix Conchillo Flaqué
0b2b9f5f1b
RunnerArguments: add pipeline_idle_timeout_secs
2025-08-06 19:35:40 -07:00
Filipi da Silva Fuchter
ad1841b739
Merge pull request #2377 from pipecat-ai/filipi/fast_api_freeze_issue
...
Fixed an issue in BaseOutputTransport where the loop could consume all CPU.
2025-08-06 14:58:36 -03:00
Mark Backman
b0c002c128
Merge pull request #2378 from pipecat-ai/mb/pyproject-compat-updates
...
Add new python-compatiblity workflow to check for dependency compatib…
2025-08-06 10:40:29 -07:00
Mark Backman
820176084c
Add support for 3.13 by bumping min version for vllm to 0.9.0, adding support for torch and torchaudio up to the next major version
2025-08-06 13:36:01 -04:00
Mark Backman
5b7e31beff
README updates for python versions
2025-08-06 13:36:01 -04:00
Mark Backman
41a22d3bf4
Add new python-compatiblity workflow to check for dependency compatibility across supported python versions
2025-08-06 13:36:01 -04:00
Filipi Fuchter
84fecabac5
Removing audio sleep from FastAPI and WebSocket server when they are not connected.
2025-08-06 14:02:51 -03:00
Filipi Fuchter
bbe01d10ef
Fixed an issue in BaseOutputTransport where the loop could consume all CPU.
2025-08-06 12:42:58 -03:00
Mark Backman
4364990fd0
Merge pull request #2375 from fabrice404/gladia-region-selection
...
Gladia region selection
2025-08-06 07:01:24 -07:00
Fabrice Lamant
e576fa481f
Add new region feature for GladiaSTTService in CHANGELOG
2025-08-06 15:31:10 +02:00
Mark Backman
ac6b59cae2
Merge pull request #2372 from pipecat-ai/mb/dotenv-dev
...
Wider package support for python-dotenv dev dep
2025-08-06 06:06:01 -07:00
Mark Backman
12e168e740
Wider package support for python-dotenv dev dep
2025-08-06 09:04:01 -04:00
Mark Backman
ac354f66ed
Merge pull request #2371 from pipecat-ai/mb/docs-gen-with-uv
...
Update docs auto-generation to use uv
2025-08-06 06:02:52 -07:00
Mark Backman
eead793927
Merge pull request #2370 from pipecat-ai/mb/update-workflows-for-uv
...
Update workflows for uv
2025-08-06 05:54:55 -07:00
Fabrice Lamant
0594a203fc
Add new region parameter to Gladia
2025-08-06 14:28:06 +02:00
Mark Backman
2337a2d92d
Remove dev-requirements.txt and mentions of it
2025-08-05 21:46:50 -04:00
Mark Backman
b3e2603553
Update workflows for uv
2025-08-05 21:45:48 -04:00
Mark Backman
29229df719
Speed up builds, mocking large packages
2025-08-05 21:34:40 -04:00
Aleix Conchillo Flaqué
61f4dd2ff2
scripts(evals): fix 14e-function-calling-google
2025-08-05 17:44:45 -07:00
Mark Backman
42094fb206
Update docs auto-generation to use uv
2025-08-05 20:37:27 -04:00
Aleix Conchillo Flaqué
58c41f112a
DailyRunnerArguments: make body optional (fix)
2025-08-05 16:59:36 -07:00
Aleix Conchillo Flaqué
fa55e2ca9b
Merge pull request #2369 from pipecat-ai/aleix/pipeline-task-cancellation-fix
...
PipelineTask: always try to cancel things
2025-08-05 16:56:23 -07:00
Aleix Conchillo Flaqué
313fdc92a1
DailyRunnerArguments: make body optional
2025-08-05 16:39:18 -07:00
Aleix Conchillo Flaqué
d22d2da03d
PipelineTask: always try to cancel things
...
In a previous commit we only cleanup things if the user run
`task.cancel()`. However, if the task finishes cleanly we were not cancelling
anything.
2025-08-05 16:24:59 -07:00
Aleix Conchillo Flaqué
de2ae9a2ec
Merge pull request #2368 from pipecat-ai/aleix/release-evals-runner-args-fix
...
pass runner arguments to release evals
2025-08-05 16:23:32 -07:00
Aleix Conchillo Flaqué
52a6d8013c
scripts(evals): pass runner arguments to run_bot()
2025-08-05 16:13:32 -07:00
Aleix Conchillo Flaqué
f14cbae9b5
DailyRunnerArguments: make token optional
...
DailyTransport can get a None token value.
2025-08-05 15:46:12 -07:00
Aleix Conchillo Flaqué
8fe906438a
Merge pull request #2358 from pipecat-ai/aleix/system-frames-queued
...
system frames are now queued
2025-08-05 15:09:52 -07:00
Mark Backman
d8f4db8827
Merge pull request #2367 from richtermb/richtermb/fix-errorframe-docstring
...
Rename 'source' parameter to 'processor' in ErrorFrame class document…
2025-08-05 15:09:18 -07:00
Aleix Conchillo Flaqué
a5ea6e1642
FrameProcessor: system frames are now queued
...
System frames are now queued. Before, system frames could be generated from any
task and would not guarantee any order which was causing undesired
behavior. Also, it was possible to get into some rare recursion issues because
of the way system frames were executed (they were executed in-place, meaning
calling `push_frame()` would finish after the system frame traversed all the
pipeline). This makes system frames more deterministic.
2025-08-05 15:05:50 -07:00
richtermb
e777e78510
Rename 'source' parameter to 'processor' in ErrorFrame class documentation for clarity.
2025-08-05 15:02:00 -07:00
Aleix Conchillo Flaqué
49a5a1e375
PipelineTask: improve task cancellation
2025-08-05 14:49:23 -07:00
Aleix Conchillo Flaqué
61cb45d61b
PipelineTask: also wait on CancelFrame
...
Before CancelFrames didn't need to be waited for because system frames were
processed in-place and therefore calling push_frame() would finalize after it
traversed all the pipeline. Now, system frames are queued so we need to wait
until CancelFrame reaches the end of the pipeline.
2025-08-05 14:49:23 -07:00
Aleix Conchillo Flaqué
6c6deb4e85
Merge pull request #2366 from pipecat-ai/aleix/run-bot-runner-arguments
...
add sigint/sigterm to RunnerArguments
2025-08-05 14:46:19 -07:00
Aleix Conchillo Flaqué
66ad29b2b1
example: pass RunnerArguments to run_bot()
...
This lets us get handle_sigint from RunnerArguments which knows where the
application is running and if SIGINT/SIGTERM should be handled or not.
2025-08-05 14:38:55 -07:00
Aleix Conchillo Flaqué
21e4f0d56d
PipelineRunner: argument ordering
2025-08-05 14:38:55 -07:00
Aleix Conchillo Flaqué
627b44bac2
runner: use new RunnerArguments handle_sigint/handle_sigterm
...
This allow us to control applications behavior from the runner arguments, which
depen on the environment they run.
2025-08-05 14:38:55 -07:00
Aleix Conchillo Flaqué
e2a576beca
RunnerArguments: add handle_sigint/handle_sigterm
2025-08-05 14:32:28 -07:00
Mark Backman
2981afb117
Merge pull request #2361 from pipecat-ai/mb/fix-changelog-simli
...
Fix Simli changelog entry placement
2025-08-05 14:12:38 -07:00
Mark Backman
d422c57b52
Merge pull request #2304 from pipecat-ai/mb/cartesia-cjk-lang-support
...
CartesiaTTSService: Add CJK lang support for word timestamps
2025-08-05 14:08:53 -07:00
Mark Backman
06d8bbd154
Fix Simli changelog entry placement
2025-08-05 17:07:58 -04:00
Mark Backman
35108afeb8
Merge pull request #2360 from pipecat-ai/mb/add-heygen-readme
...
Add HeyGen to the README page
2025-08-05 14:05:33 -07:00
Mark Backman
a0e2a2754a
Merge pull request #2327 from richtermb/richtermb/push-more-error-frames
...
Add source parameter to ErrorFrame and set it in FrameProcessor. Upda…
2025-08-05 14:04:52 -07:00
Mark Backman
b8d620c8bb
Merge pull request #2362 from pipecat-ai/mb/aws-stt-languages
...
AWSTranscribeSTTService add support for new languages
2025-08-05 14:00:50 -07:00
Mark Backman
f26bbe4092
Merge pull request #2363 from pipecat-ai/mb/update-14p
...
Update 14p, add 14p to evals, add Google creds to env.example
2025-08-05 14:00:13 -07:00
Mark Backman
52cb23f8d5
Merge pull request #2364 from pipecat-ai/mb/11labs-default-model
...
ElevenLabs TTS services: revert to Turbo v2.5 as default model
2025-08-05 13:59:59 -07:00
Filipi da Silva Fuchter
17e7f8a2cd
Merge pull request #2352 from pipecat-ai/filipi/webrtc_audio_frame
...
Implementing if the bot it is speaking or not based on the SpeechOutputAudioRawFrame
2025-08-05 17:26:44 -03:00
richtermb
efddc4732c
Refactor ErrorFrame: rename source field to processor for clarity and update related references in FrameProcessor.
2025-08-05 13:25:08 -07:00
richtermb
4476a76ad7
Merge branch 'main' into richtermb/push-more-error-frames
2025-08-05 13:23:24 -07:00
Filipi Fuchter
64592b274b
Fixed an issue where BotStartedSpeakingFrame and BotStoppedSpeakingFrame
...
were not emitted when using `TavusVideoService` or `HeyGenVideoService`.
2025-08-05 17:11:34 -03:00
Aleix Conchillo Flaqué
95c661bdaa
Merge pull request #2365 from pipecat-ai/aleix/update-release-evals-for-new-runner
...
scripts(evals): update to use new runner function
2025-08-05 13:07:57 -07:00
Aleix Conchillo Flaqué
5546c8e01c
scripts(evals): update to use new runner function
2025-08-05 11:46:28 -07:00
Mark Backman
14e02c1b08
ElevenLabs TTS services: revert to Turbo v2.5 as default model
2025-08-05 13:44:37 -04:00
Mark Backman
ba5a5c7187
Update 14p, add 14p to evals, add Google creds to env.example
2025-08-05 13:30:36 -04:00
Mark Backman
2378cba155
AWSTranscribeSTTService add support for new languages
2025-08-05 13:01:06 -04:00
Mark Backman
1138c92a00
Merge pull request #2217 from simliai/main
...
feat: Add Simli Trinity models support to pipecat
2025-08-05 09:01:20 -07:00
Antonyesk601
fb82dc8308
Update CHANGELOG.md
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-08-05 17:46:01 +02:00
Mark Backman
c8a15f30fa
Add HeyGen to the README page
2025-08-05 10:54:49 -04:00
antonyesk601
72168070f1
update changelog
2025-08-05 14:18:41 +00:00
Mark Backman
50083d1144
Merge pull request #2342 from pipecat-ai/mb/runner-connect-request-body
...
Development runner handles body information in the RTVI connect request
2025-08-05 05:15:55 -07:00
Mark Backman
64732518c6
Development runner handles body information in the RTVI connect request
2025-08-05 07:26:34 -04:00
Mark Backman
c3d8ea210f
CartesiaTTSService: Add CJK lang support for word timestamps
2025-08-05 07:17:40 -04:00
Filipi da Silva Fuchter
98ed614f63
Merge pull request #2357 from pipecat-ai/filipi/latency_observer
...
Added detailed latency logging to UserBotLatencyLogObserver.
2025-08-05 08:11:48 -03:00
Filipi Fuchter
e43bdff31e
Added detailed latency logging to UserBotLatencyLogObserver.
2025-08-04 19:36:30 -03:00
Mark Backman
42e48381fe
Merge pull request #2355 from pipecat-ai/mb/update-readme-for-uv
...
Update the README with uv-centric steps
2025-08-04 15:28:07 -07:00
Mark Backman
df7ba64b4a
Merge pull request #2354 from pipecat-ai/mb/revert-43-inline-script
...
Remove inline script from foundational 43a
2025-08-04 15:27:28 -07:00
Mark Backman
ac9b2e67a7
Merge pull request #2349 from pipecat-ai/mb/runner-support-daily-url-arg
...
daily runner util: remove arg parsing, add auto room, token generation
2025-08-04 13:44:25 -07:00
Mark Backman
c9918607cf
Merge pull request #2335 from pipecat-ai/mb/quickstart-runner-improvements
...
Improve quickstart logging, runner startup message
2025-08-04 13:43:42 -07:00
Mark Backman
cfda410a43
Remove foundational requirements.txt file
2025-08-04 16:38:37 -04:00
Mark Backman
c773ddf83d
Update foundational examples README
2025-08-04 16:26:11 -04:00
Mark Backman
54d5ebbc20
Update the README with uv-centric steps
2025-08-04 16:11:38 -04:00
Mark Backman
35002cd727
Remove inline script from foundational 43a
2025-08-04 15:46:18 -04:00
Mark Backman
53d75faa47
Merge pull request #2330 from pipecat-ai/mb/runner-clean-proxy-name
...
Runner: strip protocol from proxy address
2025-08-04 10:42:16 -07:00
Mark Backman
2901dddc2b
Merge pull request #2338 from pipecat-ai/mb/update-release-evals-tavus
...
Add Tavus, HeyGen, Simli to release-evals
2025-08-04 10:38:27 -07:00
Mark Backman
3a8d809837
Runner: strip protocol from proxy address
2025-08-04 13:38:02 -04:00
Mark Backman
1b3c2bee30
Merge pull request #2331 from pipecat-ai/mb/more-foundational
...
Updating more foundational examples
2025-08-04 10:37:15 -07:00
Mark Backman
69f049cb63
Merge pull request #2328 from pipecat-ai/mb/04b-example-cleanup
...
Align 04b livekit example with other foundational examples
2025-08-04 10:36:57 -07:00
Vanessa Pyne
96b1000e52
Merge pull request #2341 from getchannel/realtime-text
...
Hotfix: Correct Gemini Live API class to fix 1007 payload error.
2025-08-04 11:03:57 -05:00
Filipi da Silva Fuchter
0184a8c231
Merge pull request #2351 from pipecat-ai/filipi/tavus_transport_ready
...
Changed `TavusVideoService` to send audio or video frames only after the transport is ready, preventing warning messages at startup.
2025-08-04 11:48:27 -03:00
Filipi Fuchter
c22866ed58
Mentioning the TavusVideoService fix in the changelog.
2025-08-04 11:46:24 -03:00
Filipi Fuchter
0e533d21be
Only send audio and video from the tavus video service if the transport is ready.
2025-08-04 10:52:30 -03:00
Mark Backman
6f6f4c3dea
Merge pull request #2348 from sam-s10s/speechmatics-stt
...
Fix for Speechmatics STT
2025-08-04 06:15:39 -07:00
Mark Backman
f609971637
daily runner util: remove arg parsing, add auto room, token generation
2025-08-03 21:50:44 -04:00
Mark Backman
54ff10ae86
Merge pull request #2332 from hankehly/fix-piper-tts-json-payload
...
Fix PiperTTSService to send TTS input as JSON object
2025-08-03 17:39:04 -07:00
hankehly
77057eb829
Fix ruff formatting
2025-08-04 08:13:16 +09:00
Mark Backman
2b1a7b840d
Merge pull request #2346 from adenta/heygen-testing
...
me trying to get heygen working
2025-08-03 14:11:14 -07:00
Sam Sykes
e07db88bc0
Updated changelog.
2025-08-03 22:11:10 +01:00
Sam Sykes
c2282b0e73
Set user_id to "" (not None) for RTVIProcessor.
2025-08-03 22:08:22 +01:00
Andrew Denta
593bf09d8d
update script
2025-08-03 17:01:27 -04:00
Sam Sykes
534ed77ebf
Merge branch 'main' into speechmatics-stt
2025-08-03 21:51:35 +01:00
Andrew Denta
193299988d
me trying to get heygen working
2025-08-03 13:42:07 -04:00
Aleix Conchillo Flaqué
d589bcb345
Merge pull request #2344 from pipecat-ai/aleix/daily-python-0.19.6
...
pyproject: update daily-python to 0.19.6
2025-08-03 10:15:15 -07:00
Aleix Conchillo Flaqué
011ebc2801
Merge pull request #2345 from pipecat-ai/aleix/task-observer-signature-performance
...
TaskObserver: don't inspect on_push_frame signature for every frame
2025-08-03 10:15:00 -07:00
Aleix Conchillo Flaqué
3a72e94d0c
LLMService: only do handle function inspection once
2025-08-03 10:09:19 -07:00
Aleix Conchillo Flaqué
d6d39fc873
TaskObserver: don't inspect on_push_frame signature for every frame
2025-08-03 10:09:17 -07:00
Pete
258e83c904
Fix: Correct Gemini Live API text input to prevent 1007 WebSocket errors
...
- Restore TextInputMessage.realtimeInput structure for correct API format
- Remove invalid turnComplete message from _send_user_text method
- turnComplete is only valid for clientContent, not realtimeInput messages
- realtimeInput text completion is automatically inferred by the API
This fixes WebSocket 1007 errors caused by mixing realtimeInput and
clientContent message types in violation of the Gemini Live API contract.
2025-08-03 10:58:59 -04:00
Mark Backman
061f2086b2
Merge pull request #2343 from pipecat-ai/mb/update-pre-commit-ruff-version
...
Update pre-commit-config ruff version
2025-08-03 03:38:54 -07:00
Aleix Conchillo Flaqué
a1f3f51168
pyproject: update daily-python to 0.19.6
2025-08-02 20:02:22 -07:00
hankehly
2177a2b805
Remove trailing space
2025-08-03 10:34:27 +09:00
hankehly
68164415ce
Format changelog entry
2025-08-03 10:26:37 +09:00
hankehly
7646599b66
Add changelog entry
2025-08-03 10:23:58 +09:00
Mark Backman
e467eaf130
Merge pull request #2334 from Designedforusers/fix/tavus-transport-daily-callbacks
...
fix: Add missing transcription callbacks to TavusTransport for 0.0.77 compatibility
2025-08-02 16:09:57 -07:00
Designedforusers
9d6d53629e
style: Apply ruff formatting to fix line length
...
Fixed a line length issue in tavus.py where the on_transcription_stopped callback was exceeding the maximum line length. Split the partial() call across multiple lines for better readability and compliance with project style guidelines.
2025-08-02 18:27:09 -04:00
Mark Backman
89596cfec4
Update pre-commit-config ruff version
2025-08-02 18:06:06 -04:00
Designedforusers
5e338ecaf1
refactor: Remove redundant transcription callback methods
...
As suggested in PR review, removed the _on_transcription_stopped and
_on_transcription_error method definitions. Now using the consistent
partial(self._on_handle_callback, ...) pattern for these callbacks,
matching how all other callbacks are handled.
This simplifies the code while maintaining the same functionality.
2025-08-02 15:02:54 -04:00
Designedforusers
62319021f8
docs: Add changelog entry for TavusVideoService fix
...
Added changelog entry as requested by maintainers for the fix addressing
missing transcription callbacks in TavusVideoService.
2025-08-02 14:53:44 -04:00
Pete
cccd82a617
Refactor TextInputMessage class to replace realtimeInput with a text attribute.
...
This was sending a 1007 because it was wrapping RealtimeInput in the json.
- Updated the `TextInputMessage` class to directly store text input as a string.
- Modified the `from_text` class method to create an instance using the new `text` attribute.
2025-08-02 14:34:00 -04:00
Mark Backman
f552ba1f5e
Merge pull request #2336 from pipecat-ai/mb/suppress-pydub-warning
...
Suppress pydub (cartesia dependency) SyntaxWarning
2025-08-02 10:01:05 -07:00
Mark Backman
b9a2a9b729
Add Tavus, HeyGen, Simli to release-evals
2025-08-02 09:35:06 -04:00
Mark Backman
e43b3869c3
Suppress pydub SyntaxWarning from the cartesia module
2025-08-02 08:49:59 -04:00
Mark Backman
55731df999
Improve quickstart logging, runner startup message
2025-08-02 08:40:05 -04:00
Designedforusers
3a7ea25077
fix: Add missing transcription callbacks to TavusTransport for 0.0.77 compatibility
...
TavusTransport was broken in Pipecat 0.0.77 due to PR #2292 adding required
callbacks (on_transcription_stopped, on_transcription_error) to DailyCallbacks.
This fix adds placeholder implementations of these callbacks to TavusTransportClient,
allowing TavusTransport to initialize properly. These callbacks are not used by
Tavus (which handles avatar video, not transcription) but are required by the
DailyCallbacks validation.
Fixes initialization error:
- 2 validation errors for DailyCallbacks
- on_transcription_stopped: Field required
- on_transcription_error: Field required
2025-08-02 05:56:46 -04:00
Yohan Liyanage
248206e234
Fixes 2277 - SSML reserved characters in LLM generated text causes Azure TTS to fail.
2025-08-02 12:49:29 +05:30
hankehly
694922f627
Fix PiperTTSService to send TTS input as JSON object
2025-08-02 15:29:16 +09:00
Mark Backman
cc9950e72d
Updating more foundational examples
2025-08-01 19:58:40 -04:00
richtermb
6814c390ba
Update CHANGELOG to reflect the addition of the source field in ErrorFrame for improved error tracking.
2025-08-01 14:47:57 -07:00
Richter Brzeski
c2d05ad23b
Merge branch 'pipecat-ai:main' into richtermb/push-more-error-frames
2025-08-01 14:47:08 -07:00
Mark Backman
ee56d8572d
Merge pull request #2329 from pipecat-ai/mb/fix-livekit-empty-audio-frames
...
fix: LiveKitTransport, don't push empty AudioRawFrames
2025-08-01 12:53:05 -07:00
richtermb
91568eeddc
Update type hint for source in ErrorFrame to use forward declaration for improved clarity.
2025-08-01 12:52:56 -07:00
richtermb
165d6b4c1d
Update CHANGELOG to include new source field in ErrorFrame for error tracking.
2025-08-01 12:25:29 -07:00
Mark Backman
1d8abe3c1c
fix: LiveKitTransport, don't push empty AudioRawFrames
2025-08-01 14:57:53 -04:00
Mark Backman
a6e69d6aad
Merge pull request #2325 from pipecat-ai/mb/dependency-groups
...
Move dev to [dependency-groups], update uv.lock
2025-08-01 11:54:21 -07:00
Mark Backman
519da9cc61
Align 04b livekit example with other foundational examples
2025-08-01 14:28:15 -04:00
richtermb
ead4e97ab5
Add source parameter to ErrorFrame and set it in FrameProcessor. Updated error handling in AnthropicLLMService and DeepgramSTTService to include ErrorFrame with source information.
2025-08-01 11:14:50 -07:00
Mark Backman
0c021378b0
Merge pull request #2326 from pipecat-ai/readme-quickstart-link
...
Update README.md
2025-08-01 10:45:30 -07:00
Mark Backman
e22c7e8ad5
Update README.md
2025-08-01 13:40:03 -04:00
Mark Backman
b71057bf7c
Move dev to [dependency-groups], update uv.lock
2025-08-01 09:43:56 -04:00
Mark Backman
0865f6cd7d
Merge pull request #2318 from pipecat-ai/mb/add-asyncio-readme
...
Add AsyncAI TTS to README vendor list
2025-08-01 06:11:13 -07:00
Mark Backman
610b1ab065
Merge pull request #2319 from pipecat-ai/mb/use-new-runner
...
Update foundational examples to use new runner
2025-08-01 06:11:03 -07:00
Mark Backman
3a2a226668
Merge pull request #2320 from pipecat-ai/mb/uv-lock-init
...
Add initial uv.lock file
2025-08-01 06:07:53 -07:00
Mark Backman
8e4b7352fd
Merge pull request #2321 from pipecat-ai/mb/dev-requirements
...
Add dev to optional-dependencies
2025-08-01 06:02:58 -07:00
Mark Backman
637d372fe4
Add dev to optional-dependencies
2025-07-31 23:39:23 -04:00
Mark Backman
ac15fe8ae4
Add workflow to update lockfile with pyproject.toml changes
2025-07-31 23:08:21 -04:00
Mark Backman
07239c0b8b
Add initial uv.lock file
2025-07-31 22:46:44 -04:00
Mark Backman
367b2fbe3c
Update requirements.txt
2025-07-31 22:12:57 -04:00
Mark Backman
f1b1d5b130
Update foundational examples to use the development runner
2025-07-31 22:11:32 -04:00
Mark Backman
ff45b77fdf
Remove examples runner
2025-07-31 21:22:04 -04:00
Mark Backman
e522b7ae96
Add AsyncAI TTS to README vendor list
2025-07-31 19:33:37 -04:00
Mark Backman
b8eef4f93b
Merge pull request #2314 from pipecat-ai/mb/sync-quickstart-example
...
Add workflow to sync quickstart to pipecat-quickstart repo
2025-07-31 15:34:26 -07:00
Mark Backman
dcc205996a
Merge pull request #2317 from pipecat-ai/mb/release-prep-0.0.77
...
Changelog update for 0.0.77
2025-07-31 15:34:02 -07:00
Mark Backman
9f61af4d1b
Changelog update for 0.0.77
2025-07-31 18:19:05 -04:00
Sam Sykes
e8faf28e6a
Doc fix for incorrect argument name.
2025-07-31 22:30:54 +01:00
Filipi da Silva Fuchter
40d53b3d84
Merge pull request #2316 from sam-s10s/speechmatics-stt
...
Updated to SpeechmaticsSTTService
2025-07-31 18:28:16 -03:00
Sam Sykes
7c223a86c2
Fix to missing deprecated attribute enable_speaker_diarization.
2025-07-31 22:25:46 +01:00
Sam Sykes
2d3f61aa07
Updated Speechmatics Plugin ( #2225 )
...
Changes
Split out module attributes to make engine settings clearer
Removed internal audio buffer to use latest Speechmatics python SDK (0.4.0)
Use diarization for improved VAD in multi-speaker situations
Support custom dictionary / vocabulary with attributes
Deprecated attributes superseded by re-organised attributes
Diarization Enhancements
Focus on specific speakers (using speaker labels)
Ignore specific speakers (using speaker labels)
Separate transcription formats for active and inactive speakers
Support for known speakers
2025-07-31 17:51:38 -03:00
Mark Backman
e05a47744d
Merge pull request #2311 from pipecat-ai/mb/quickstart-fixups
...
Set quickstart min pipecat-ai version to 0.0.77, remove non-quickstart examples
2025-07-31 13:42:10 -07:00
Aleix Conchillo Flaqué
6ffaab2b93
CHANGELOG cosmetics
2025-07-31 13:39:37 -07:00
Aleix Conchillo Flaqué
c2d8844903
Merge pull request #2312 from pipecat-ai/aleix/srhinos/main
...
Enable Interruption Support for LLMUserResponseAggregator
2025-07-31 13:30:57 -07:00
Mark Backman
e8caba7723
Add workflow to sync quickstart to pipecat-quickstart repo
2025-07-31 15:56:18 -04:00
Mark Backman
df96ef7d37
Remove non-quickstart demos
2025-07-31 15:38:54 -04:00
Aleix Conchillo Flaqué
7553f670af
fix formatting and update CHANGELOG
2025-07-31 10:41:11 -07:00
Mark Backman
6960f5861b
Set example min pipecat-ai version to 0.0.77 due to runner requirement
2025-07-31 12:21:58 -04:00
Mark Backman
b5edbbc0ca
Merge pull request #2309 from pipecat-ai/mb/remove-runner-examples
...
Remove examples/runner-examples
2025-07-31 09:18:22 -07:00
Aleix Conchillo Flaqué
e78d9c2c95
Merge pull request #2293 from azain47/azain47/fix-piper-tts-service
...
Fix Piper TTS Service
2025-07-31 08:32:17 -07:00
Vanessa Pyne
b25547a98b
Merge pull request #2305 from pipecat-ai/vp-changelog-text-input
...
update changelog
2025-07-31 10:16:47 -05:00
Mark Backman
e80281c3c4
Remove examples/runner-examples
2025-07-31 10:59:06 -04:00
Mark Backman
d692843e5b
Merge pull request #2308 from pipecat-ai/mb/change-neuphonic-url
...
NeuphonicTTSService: change the default url value to the global endpoint
2025-07-31 07:38:57 -07:00
Mark Backman
eaad3c5d55
NeuphonicTTSService: change the default url value to the global endpoint
2025-07-31 10:24:54 -04:00
vipyne
f2a1c66379
update changelog
2025-07-31 08:55:25 -05:00
Vanessa Pyne
af8de227bb
Merge pull request #2223 from getchannel/realtime-text
...
Add text input handling to unify context for realtimeInput stream of GeminiMultimodalLiveService
2025-07-31 08:53:39 -05:00
Mark Backman
7cd78dd286
Merge pull request #2303 from pipecat-ai/mb/add-new-quickstart-demos
...
Add quickstart demos
2025-07-31 05:56:00 -07:00
Mark Backman
226b516948
Add quickstart demos
2025-07-30 22:14:10 -04:00
Mark Backman
aa85fffa57
New runner module ( #2269 )
...
* Adds pipecat.runner.run - FastAPI-based development server with automatic bot discovery
* Adds new RunnerArguments types for different transports
* Adds new runner utils for creating transports and parsing data
* Adds new Daily and LiveKit utils for setup
2025-07-30 22:02:28 -04:00
srhinos
8b97ab70ff
Enable Interruption Support for LLMUserResponseAggregator
2025-07-30 20:48:31 -04:00
Filipi da Silva Fuchter
9013b2929a
Merge pull request #2300 from pipecat-ai/filipi/fast_api_race_condition
...
Fixed a race condition in FastAPIWebsocketClient
2025-07-30 18:10:09 -03:00
Filipi Fuchter
0c6e12a9b0
Fixed a race condition in FastAPIWebsocketClient that occurred when attempting to send a message while the client was disconnecting.
2025-07-30 18:07:40 -03:00
Aleix Conchillo Flaqué
efb24071d5
Merge pull request #2301 from pipecat-ai/aleix/daily-python-0.19.5
...
pyproject: update daily-python to 0.19.5
2025-07-30 14:01:27 -07:00
Filipi da Silva Fuchter
318ebec67e
Merge pull request #2298 from pipecat-ai/filipi/google_interruptions
...
Fixed an issue in GoogleLLMService where interruptions did not work when an interruption strategy was used.
2025-07-30 17:49:07 -03:00
Aleix Conchillo Flaqué
c679227aa8
pyproject: update daily-python to 0.19.5
2025-07-30 13:19:48 -07:00
Filipi Fuchter
392853f5fa
Fixed an issue in GoogleLLMService where interruptions did not work when an interruption strategy was used.
2025-07-30 12:10:32 -03:00
Mark Backman
98d27caab3
Merge pull request #2296 from pipecat-ai/mb/switch-rime-voices
...
Added the ability to switch voices to RimeTTSService
2025-07-30 07:55:52 -07:00
Mark Backman
0fa51968bf
Added the ability to switch voices to RimeTTSService
2025-07-30 10:53:14 -04:00
Mark Backman
92aee2634b
Merge pull request #2291 from pipecat-ai/mb/remove-on-client-closed
2025-07-30 06:36:32 -07:00
Filipi da Silva Fuchter
bff6a93f31
Merge pull request #2150 from pipecat-ai/filipi/hey_gen
...
HeyGen implementation for Pipecat - HeyGenVideoService
2025-07-30 09:10:07 -03:00
Filipi Fuchter
6e921cdf45
HeyGen implementation for Pipecat - HeyGenVideoService
2025-07-30 09:07:15 -03:00
Azain.
1e2b066cf3
Fix tts.py
...
Update Piper TTS Service to work with the newer Piper GPL Version, that uses JSON as its payload.
2025-07-30 13:41:27 +05:30
Pete
2af3b6329d
Ruff format debug
2025-07-29 17:48:11 -04:00
Pete
8ca06e5887
Add InputTextRawFrame class for handling raw text input in frames
...
- Introduced `InputTextRawFrame` to represent raw text input from users or programs.
- Updated `GeminiMultimodalLiveLLMService` to process `InputTextRawFrame` and send user text via the Gemini Live API's realtime input stream.
- Enhanced `_send_user_text` method documentation for clarity on its functionality and usage.
2025-07-29 17:43:14 -04:00
Mark Backman
c145a9ef13
Merge pull request #2288 from pipecat-ai/mb/stt-mute-examples
...
Update placement of STTMuteFilter in examples to reflect the new reco…
2025-07-29 12:10:36 -07:00
Mark Backman
b523f9a4c6
Merge pull request #2248 from ashotbagh/feat/async-tts
...
feat(tts): integrate Async TTS engine into pipecat
2025-07-29 12:10:11 -07:00
Mark Backman
7f184422d0
Merge branch 'main' into feat/async-tts
2025-07-29 12:06:56 -07:00
Aleix Conchillo Flaqué
fa4c3ec6bf
Merge pull request #2287 from pipecat-ai/aleix/asyncio-trace-logging
...
utils(asyncio): use trace logging for some cancelling messages
2025-07-29 11:56:25 -07:00
Aleix Conchillo Flaqué
9fafc10844
Merge pull request #2292 from richtermb/transcription-error-callback
...
Add on_transcription_error callback to DailyCallbacks and handle tran…
2025-07-29 11:56:02 -07:00
richtermb
67107d02ed
Refactor callback invocation for on_transcription_stopped in DailyTransportClient for improved readability
2025-07-29 11:53:41 -07:00
richtermb
c1df19982c
Add on_transcription_stopped callback to DailyTransport for handling transcription stop events
2025-07-29 11:50:16 -07:00
richtermb
444b1b5b02
Add on_transcription_stopped callback to DailyCallbacks and implement handling in DailyTransport for transcription stop events
2025-07-29 11:49:28 -07:00
Mark Backman
ebfa4f2d5e
Push the STTMuteFrame upstream and downstream
2025-07-29 14:37:36 -04:00
Mark Backman
e961c438e7
Update placement of STTMuteFilter in examples to reflect the new recommendation
2025-07-29 14:36:39 -04:00
richtermb
d3d36a89e2
Add _on_transcription_error method to DailyTransport for handling transcription error events
2025-07-29 10:48:50 -07:00
richtermb
fa6e5ce4a7
Add on_transcription_error callback to DailyCallbacks and handle transcription errors in DailyTransportClient
2025-07-29 10:43:18 -07:00
Mark Backman
3ffb261864
Remove use of on_client_closed event in foundational examples
2025-07-29 13:28:33 -04:00
Mark Backman
f69a02b7a7
Merge pull request #2290 from pipecat-ai/mb/remove-examples
...
Removed most pipecat examples, relocating to pipecat-examples repo
2025-07-29 10:02:24 -07:00
Mark Backman
f1f4aed398
Remove random Dockerfile, update README links
2025-07-29 11:41:27 -04:00
Mark Backman
414c245c92
Remove android.yaml github workflow
2025-07-29 11:34:48 -04:00
Mark Backman
3f57d94c0b
Update examples README
2025-07-29 11:28:40 -04:00
Mark Backman
15e3c69ddc
Removed most pipecat examples, relocating to pipecat-examples repo
2025-07-29 11:17:01 -04:00
Ashot
39b00f5269
chore: address review comments
2025-07-29 18:20:50 +04:00
Mark Backman
4c368c78c6
Merge pull request #2289 from tomoima525/tomoima525/transcription-bucket-params
...
Add transcription_bucket param for rest helper
2025-07-29 05:05:08 -07:00
Tomoaki Imai
6eb00a99cb
update Changelog for transcription_bucket params addition
2025-07-29 20:38:12 +09:00
Tomoaki Imai
3ae8cf1916
Add transcription_bucket param for rest helper
2025-07-29 18:58:38 +09:00
Aleix Conchillo Flaqué
03e87469df
utils(asyncio): use trace logging for some cancelling messages
2025-07-28 17:43:41 -07:00
Mark Backman
70255d3c81
Merge pull request #2274 from pipecat-ai/mb/remove-message-name
...
Remove message["name"] addition when pushing
2025-07-28 17:29:23 -07:00
Mark Backman
96a72d0647
Remove message[name] addition when pushing
2025-07-28 20:13:50 -04:00
Mark Backman
27d4910694
Merge pull request #2286 from pipecat-ai/mb/fix-transcript-processor-newline
...
fix: Improve TranscriptProcessor detection for transcript type
2025-07-28 17:07:43 -07:00
Mark Backman
50242f4ad8
fix: Improve TranscriptProcessor detection for transcript type
2025-07-28 19:56:36 -04:00
Mark Backman
c9dda5251c
Merge pull request #2284 from pipecat-ai/mb/yank-74-75
...
Add yanked notices to 0.0.74 and 0.0.75 changelogs
2025-07-28 12:55:47 -07:00
Mark Backman
419cc9ac68
Add yanked notices to 0.0.74 and 0.0.75 changelogs
2025-07-28 13:36:02 -04:00
Ashot
83b4747196
chore: address review comments
2025-07-28 17:52:17 +04:00
Ashot
a13b954415
formatting/cleanup: address Copilot PR review comments
2025-07-28 17:43:17 +04:00
Ashot
f2e9562f1b
feat(tts): integrate Async TTS engine into pipecat
2025-07-28 17:42:57 +04:00
Mark Backman
afed9a61f2
Merge pull request #2268 from pipecat-ai/mb/inworld-changelog
...
Add changelog entry for InworldTTSService
2025-07-28 05:59:57 -07:00
Mark Backman
f0de27b35e
Merge pull request #2273 from pipecat-ai/mb/gitignore-plivo-stream
...
.gitignore: add plivo-chatbot streams.xml, .python-version
2025-07-28 05:59:41 -07:00
Filipi da Silva Fuchter
9d5510ee47
Merge pull request #2265 from pipecat-ai/filipi/small_webrtc_buffer_processor
...
Fixed an issue in AudioBufferProcessor when using SmallWebRTCTransport
2025-07-28 09:23:58 -03:00
Mark Backman
434c3fc527
Merge pull request #2279 from Allenmylath/patch-26
...
Update README.md
2025-07-28 04:51:58 -07:00
allenmylath
aba79a9478
Update README.md
...
Explanatory comment.Eventhought code allows for transport params.It is not clearly given in readme, what all are the options are there.
2025-07-28 11:24:27 +05:30
Mark Backman
fc96e091a9
Update NVIDIA in README
2025-07-26 15:01:52 -04:00
Mark Backman
851a27c082
Add Groq TTS to README
2025-07-26 14:58:07 -04:00
Mark Backman
a72d93dc6d
Add Inworld to README
2025-07-26 14:55:19 -04:00
Mark Backman
c971232f20
.gitignore: add plivo-chatbot streams.xml, .python-version
2025-07-26 10:19:50 -04:00
Mark Backman
4b2ba2d69f
Merge pull request #2270 from Allenmylath/patch-25
...
Update README.md
2025-07-26 04:55:59 -07:00
allenmylath
240a698fab
Update README.md
...
recreating examples without activating bedrock models will create errors . Warning and link added
2025-07-26 14:51:19 +05:30
Mark Backman
9aaae01063
Add changelog entry for InworldTTSService
2025-07-25 21:46:02 -04:00
Mark Backman
41c8d22cf3
Merge pull request #2208 from padillamt/mtp/add-inworld-tts
...
Inworld HTTP TTS Service
2025-07-25 17:13:37 -07:00
padillamt
b68f044ef7
mtpadilla: updated example to reflect parameter placement changes in base Inworld TTS class
2025-07-25 15:13:43 -07:00
padillamt
e140bd6960
mtpadilla: moved model and voice id setting into the class constructor
2025-07-25 14:04:49 -07:00
Filipi Fuchter
e86b55e2b3
Fixed an issue in AudioBufferProcessor when using SmallWebRTCTransport where, if the microphone was muted, track timing was not respected.
2025-07-25 17:01:41 -03:00
padillamt
4a9bec5b35
mtpadilla: stop metrics at result chunk
2025-07-25 11:14:20 -07:00
padillamt
37361391d9
mtpadilla: removed ability to set base_url via constructor, set internally based on streaming variable
2025-07-25 09:16:56 -07:00
Filipi da Silva Fuchter
4b3726eba4
Merge pull request #2260 from pipecat-ai/filipi/audio_resampler
...
Fixed an issue in `AudioBufferProcessor` that caused garbled audio
2025-07-25 09:27:42 -03:00
padillamt
8e66794759
mtpadilla: switch to Deepgram ASR for lower latency
2025-07-24 22:22:36 -07:00
padillamt
acc5b9f210
inworld: change to function that stops all processing metrics
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 22:07:15 -07:00
padillamt
f982ace4c5
inworld: removal of unnecessary setting of ssampling rate since matches default
2025-07-24 21:56:01 -07:00
padillamt
5fb1899aeb
inworld: removal of unnecessary default assignment as already handled
2025-07-24 21:42:42 -07:00
padillamt
7483422bd9
inworld: change set_voice uto use self._settings
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 21:23:03 -07:00
padillamt
16c20f3a99
inworld: removal of unnecessary default assignment since already done
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 21:15:34 -07:00
padillamt
d248c102c8
inworld: removal of unnecessary default assignment since already done
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 21:15:20 -07:00
padillamt
662550cc5e
mtpadilla: remove unused imports
2025-07-24 21:05:22 -07:00
padillamt
067f64389b
mtpadilla: no longer needed so making empty
2025-07-24 20:44:27 -07:00
padillamt
81048ce43a
mtpadilla: rename 07aa-interruptible-inworld-http.py to 07ab-interruptible-inworld-http.py
2025-07-24 20:42:29 -07:00
padillamt
f6440ee6e1
mtpadilla: correct Examples header in comments
2025-07-24 13:36:40 -07:00
padillamt
da8c67114a
mtpadilla: make streaming the default for example
2025-07-24 13:35:29 -07:00
Mark Backman
d8ea1311ff
Merge pull request #2254 from pipecat-ai/mb/11labs-create-context-id
...
ElevenLabsTTSService: Only reset the context_id when interruptions ar…
2025-07-24 13:32:37 -07:00
Mark Backman
2be615066c
Merge pull request #2261 from pipecat-ai/mb/foundational-requirements
...
Foundational requirements.txt: add silero, websocket optional dep, re…
2025-07-24 11:06:16 -07:00
Mark Backman
75c2ffc0b5
Check if audio context is already available, create one if not
2025-07-24 13:57:46 -04:00
Mark Backman
2297eb217e
ElevenLabsTTSService: Only reset the context_id when interruptions are enabled
2025-07-24 13:53:44 -04:00
Mark Backman
1bb821a07d
Foundational requirements.txt: add silero, websocket optional dep, remove fastapi
2025-07-24 13:49:44 -04:00
Filipi Fuchter
970b8044a0
Fixed an issue in AudioBufferProcessor that caused garbled audio when enable_turn_audio was enabled and audio resampling was required.
2025-07-24 13:25:48 -03:00
Filipi da Silva Fuchter
d8bcb81f35
Merge pull request #2259 from pipecat-ai/filipi/eleven_labs_delayed_messages
...
Play delayed messages from `ElevenLabsTTSService` if they still belong to the current context.
2025-07-24 12:07:06 -03:00
Filipi da Silva Fuchter
3ce0ab8c6d
Removing extra space.
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-07-24 12:05:17 -03:00
Filipi Fuchter
097d786431
Fixing ruff format.
2025-07-24 12:03:17 -03:00
Filipi Fuchter
662f04879c
Play delayed messages from ElevenLabsTTSService if they still belong to the current context.
2025-07-24 12:00:14 -03:00
Mark Backman
7a69f57e11
Merge pull request #2255 from pipecat-ai/mb/pyproject-versions-for-uv
...
pyproject.toml dependency updates to support better cross compatibility
2025-07-24 06:43:35 -07:00
Mark Backman
5b7b4efdc9
Add broader version support for stable core dependencies, up to the next major version
2025-07-24 09:40:52 -04:00
Mark Backman
cfa26524ca
Add support for fastapi>=0.115.6,<0.117.0
2025-07-24 09:37:42 -04:00
Mark Backman
3d4ab7158d
pyproject.toml dependency updates to support better cross compatibility
2025-07-24 09:37:42 -04:00
Mark Backman
26d1ca3c98
Merge pull request #2256 from pipecat-ai/mb/refactor-neuphonic-http
...
NeuphonicHttpTTSService: Refactor to use POST API
2025-07-24 06:36:23 -07:00
Mark Backman
083b32887e
NeuphonicHttpTTSService: Refactor to use POST API
2025-07-24 01:05:37 -04:00
padillamt
b6367965cb
mtpadilla: consolidate streaming and non-streaming options into a single class with common API, with boolean switch variable added (streaming)
2025-07-23 16:50:32 -07:00
padillamt
147bf9cfe8
mtpadilla: addition of non-streaming option with own dedicated class, and related additional non-streaming test option
2025-07-23 15:28:43 -07:00
Mark Backman
3391929127
Merge pull request #2252 from pipecat-ai/mb/example-axios-version-bump
...
Update axios in daily-pstn-server example due to transitive vulnerabi…
2025-07-23 13:30:58 -07:00
padillamt
a5d353030e
mtpadilla: small formatting fix to comments
2025-07-23 12:02:58 -07:00
padillamt
f29024bcc0
mtpadilla: update coments regarding temperature parameter
2025-07-23 11:47:26 -07:00
Mark Backman
ebf9bc2741
Merge pull request #2246 from ydlamba/ydlamba/missing-livekit-event
...
fix(livekit): emit on_audio_track_subscribed event
2025-07-23 11:27:10 -07:00
Mark Backman
f5edde42f6
Update axios in daily-pstn-server example due to transitive vulnerability with form-data
2025-07-23 14:22:13 -04:00
Filipi da Silva Fuchter
37bb7ef926
Merge pull request #2239 from pipecat-ai/filipi/daily_log
...
Added `set_log_level` to `DailyTransport`
2025-07-23 14:48:34 -03:00
Filipi Fuchter
a63d1530a4
Added set_log_level to DailyTransport.
2025-07-23 14:43:53 -03:00
Yash Dev Lamba
960bc9df5b
chore(changelog): add entry for LiveKitTransport audio subscribed event fix
2025-07-23 22:41:20 +05:30
Mark Backman
e2a153ee01
Merge pull request #2242 from pipecat-ai/mb/websockets-14
...
Upgrade websockets to support asyncio implementation
2025-07-23 08:58:08 -07:00
Mark Backman
300f19ad23
Port to the websockets asyncio implementation, support for websockets 13 and 14
2025-07-23 11:54:25 -04:00
Mark Backman
7955080da2
Change extra_headers to additional_headers, update websocket version support
2025-07-23 11:53:43 -04:00
Mark Backman
994e82c1ef
Merge pull request #2243 from pipecat-ai/mb/word-wrangler-twilio-readme
...
Update Word Wrangler phone bot README to include deployment info
2025-07-23 07:04:19 -07:00
Mark Backman
b07b947352
Merge pull request #2244 from pipecat-ai/mb/upgrade-deepgram-4.7.0
...
Deepgram: Update optional dependency to 4.7.0
2025-07-23 07:04:02 -07:00
Filipi da Silva Fuchter
a6527c3856
Merge pull request #2240 from pipecat-ai/filipi/sig_term
...
Adding support for handle_sigterm
2025-07-23 08:15:50 -03:00
antonyesk601
1cbf7ae480
fix: remove unused variable; fix: remove redundant logic
2025-07-23 08:26:44 +00:00
Yash Dev Lamba
0e6874b605
fix(livekit): emit on_audio_track_subscribed event
2025-07-23 08:23:45 +05:30
Mark Backman
9ba172c49f
Merge pull request #2236 from dbtreasure/fix/python-311-compatibility
...
Fix Python 3.11+ compatibility by pinning numba/llvmlite versions
2025-07-22 18:20:38 -07:00
dbtreasure
f710c94b6e
Address code review feedback: remove explicit llvmlite pin
...
- Remove explicit llvmlite>=0.44.0 pin as numba>=0.61.0 automatically pulls compatible version
- Add changelog entry for Python 3.11+ dependency fix
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-07-22 18:45:32 -06:00
dbtreasure
6e3a0a2d5d
Add explicit numba/llvmlite pins for Python 3.11+ compatibility
...
Fixes dependency resolution issues where transitive dependencies
through resampy would install incompatible versions:
- numba>=0.61.0 (supports Python 3.10-3.13)
- llvmlite>=0.44.0 (supports Python 3.10-3.13)
Previously, older versions (numba 0.53.1, llvmlite 0.36.0) only
supported Python 3.6-3.9, causing deployment failures on Python 3.11+.
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-07-22 18:45:02 -06:00
Mark Backman
9530b8b842
Merge pull request #2235 from pipecat-ai/mb/nltk-tokenizer
...
Update match_endofsentence to use NLTK sentence tokenizer
2025-07-22 17:22:23 -07:00
Mark Backman
26c937af87
Update match_endofsentence to use NLTK sentence tokenizer
2025-07-22 20:19:29 -04:00
Mark Backman
976f6168f0
Deepgram: Update optional dependency to 4.7.0
2025-07-22 20:15:30 -04:00
Mark Backman
0be64e0fd9
Update Word Wrangler phone bot README to include deployment info
2025-07-22 20:10:20 -04:00
Filipi Fuchter
7d527c3a6b
Mentioning the new field in the changelog.
2025-07-22 19:32:52 -03:00
Filipi Fuchter
c6f6930c27
Adding support for handle_sigterm
2025-07-22 17:24:07 -03:00
Mark Backman
c33dfe8309
Merge pull request #2233 from pipecat-ai/mb/enable-tracing-flag
...
fix: enable_tracing PipelineParam controls the service class decorators
2025-07-22 08:14:32 -07:00
Mark Backman
769cd1ef06
fix: enable_tracing PipelineParam controls the service class decorators
2025-07-22 11:10:53 -04:00
Mark Backman
6d72f60571
Merge pull request #2234 from pipecat-ai/mb/fix-minimax-pitch
...
fix: MiniMaxHttpTTSService pitch, add base_url arg
2025-07-22 08:10:01 -07:00
Mark Backman
e8d0712ac1
Merge pull request #2238 from pipecat-ai/mb/patch-form-data
...
Fix form-data vulnerability in pipecat-cloud-daily-pstn-server
2025-07-22 08:09:49 -07:00
Mark Backman
88b2c817ac
Fix form-data vulnerability in pipecat-cloud-daily-pstn-server
2025-07-22 10:08:25 -04:00
Mark Backman
f8f6c9918d
Merge pull request #2237 from pipecat-ai/mb/pipecat-cloud-example-pipeline-runner-args
...
Update Pipecat Cloud example to use handle_sigint=False in PipelineRu…
2025-07-22 06:55:56 -07:00
Mark Backman
8ee608bbfe
Update Pipecat Cloud example to use handle_sigint=False in PipelineRunner args
2025-07-22 09:52:57 -04:00
Mark Backman
fad2ba4570
Merge pull request #2204 from yousifa/mcp-FunctionCallParams
2025-07-22 05:01:32 -07:00
Mark Backman
f609f7eb53
fix: MiniMaxHttpTTSService pitch, add base_url arg
2025-07-21 21:16:35 -04:00
Mark Backman
ea09813a2b
Merge pull request #2227 from pipecat-ai/mb/fix-11labs-wordtimestamps
...
fix: Improve ElevenLabsTTSService word/timestamp calcuation accuracy
2025-07-21 16:07:07 -07:00
Mark Backman
53abfc27a7
fix: Improve ElevenLabsTTSService word/timestamp calcuation accuracy
2025-07-21 18:48:38 -04:00
padillamt
1915407ff7
inworld: removed unreferenced is_first_chunk variable
2025-07-21 15:30:48 -07:00
Mark Backman
9c72e96a2c
Merge pull request #2230 from pipecat-ai/mb/livekit-tenacity
...
Livekit: change tenacity supported versions
2025-07-21 15:28:38 -07:00
Mark Backman
f66c67c4ab
Merge pull request #2232 from pipecat-ai/mb/fix-ollama-args
...
Fix: Ollama kwargs error
2025-07-21 15:26:13 -07:00
Mark Backman
b623face03
Add Ollama function calling example 14u
2025-07-21 17:52:16 -04:00
Mark Backman
698d60f3ae
fix: OLLamaLLMService pass base_url as kwarg
2025-07-21 17:51:11 -04:00
Mark Backman
c9717a23a5
Livekit: change tenacity supported versions
2025-07-21 17:30:18 -04:00
padillamt
076a675a75
inworld: Fix...Set sample_rate=None in InworldHttpTTSService to match Cartesia pattern
2025-07-21 13:50:36 -07:00
padillamt
0d5292c4ef
inworld: typo fix in voice name
2025-07-21 13:48:13 -07:00
padillamt
4853d5d55c
inworld: updated InworldHttpTTSService initialization
2025-07-21 13:27:25 -07:00
padillamt
8eda2435a2
inworld: removed explicit references to language since our models currently infer that from the text.
2025-07-21 13:24:10 -07:00
Mark Backman
d981ce6e56
Merge pull request #2226 from pipecat-ai/mb/11labs-speed-docstring
...
Fix 11Labs speed docstring
2025-07-21 13:21:45 -07:00
padillamt
54ff946976
inworld: largely adjustments for docstring compatibility
2025-07-21 12:07:58 -07:00
Mark Backman
1bbd3bd8ab
Fix 11Labs speed docstring
2025-07-21 14:58:12 -04:00
padillamt
aadd088b50
inworld: commented out contents as per Pipecat guidance that this pattern is being retired
2025-07-21 10:52:55 -07:00
padillamt
4250aa6616
inworld: removal of backup copy, no longer needed
2025-07-21 10:11:50 -07:00
Kwindla Hultman Kramer
a20915caa7
Merge pull request #2224 from pipecat-ai/khk/mps
...
Add MPS backend auto-detection to local smart-turn v2
2025-07-21 09:24:51 -07:00
Vanessa Pyne
28cab5a606
Merge pull request #1932 from getchannel/groundingMetadata
...
Add groundingMetadata to Gemini Multimodal Live Service
2025-07-21 10:09:26 -05:00
Vanessa Pyne
cfea56064d
small merge-main nit fixes - gemini_multimodal_live events.py
2025-07-21 09:54:15 -05:00
Vanessa Pyne
8467d87cfc
small main-merge fixes - gemini.py
2025-07-21 09:52:32 -05:00
Kwindla Hultman Kramer
b20d020bea
Add MPS backend auto-detection to local smart-turn v2
2025-07-20 20:18:45 -04:00
padillamt
e3711f96a3
inworld: added detailed comments
2025-07-20 17:06:35 -07:00
Pete
948257c66e
Merge branch 'main' into groundingMetadata
2025-07-20 19:54:30 -04:00
Pete
b54d1fb7fd
Resolve merge conflict and remove duplicate File API initialization
...
- Remove duplicate file_api initialization lines
- Keep grounding metadata tracking functionality
- Maintain clean code structure
2025-07-20 19:15:40 -04:00
Pete
ec361df0d1
Fix final ruff linting issues
...
- Remove duplicate import in __init__.py
- Clean up extra blank lines in gemini.py
- Remove extra blank line in _create_single_response method
2025-07-20 18:58:54 -04:00
Pete
b1a5cddde4
Refactor whitespace and formatting in multiple files
...
- Clean up unnecessary whitespace in `gemini.py`, `events.py`, and `file_api.py`
- Ensure consistent formatting in `26g-gemini-multimodal-live-groundingMetadata.py`
- Improve readability by aligning code and removing trailing spaces
2025-07-20 18:40:12 -04:00
Pete
e165d38277
remove truncated logging from debug
2025-07-20 18:27:21 -04:00
Pete
8ba340a8a5
remove debug logging
2025-07-20 18:21:42 -04:00
Pete
8f74b97591
Refactor _send_user_text method in Gemini multimodal service to streamline event creation for turn completion
2025-07-20 18:08:45 -04:00
Pete
1d69cd1a5e
Remove debug logging from _send_user_text method in Gemini multimodal service
2025-07-20 18:04:57 -04:00
Pete
bd7a0f27cc
Add text input handling to Gemini multimodal service
...
- Updated `RealtimeInput` to include an optional `text` parameter.
- Introduced `TextInputMessage` class for encapsulating text input data.
- Implemented `_send_user_text` method to send text input to the Gemini Live API.
- Enhanced message processing to support text input alongside media chunks.
2025-07-20 17:39:31 -04:00
padillamt
5d8c184d99
inworld: commit of original text file and changes that copy openai's with Inworld TTS as only change
2025-07-18 16:30:03 -07:00
padillamt
1bc442e329
inworld: docstring fix
2025-07-18 15:13:19 -07:00
kompfner
d4e33663b2
Merge pull request #2214 from pipecat-ai/pk/fix-google-llm-context
...
Fixed an issue in `GoogleLLMContext` where it would inject the `syste…
2025-07-18 09:28:28 -04:00
marcus-daily
d7d1b16dad
Removing old import
2025-07-18 12:48:06 +01:00
marcus-daily
0bc2ea13f2
Updating changelog
2025-07-18 12:48:06 +01:00
marcus-daily
b5d1301221
Fix linter warnings
2025-07-18 12:48:06 +01:00
marcus-daily
ed8f30ec71
Add support for running smart-turn-v2 locally
2025-07-18 12:48:06 +01:00
antonyesk601
688031efd6
fix: use undeclared variable _preinitialized. fix: double send of start frame
2025-07-18 08:23:04 +00:00
kompfner
a74a935ca0
Merge pull request #1910 from matejmarinko-soniox/main
...
Add Soniox STT service integration
2025-07-17 09:29:07 -04:00
antonyesk601
0f9e69d3c7
feat: Add Simli Trinity models support to pipecat
2025-07-17 11:55:40 +00:00
padillamt
f3984aec33
inworld: added (empty) requirements for Inworld to be explicit reg dependencies
2025-07-16 13:21:32 -07:00
Paul Kompfner
7cfd56699b
Fixed an issue in GoogleLLMContext where it would inject the system_message as a "user" message into cases where it was not meant to; it was only meant to do that when there were no "regular" (non-function-call) messages in the context, to ensure that inference would run properly.
2025-07-16 16:07:53 -04:00
Matej Marinko
cb984237a7
Fix lint error
2025-07-16 16:54:28 +02:00
Matej Marinko
c969fdddb9
Rename and simplify VAD finalization parameter usage
2025-07-16 09:47:34 +02:00
padillamt
2b76823b01
inworld: added comments to track a few things to confirm
2025-07-15 18:17:30 -07:00
padillamt
ca936bd569
inworld: added Inworld to list of needed credentials
2025-07-15 18:11:50 -07:00
padillamt
c67b779b91
inworld: first commit of Inworld example file for TTS
2025-07-15 17:21:16 -07:00
padillamt
913dba3b74
inworld: class name change
2025-07-15 17:15:57 -07:00
padillamt
384838147a
inworld: removed unnecessary code from stop() and cancel()
2025-07-15 16:56:18 -07:00
padillamt
7861b911c0
inworld: first commit of __init__ and tts.py files
2025-07-15 16:50:50 -07:00
Mark Backman
9931ad2ce1
Merge pull request #2199 from Dev-Khant/add-host-support-in-Mem0
...
Add `host` support in Mem0 Memory
2025-07-15 11:41:15 -07:00
Filipi da Silva Fuchter
fd73feb645
Merge pull request #2201 from pipecat-ai/filipi/stt_issue
...
Only create the EmulateUserStartedSpeakingFrame if we have received a transcription
2025-07-15 13:56:11 -03:00
Yousif Astarabadi
ee78428a2a
formatted
2025-07-14 20:38:28 -07:00
Yousif Astarabadi
ae02249255
mcp_tool_wrapper using FunctionCallParams
2025-07-14 20:31:22 -07:00
Filipi Fuchter
727af2e6fb
Only create the EmulateUserStartedSpeakingFrame if we have received a transcription.
2025-07-14 17:38:03 -03:00
Mark Backman
8fd5576879
Merge pull request #2198 from Allenmylath/patch-24
...
Update app.py
2025-07-14 06:37:42 -07:00
kompfner
1f85dcee7c
Merge pull request #2171 from pipecat-ai/pk/aws-strands-demo
...
Minimal AWS Strands demo
2025-07-14 09:32:16 -04:00
Dev Khant
138890bc5c
Add support in Mem0 Memory
2025-07-14 18:08:25 +05:30
Filipi da Silva Fuchter
a094efc9e6
Merge pull request #2196 from pipecat-ai/mb/lmnt-model
...
LmntTTSService: update the default model to blizzard
2025-07-14 09:15:17 -03:00
allenmylath
1f9e2fdecc
Update app.py
...
misleading comment. no endpoints.py
2025-07-14 14:02:35 +05:30
Mark Backman
4a2b4660bc
LmntTTSService: update the default model to blizzard
2025-07-13 10:54:43 -07:00
Mark Backman
b3ac90015a
Merge pull request #2195 from Trinary-Projects/transformers_ver_patch
...
Update transformers dep. to >=4.48.0 for Ultravox
2025-07-11 23:31:47 -07:00
Jaideep
2fe06f0a4e
Update pyproject.toml
2025-07-12 11:34:45 +05:30
Mark Backman
1836a7484e
Merge pull request #2193 from pipecat-ai/mb/changelog-0.0.76
...
Prepare changelog for 0.0.76 release
2025-07-11 16:15:34 -07:00
Mark Backman
25a5c5aaab
Prepare changelog for 0.0.76 release
2025-07-11 16:08:08 -07:00
mattie ruth backman
24694e2558
Changelog entry
2025-07-11 14:30:12 -07:00
mattie ruth backman
2325edd9ba
Add a text entry box to the simple-chatbot example
2025-07-11 14:30:12 -07:00
mattie ruth backman
fad5713ade
Fix append-to-context function call
2025-07-11 14:30:12 -07:00
Paul Kompfner
fe8573322f
AWS Strands demos
2025-07-11 16:42:27 -04:00
Mark Backman
06c1255abe
fix: use a different aggregation timeout for emulated user speech ( #2185 )
...
* fix: use a different aggregation timeout for emulated user speech
* Add SpeechControlParamsFrame
* Update test_context_aggregator tests
2025-07-11 16:33:44 -04:00
Mark Backman
f108a67635
Merge pull request #2189 from pipecat-ai/mb/numpy-version-bump
...
Update numpy, transformers to support newer versions
2025-07-11 12:02:02 -07:00
Mark Backman
bf580d061d
Update numpy, transformers to support newer versions
2025-07-11 11:58:31 -07:00
Filipi da Silva Fuchter
b005bd7b98
Merge pull request #2184 from pipecat-ai/filipi/twilio_issue
...
Fixing an issue where Pipecat was not receiving the user's audio
2025-07-11 15:32:28 -03:00
Filipi Fuchter
75f8baab33
Mentioning the fixes in the changelog.
2025-07-11 11:56:16 -03:00
Matej Marinko
5c3fb73cef
Rename example
2025-07-11 16:07:24 +02:00
Filipi Fuchter
5c3f4180b9
Refactored VAD analyzer to process multiple audio frames in a single iteration if needed.
2025-07-11 10:59:32 -03:00
Mark Backman
6cd6e7ceed
Merge pull request #2186 from pipecat-ai/mb/fix-pre-commit-config
...
Update .pre-commit-config.yaml to use pyproject.toml linting rules
2025-07-11 06:34:01 -07:00
Filipi Fuchter
1a146c2a64
Not serializing a JSON in case we have no audio.
2025-07-11 10:15:09 -03:00
Filipi Fuchter
eaeb9e6efa
Not creating InputAudioRawFrame in case we don't have bytes. Fixed for Pilvo, Exotel and Telnyx.
2025-07-11 09:51:38 -03:00
Matej Marinko
2e84c91748
Remove outdated parameter
2025-07-11 08:52:39 +02:00
Matej Marinko
650d45c1f4
Use single sample rate parameter
2025-07-11 08:27:06 +02:00
Filipi Fuchter
f4f65024ef
Refactoring the test client to use the new version of the Pipecat Client SDK.
2025-07-10 21:57:25 -03:00
Filipi Fuchter
1200aa4fb8
Not creating InputAudioRawFrame in case we don't have bytes.
2025-07-10 21:56:34 -03:00
Filipi da Silva Fuchter
6762363685
Merge pull request #2183 from pipecat-ai/filipi/parallel_pipeline_issue
...
Fixed an issue in ParallelPipeline that caused errors when attempting to drain the queues.
2025-07-10 21:51:04 -03:00
Filipi Fuchter
b2ead325c4
Fixed an issue in ParallelPipeline that caused errors when attempting to drain the queues.
2025-07-10 21:50:35 -03:00
Mark Backman
4e24b915cc
Update .pre-commit-config.yaml to use pyproject.toml linting rules
2025-07-10 16:10:27 -07:00
kompfner
b610ee26ba
Merge pull request #2181 from pipecat-ai/pk/fix-aws-nova-sonic-pipeline-freeze
...
Fix a pipeline freeze when using AWS Nova Sonic. The freeze occurs if…
2025-07-10 16:30:55 -04:00
Paul Kompfner
2b867f1613
Fix a pipeline freeze when using AWS Nova Sonic. The freeze occurs if the user starts speaking before we've finished sending the "trigger " audio (AWS Nova Sonic can only start speaking in response to a user utterance, so we have a simulated user utterance to "trigger" the bot speaking without the user having actually spoken first).
2025-07-10 15:57:05 -04:00
Mark Backman
7b8fe565c7
Merge pull request #2182 from pipecat-ai/mb/run-example-usage
...
run.py: Add example usage to the module docstring
2025-07-10 12:48:29 -07:00
Mark Backman
a246862910
run.py: Add example usage to the module docstring
2025-07-10 11:41:49 -07:00
Filipi da Silva Fuchter
106809f3fd
Merge pull request #2166 from carolin-tavus/remove-persona-microphone-check
...
feat: Remove persona microphone check
2025-07-10 15:28:35 -03:00
carolin-tavus
f0d8499f7e
feat: avoid checking microphone enabled
2025-07-10 09:40:27 +00:00
Mark Backman
332ca3d55e
Merge pull request #2177 from pipecat-ai/mb/fix-ruff-improvements
...
Make fix-ruff.sh more flexible, use pyproject rules
2025-07-09 12:33:05 -07:00
Mark Backman
a48f5d5796
Make fix-ruff.sh more flexible, use pyproject rules
2025-07-09 11:48:17 -07:00
Mark Backman
f04f047428
Merge pull request #2176 from pipecat-ai/mb/pre-commit-config
...
Add docstring checking to .pre-commit-config.yaml
2025-07-09 11:47:25 -07:00
Mark Backman
4e61fd33ea
Add docstring checking to .pre-commit-config.yaml
2025-07-09 11:18:40 -07:00
Matej Marinko
61ac77be72
Update docs
2025-07-09 11:59:45 +02:00
Matej Marinko
c093eb5b63
Move config to main file
2025-07-09 10:20:37 +02:00
Matej Marinko
98e24131bd
Send raw result
2025-07-09 09:59:04 +02:00
Matej Marinko
7becce9e8c
Add transcript tracing
2025-07-09 09:37:58 +02:00
Matej Marinko
3cdaeb719a
Update examples to new format
2025-07-09 09:28:43 +02:00
Matej Marinko
8daaea5969
Minor code cleanup
2025-07-09 09:03:02 +02:00
matejmarinko-soniox
dc47516e14
Update src/pipecat/services/soniox/config.py
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-09 08:04:59 +02:00
Mark Backman
0fcc4f822f
Merge pull request #2173 from captaincaius/fix-nextjs-webhook-example-null-check
...
fix nextjs webhook example num_endpoints null check
2025-07-08 14:10:16 -07:00
Captain Caius
c0ed061ff5
fix nextjs webhook example num_endpoints null check
2025-07-08 13:40:26 -07:00
Mark Backman
d98b6b418d
Release prep for 0.0.75 ( #2169 )
...
* Update CHANGELOG for 0.0.75 release
* Add RTVI changes to CHANGELOG
* Update CHANGELOG, add deprecation directives to rtvi.py
---------
Co-authored-by: mattie ruth backman <mattieruth@gmail.com >
2025-07-08 15:39:44 -04:00
Mark Backman
deea29b5e8
Merge pull request #2170 from pipecat-ai/mb/update-packages-0.0.75
...
Package updates to run the release evals
2025-07-08 12:02:22 -07:00
Mark Backman
0bdbc83ed9
Package updates to run the release evals
2025-07-08 11:39:49 -07:00
Mark Backman
6c591f0990
Merge pull request #2167 from pipecat-ai/mb/fix-riva-watchdog
...
RivaSTTService: reset the watchdog in an async function
2025-07-08 11:29:44 -07:00
Mark Backman
b55b9c257b
RivaSTTService: remove reset_watchdog, which is handled in the WatchdogQueue already
2025-07-08 11:19:47 -07:00
Mark Backman
5156c21d14
Merge pull request #2168 from pipecat-ai/mb/fix-neuophonic-tts
...
Fix: NeuphonicTTSService to use latest websocket API
2025-07-08 11:17:58 -07:00
Mark Backman
a9d824753b
Fix: NeuphonicTTSService to use latest websocket API
2025-07-08 11:08:08 -07:00
Filipi da Silva Fuchter
3c6a208101
Merge pull request #2148 from pipecat-ai/filipi/aws_bedrock
...
Refactoring AWSBedrockLLMService to work async
2025-07-08 12:14:28 -03:00
Mark Backman
b1032a1ca4
Merge pull request #2151 from pipecat-ai/mb/ollama-kwargs
...
OLLamaLLMService: Pass kwargs
2025-07-08 07:21:09 -07:00
Mark Backman
931f34fccd
OLLamaLLMService: Pass kwargs
2025-07-08 07:17:18 -07:00
Mark Backman
f2509adec1
Merge pull request #2162 from pipecat-ai/mb/tts-service-aggregate-sentences
...
TTS services: Add aggregate_sentences arg
2025-07-08 07:14:58 -07:00
Filipi Fuchter
285b82eb65
Mentioning the AWSBedrockLLMService and AWSPollyTTSService refactors in the changelog.
2025-07-08 07:30:30 -03:00
Filipi Fuchter
74da197304
Refactored AWSBedrockLLMService and AWSPollyTTSService to work asynchronously using aioboto3 instead of the boto3 library.
2025-07-08 07:28:23 -03:00
Matej Marinko
0f727248d2
Merge branch 'main' of github.com:pipecat-ai/pipecat
2025-07-08 08:20:10 +02:00
mattie ruth backman
a6de16f92f
Bump all client dependencies to use client-js/react/transports 1.0.0
2025-07-07 15:56:08 -07:00
mattie ruth backman
fc09854d7f
fix cam light always on
2025-07-07 15:56:08 -07:00
mattie ruth backman
2959029151
PR Review fixes
2025-07-07 15:56:08 -07:00
mattie ruth backman
e590441b7b
Add support for about info in ready messages and add deprecation comments to deprecated types
2025-07-07 15:56:08 -07:00
mattie ruth backman
dc41ec7cb1
Updated all examples with clients to use the new PipecatClient
2025-07-07 15:56:08 -07:00
mattie ruth backman
43049c865c
Add support for new RTVI client message protocol: handling and responding
2025-07-07 15:56:08 -07:00
mattie ruth backman
c4a9fc7f88
video-transport typescript formatting
2025-07-07 15:56:08 -07:00
mattie ruth backman
faf4026cf4
Add device controls to the simple chatbot example
2025-07-07 15:56:08 -07:00
Mark Backman
f53f45a6cd
TTS services: Add aggregate_sentences arg
2025-07-07 15:38:31 -07:00
Mark Backman
e04e876f44
Merge pull request #2156 from shahrukhx01/add-additional-whisper-models
...
WhisperSTTService: Add additional whisper model variants
2025-07-07 12:53:06 -07:00
shahrukhx01
a84e7e30da
WhisperSTTService: Add additional whisper model variants
2025-07-07 21:43:48 +02:00
Mark Backman
6eed6ff779
Merge pull request #2147 from pipecat-ai/mb/user-idle-long-function-call
...
UserIdleProcessor: Account for function calls in progress
2025-07-04 14:11:16 -07:00
Mark Backman
1375211610
UserIdleProcessor: Account for function calls in progress
2025-07-04 14:05:05 -07:00
Mark Backman
4e9369a702
Merge pull request #2149 from pipecat-ai/mb/twilio-hang-up-handling
2025-07-04 12:44:17 -07:00
Mark Backman
f9e8748a96
TwilioFrameSerializer: Handle user hanging up before the serializer
2025-07-04 09:42:16 -07:00
Filipi da Silva Fuchter
20d6bf267a
Merge pull request #2146 from pipecat-ai/remove_gemini_duplicated_code
...
Removing duplicated code inside Gemini.
2025-07-04 11:59:10 -03:00
Filipi Fuchter
b573f9dab2
Removing duplicated code inside Gemini.
2025-07-04 10:57:53 -03:00
Pete
7ed4fe50d4
Update gemini.py
...
-FunctionCallFromLLM
-Delete duplicate Gemini imports
2025-07-03 19:39:44 -04:00
Pete
6f66ec1727
Update gemini.py
...
tab indentation fix
2025-07-03 18:55:21 -04:00
Pete
c7e758fc36
Merge branch 'main' into groundingMetadata
2025-07-03 18:47:47 -04:00
Pete
14c22234bb
Fix parameter name consistency in parse_server_event function
...
- Change function body to use 'str' parameter consistently
- Matches pattern used in OpenAI Realtime Beta service
- Fixes bug where parameter was named 'str' but body used 'message_str'
- Maintains consistency with existing codebase patterns
2025-07-03 18:02:24 -04:00
Pete
d565e9ae53
Update grounding metadata example with final refinements
...
- Reorganize imports and transport_params structure
- Remove copyright header for consistency
- Enhance grounding metadata logging with better formatting
- Remove unnecessary PipelineParams configuration
- Update message content formatting
Completes incorporation of draft PR #2121 changes
2025-07-03 17:53:55 -04:00
Pete
4951c97eab
Clean up verbose logging in grounding metadata implementation
...
- Remove debug logging from grounding metadata event handlers
- Simplify logging in _process_grounding_metadata method
- Clean up example file logging for better readability
- Remove verbose event parsing comments
Based on suggestions from draft PR #2121
2025-07-03 17:49:27 -04:00
Pete
9b38f3e2fa
Delete examples/foundational/26f-gemini-multimodal-live-files-api.py
2025-07-03 17:15:18 -04:00
Mark Backman
dbc76389d8
Merge pull request #2140 from pipecat-ai/mb/fix-26-imports
...
Fix: missing import in 26f foundational example
2025-07-03 14:12:54 -07:00
Aleix Conchillo Flaqué
c27f838444
Merge pull request #2124 from pipecat-ai/aleix/frame-processor-no-push-queue
...
FrameProcessor: remove unnecessary push task
2025-07-03 14:03:05 -07:00
Aleix Conchillo Flaqué
ce84485e26
Merge pull request #2142 from pipecat-ai/aleix/publish-workflow-message
...
github: update publish message to make it clear
2025-07-03 14:02:51 -07:00
Mark Backman
6cf254e2f9
Fix: missing import in 26f foundational example, update twilio transport_params to FastAPIWebsocketParams
2025-07-03 13:58:18 -07:00
Aleix Conchillo Flaqué
02b63c28a5
FrameProcessor: remove unnecessary push task
...
When we call `FrameProcessor.push_frame()` we end up calling
`FrameProcessor.queue_frame()` on the next or previous processor which already
uses the input queue and guarantees frame ordering. So, there's no need to have
a two queues next to each other.
2025-07-03 13:57:32 -07:00
Aleix Conchillo Flaqué
57c6ce7ffa
github: update publish message to make it clear
2025-07-03 13:55:02 -07:00
Pete
a297e4208e
Merge branch 'main' into groundingMetadata
2025-06-30 19:48:55 -04:00
Pete
1cf0b35ac1
Merge branch 'main' into groundingMetadata
2025-06-24 22:00:16 -04:00
Matej Marinko
c54084b7a4
Fix deadlock on STT service stop
2025-06-23 14:18:29 +02:00
Pete
e3fe040017
Update gemini.py
2025-06-21 14:43:15 -04:00
Pete
ae5e3e2dc4
Merge branch 'main' into groundingMetadata
2025-06-21 12:16:32 -04:00
Pete
77378d2779
Merge branch 'pipecat-ai:main' into groundingMetadata
2025-06-21 12:08:49 -04:00
Pete
4106f0dabe
Merge branch 'pipecat-ai:main' into main
2025-06-21 10:54:25 -04:00
Pete
2ed1ed6821
Merge branch 'pipecat-ai:main' into main
2025-06-14 16:23:27 -04:00
Matej Marinko
6d3a38842d
Merge branch 'main' of github.com:pipecat-ai/pipecat
2025-06-12 11:32:38 +02:00
Pete
7360f79413
Merge branch 'pipecat-ai:main' into main
2025-06-11 13:16:19 -04:00
Pete
8d55e13750
remove audio_transcriber from gemini.py
...
unecessary import removed.
2025-06-10 11:22:16 -04:00
Pete
737e8e79c9
Merge branch 'main' into groundingMetadata
2025-06-10 11:12:35 -04:00
Pete
4d977fede0
Merge branch 'main' into main
2025-06-10 11:07:59 -04:00
getchannel
8070e156d8
Add groundingMetadata events.py
2025-05-30 18:07:09 -04:00
getchannel
43c6f1f5cd
Add groundingMetadata and logging gemini.py
2025-05-30 18:01:15 -04:00
getchannel
f53f5445ba
Create 26g-gemini-multimodal-live-groundingMetadata.py
2025-05-30 17:36:36 -04:00
getchannel
7263d11ee4
update correct upload endpoint file_api.py
2025-05-30 13:41:55 -04:00
getchannel
f2d5b9ad69
Create 26f-gemini-multimodal-live-files-api.py
...
This is an example to test usage of the Files API integration. Specifically with the Gemini Multimodal Live Service.
2025-05-30 13:04:52 -04:00
getchannel
40c7e3c52c
Update gemini.py
2025-05-30 12:19:40 -04:00
Matej Marinko
ee5fea4221
Fix auto finalization cycle
2025-05-29 14:58:35 +02:00
Matej Marinko
db7b60cfe9
Auto finalize fix
2025-05-29 13:24:53 +02:00
Matej Marinko
51b79bd6a1
Minor code style changes
2025-05-29 10:11:11 +02:00
Matej Marinko
95fe762776
Fix typo
2025-05-29 09:23:37 +02:00
Matej Marinko
2968c846ce
Add Soniox STT service
2025-05-28 09:35:21 +02:00
Nischal Jain
ffa16dd136
added deepwiki badge for weekly repo refresh
2025-05-22 20:08:48 -07:00
getchannel
e27da96cdc
Rename file_api to file_api.py
...
added proper .py to file name.
2025-05-13 22:01:02 -04:00
getchannel
d86502e79a
add file_api __init__.py
2025-05-09 10:53:31 -04:00
getchannel
59c7744590
add FileData class events.py
2025-05-09 10:52:04 -04:00
getchannel
949971dea9
Create file_api
2025-05-09 10:51:24 -04:00
getchannel
cd4a893c65
add FileAPI to gemini.py
2025-05-09 10:50:27 -04:00