Mark Backman
708ef71c96
Update python-compatibility workflow to include new user project check
2025-08-09 20:19:16 -04:00
Aleix Conchillo Flaqué
241ab19228
update uv.lock with numba dependency
2025-08-08 15:12:55 -07:00
Mark Backman
c08e8ec8fb
Merge pull request #2391 from pipecat-ai/mb/readme-local-dev
...
Update README with local dev setup for contributors
2025-08-08 11:15:58 -07:00
Mark Backman
eb9bc9644e
Merge pull request #2400 from pipecat-ai/mb/pin-numba-0.61.2
...
fix: pin numba to >=0.61.2
2025-08-08 11:15:22 -07:00
Mark Backman
3a306dae90
fix: pin numba to >=0.61.2
2025-08-08 10:52:47 -04:00
Mark Backman
c42cc8254f
Update README with local dev setup for contributors
2025-08-07 22:07:35 -04:00
Aleix Conchillo Flaqué
a8e21f7d5d
Merge pull request #2395 from pipecat-ai/aleix/examples-15-inherit-parallel-pipeline
...
examples(foundational): move 15/15a logic into its own processor
2025-08-07 17:59:28 -07:00
Aleix Conchillo Flaqué
c6ef8de578
scripts(evals): fix 14v-function-calling-openai.py
2025-08-07 17:57:47 -07:00
Aleix Conchillo Flaqué
fc571fba42
examples(foundational): move 15/15a logic into its own processor
2025-08-07 17:57:47 -07:00
Mark Backman
0502ee2b5a
Merge pull request #2394 from pipecat-ai/mb/uv-lock
...
Update uv.lock
2025-08-07 15:25:38 -07:00
Mark Backman
9ec047094b
Update uv.lock
2025-08-07 18:24:47 -04:00
Mark Backman
d991c106c8
Merge pull request #2393 from pipecat-ai/mb/openai-dep
...
fix: pin openai package upper bound to <=1.99.1
2025-08-07 15:19:05 -07:00
Mark Backman
312fb23c89
fix: pin openai package upper bound to <=1.99.1
2025-08-07 18:00:25 -04:00
Aleix Conchillo Flaqué
4d7f21d44e
Merge pull request #2392 from pipecat-ai/aleix/avoid-using-tts-say
...
deprecate TTSService.say() method
2025-08-07 13:55:49 -07:00
Aleix Conchillo Flaqué
ec25d0a7c9
examples(foundational): fix 20a-persistent-context-openai
2025-08-07 13:48:32 -07:00
Aleix Conchillo Flaqué
2b8218deaa
examples(foundational): use TTSSpeakFrame instead of TTSService.say()
2025-08-07 13:48:32 -07:00
Aleix Conchillo Flaqué
11119430cd
TTSService: deprecate say() method
2025-08-07 13:48:32 -07:00
kompfner
9ca79232c1
Merge pull request #2380 from pipecat-ai/pk/deprecate-llm-messages-frame
...
Deprecate `LLMMessagesFrame`, `LLMUserResponseAggregator`, and `LLMAssistantResponseAggregator`
2025-08-07 15:13:01 -04:00
Paul Kompfner
9ea06c33f7
Bump deprecation version of LLMMessagesFrame, LLMUserResponseAggregator, and LLMAssistantResponseAggregator (the deprecation slipped past the 0.0.78 release)
2025-08-07 14:56:50 -04:00
Paul Kompfner
30a1dd202e
Move deprecation of LLMMessagesFrame, LLMUserResponseAggregator, and LLMAssistantResponseAggregator into the next release in the changelog
2025-08-07 14:55:11 -04:00
Paul Kompfner
809ab0b7b6
Improve printed deprecation warning
2025-08-07 14:45:35 -04:00
Paul Kompfner
2b5db9c562
Remove redundant deprecation warning in docstring
2025-08-07 14:45:35 -04:00
Paul Kompfner
b4a886b59f
Remove redundant deprecation warning in docstring
2025-08-07 14:45:35 -04:00
Paul Kompfner
07eb00722b
Fix langchain unit test
2025-08-07 14:45:35 -04:00
Paul Kompfner
96652b8fba
Add new deprecations to changelog
2025-08-07 14:45:30 -04:00
Paul Kompfner
df1fcf0c68
Remove unused import
2025-08-07 14:43:37 -04:00
Paul Kompfner
711f740d9e
Update UserResponseAggregator to avoid using the now-deprecated LLMUserResponseAggregator
2025-08-07 14:43:37 -04:00
Paul Kompfner
a0bda98c20
Update langchain to avoid using the now-deprecated LLMMessagesFrame, LLMUserResponseAggregator, and LLMAssistantResponseAggregator
2025-08-07 14:43:37 -04:00
Paul Kompfner
1c1bae35ab
Mention deprecation in docstring for LLMMessagesFrame
2025-08-07 14:43:37 -04:00
Paul Kompfner
56c52c2cf2
Deprecate LLMUserResponseAggregator and LLMAssistantResponseAggregator, which depend on the now-deprecated LLMMessagesFrame.
2025-08-07 14:43:37 -04:00
Paul Kompfner
740aee1a1a
Fix an issue in AnthropicLLMContext where we would never initialize turns_above_cache_threshold if we were upgrading from an OpenAILLMContext.
...
I noticed this when working on 22c-natural-conversation-mixed-llms.py
2025-08-07 14:43:37 -04:00
Paul Kompfner
f0391c3280
Progress on updating foundational examples to avoid using the newly-deprecated LLMMessagesFrame.
...
Skipping over 07b-interruptible-langchain.py for now, as it requires deeper changes involving `LLMUserResponseAggregator` and `LLMAssistantResponseAggregator`.
2025-08-07 14:43:37 -04:00
Paul Kompfner
64e48e4660
Deprecate LLMMessagesFrame.
...
The same functionality can be achieved using either:
- `LLMMessagesUpdateFrame` with the desired messages, with `run_llm` set to `True`
- `OpenAILLMContextFrame` with a new context initialized with the desired messages
2025-08-07 14:43:37 -04:00
Paul Kompfner
b8147bdbbd
Add missing Deepgram key to env.example
2025-08-07 14:43:37 -04:00
Aleix Conchillo Flaqué
315e45d41b
Merge pull request #2389 from pipecat-ai/aleix/pipecat-0.0.78
...
update CHANGELOG for 0.0.78
2025-08-07 11:34:27 -07:00
Aleix Conchillo Flaqué
c057139c48
update CHANGELOG for 0.0.78
2025-08-07 11:14:54 -07:00
Mark Backman
c61e07132d
Merge pull request #2390 from pipecat-ai/mb/optionally-ignore-emulated-speech
...
feat: Add option to ignore emulated user speech while the bot is spea…
2025-08-07 11:14:46 -07:00
Mark Backman
a5f5e418a8
feat: Add option to ignore emulated user speech while the bot is speaking
2025-08-07 14:08:11 -04:00
Mark Backman
31acfaa091
Merge pull request #2388 from pipecat-ai/14v-adding-openai-stt-tts-llm-functioncalling
...
14v adding OpenAI stt tts llm functioncalling
2025-08-07 10:22:35 -07:00
Mark Backman
69541c8835
Linting fix, plus update eval suite with 14v and others, tiny fix for 14m, too
2025-08-07 13:20:45 -04:00
Varun Singh
af94620839
Add OpenAI function calling example with Pipecat
...
Introduces a new example script demonstrating how to use OpenAI's function calling capabilities within a Pipecat pipeline. The example integrates OpenAI STT, TTS, and LLM services, registers a weather function, and sets up a pipeline for real-time audio interaction over WebRTC.
2025-08-07 13:20:45 -04:00
Filipi da Silva Fuchter
cec8a74293
Merge pull request #2386 from pipecat-ai/filipi/parallel_pipeline
...
Only push the StartFrame when all parallel pipelines have processed it
2025-08-07 14:20:30 -03:00
Filipi Fuchter
228a55ac1e
Only push the StartFrame when all parallel pipelines have processed it.
2025-08-07 14:18:21 -03:00
Vanessa Pyne
ab9831daf0
Merge pull request #2382 from pipecat-ai/vp-trace-ignore-message
...
log: warning -> trace for elevenlabs tts unavailable context
2025-08-07 09:35:57 -05:00
Vanessa Pyne
e8c3f5dea6
Update src/pipecat/services/elevenlabs/tts.py
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-08-07 09:23:33 -05:00
Mark Backman
4288b5e780
Merge pull request #2381 from pipecat-ai/aleix/runner-args-pipeline-idle-timeout
...
allow specifying PipelineTask idle timeout to runner arguments
2025-08-07 04:47:08 -07:00
Mark Backman
23343dd7e7
Remove idle_timeout_secs from quickstart
2025-08-07 07:44:21 -04:00
Mark Backman
88de5dd415
Merge pull request #2383 from pipecat-ai/aleix/riva-stt-iterator-exception
...
properly handle concurrent.futures.CancelledError
2025-08-07 04:39:56 -07:00
Mark Backman
33f87589d1
Merge pull request #2384 from pipecat-ai/aleix/release-evals-soniox-inworld-asyncai
...
scripts(evals): added soniox, inworld and asyncai
2025-08-07 04:35:18 -07:00
Aleix Conchillo Flaqué
7ed14ad91f
scripts(evals): added soniox, inworld and asyncai
2025-08-06 23:14:50 -07:00
Aleix Conchillo Flaqué
86c6141580
DailyTransport: handle future cancellation
2025-08-06 23:03:20 -07:00
Aleix Conchillo Flaqué
c97643c797
RivaSTTService: always use WatchdogQueue
2025-08-06 23:00:03 -07:00
Aleix Conchillo Flaqué
434d346079
RivaSTTService: handle future cancellation
2025-08-06 22:59:52 -07:00
vipyne
64ae8d2394
log: warning -> trace for elevenlabs tts unavailable context
2025-08-06 22:40:47 -05:00
Aleix Conchillo Flaqué
786f24c9db
examples(foundational): use RunnerArgs.pipeline_idle_timeout_secs
2025-08-06 19:38:06 -07:00
Aleix Conchillo Flaqué
38951aab56
scripts(evals): use RunnerArguments.pipeline_idle_timeout_secs
2025-08-06 19:37:29 -07:00
Aleix Conchillo Flaqué
ed8b0655a8
scripts(evals): fix runner eval cancellation
...
We need to call asyncio.gather() just once, not for every cancelled task.
2025-08-06 19:36:42 -07:00
Aleix Conchillo Flaqué
0b2b9f5f1b
RunnerArguments: add pipeline_idle_timeout_secs
2025-08-06 19:35:40 -07:00
Filipi da Silva Fuchter
ad1841b739
Merge pull request #2377 from pipecat-ai/filipi/fast_api_freeze_issue
...
Fixed an issue in BaseOutputTransport where the loop could consume all CPU.
2025-08-06 14:58:36 -03:00
Mark Backman
b0c002c128
Merge pull request #2378 from pipecat-ai/mb/pyproject-compat-updates
...
Add new python-compatiblity workflow to check for dependency compatib…
2025-08-06 10:40:29 -07:00
Mark Backman
820176084c
Add support for 3.13 by bumping min version for vllm to 0.9.0, adding support for torch and torchaudio up to the next major version
2025-08-06 13:36:01 -04:00
Mark Backman
5b7e31beff
README updates for python versions
2025-08-06 13:36:01 -04:00
Mark Backman
41a22d3bf4
Add new python-compatiblity workflow to check for dependency compatibility across supported python versions
2025-08-06 13:36:01 -04:00
Filipi Fuchter
84fecabac5
Removing audio sleep from FastAPI and WebSocket server when they are not connected.
2025-08-06 14:02:51 -03:00
Filipi Fuchter
bbe01d10ef
Fixed an issue in BaseOutputTransport where the loop could consume all CPU.
2025-08-06 12:42:58 -03:00
Mark Backman
4364990fd0
Merge pull request #2375 from fabrice404/gladia-region-selection
...
Gladia region selection
2025-08-06 07:01:24 -07:00
Fabrice Lamant
e576fa481f
Add new region feature for GladiaSTTService in CHANGELOG
2025-08-06 15:31:10 +02:00
Mark Backman
ac6b59cae2
Merge pull request #2372 from pipecat-ai/mb/dotenv-dev
...
Wider package support for python-dotenv dev dep
2025-08-06 06:06:01 -07:00
Mark Backman
12e168e740
Wider package support for python-dotenv dev dep
2025-08-06 09:04:01 -04:00
Mark Backman
ac354f66ed
Merge pull request #2371 from pipecat-ai/mb/docs-gen-with-uv
...
Update docs auto-generation to use uv
2025-08-06 06:02:52 -07:00
Mark Backman
eead793927
Merge pull request #2370 from pipecat-ai/mb/update-workflows-for-uv
...
Update workflows for uv
2025-08-06 05:54:55 -07:00
Fabrice Lamant
0594a203fc
Add new region parameter to Gladia
2025-08-06 14:28:06 +02:00
Mark Backman
2337a2d92d
Remove dev-requirements.txt and mentions of it
2025-08-05 21:46:50 -04:00
Mark Backman
b3e2603553
Update workflows for uv
2025-08-05 21:45:48 -04:00
Mark Backman
29229df719
Speed up builds, mocking large packages
2025-08-05 21:34:40 -04:00
Aleix Conchillo Flaqué
61f4dd2ff2
scripts(evals): fix 14e-function-calling-google
2025-08-05 17:44:45 -07:00
Mark Backman
42094fb206
Update docs auto-generation to use uv
2025-08-05 20:37:27 -04:00
Aleix Conchillo Flaqué
58c41f112a
DailyRunnerArguments: make body optional (fix)
2025-08-05 16:59:36 -07:00
Aleix Conchillo Flaqué
fa55e2ca9b
Merge pull request #2369 from pipecat-ai/aleix/pipeline-task-cancellation-fix
...
PipelineTask: always try to cancel things
2025-08-05 16:56:23 -07:00
Aleix Conchillo Flaqué
313fdc92a1
DailyRunnerArguments: make body optional
2025-08-05 16:39:18 -07:00
Aleix Conchillo Flaqué
d22d2da03d
PipelineTask: always try to cancel things
...
In a previous commit we only cleanup things if the user run
`task.cancel()`. However, if the task finishes cleanly we were not cancelling
anything.
2025-08-05 16:24:59 -07:00
Aleix Conchillo Flaqué
de2ae9a2ec
Merge pull request #2368 from pipecat-ai/aleix/release-evals-runner-args-fix
...
pass runner arguments to release evals
2025-08-05 16:23:32 -07:00
Aleix Conchillo Flaqué
52a6d8013c
scripts(evals): pass runner arguments to run_bot()
2025-08-05 16:13:32 -07:00
Aleix Conchillo Flaqué
f14cbae9b5
DailyRunnerArguments: make token optional
...
DailyTransport can get a None token value.
2025-08-05 15:46:12 -07:00
Aleix Conchillo Flaqué
8fe906438a
Merge pull request #2358 from pipecat-ai/aleix/system-frames-queued
...
system frames are now queued
2025-08-05 15:09:52 -07:00
Mark Backman
d8f4db8827
Merge pull request #2367 from richtermb/richtermb/fix-errorframe-docstring
...
Rename 'source' parameter to 'processor' in ErrorFrame class document…
2025-08-05 15:09:18 -07:00
Aleix Conchillo Flaqué
a5ea6e1642
FrameProcessor: system frames are now queued
...
System frames are now queued. Before, system frames could be generated from any
task and would not guarantee any order which was causing undesired
behavior. Also, it was possible to get into some rare recursion issues because
of the way system frames were executed (they were executed in-place, meaning
calling `push_frame()` would finish after the system frame traversed all the
pipeline). This makes system frames more deterministic.
2025-08-05 15:05:50 -07:00
richtermb
e777e78510
Rename 'source' parameter to 'processor' in ErrorFrame class documentation for clarity.
2025-08-05 15:02:00 -07:00
Aleix Conchillo Flaqué
49a5a1e375
PipelineTask: improve task cancellation
2025-08-05 14:49:23 -07:00
Aleix Conchillo Flaqué
61cb45d61b
PipelineTask: also wait on CancelFrame
...
Before CancelFrames didn't need to be waited for because system frames were
processed in-place and therefore calling push_frame() would finalize after it
traversed all the pipeline. Now, system frames are queued so we need to wait
until CancelFrame reaches the end of the pipeline.
2025-08-05 14:49:23 -07:00
Aleix Conchillo Flaqué
6c6deb4e85
Merge pull request #2366 from pipecat-ai/aleix/run-bot-runner-arguments
...
add sigint/sigterm to RunnerArguments
2025-08-05 14:46:19 -07:00
Aleix Conchillo Flaqué
66ad29b2b1
example: pass RunnerArguments to run_bot()
...
This lets us get handle_sigint from RunnerArguments which knows where the
application is running and if SIGINT/SIGTERM should be handled or not.
2025-08-05 14:38:55 -07:00
Aleix Conchillo Flaqué
21e4f0d56d
PipelineRunner: argument ordering
2025-08-05 14:38:55 -07:00
Aleix Conchillo Flaqué
627b44bac2
runner: use new RunnerArguments handle_sigint/handle_sigterm
...
This allow us to control applications behavior from the runner arguments, which
depen on the environment they run.
2025-08-05 14:38:55 -07:00
Aleix Conchillo Flaqué
e2a576beca
RunnerArguments: add handle_sigint/handle_sigterm
2025-08-05 14:32:28 -07:00
Mark Backman
2981afb117
Merge pull request #2361 from pipecat-ai/mb/fix-changelog-simli
...
Fix Simli changelog entry placement
2025-08-05 14:12:38 -07:00
Mark Backman
d422c57b52
Merge pull request #2304 from pipecat-ai/mb/cartesia-cjk-lang-support
...
CartesiaTTSService: Add CJK lang support for word timestamps
2025-08-05 14:08:53 -07:00
Mark Backman
06d8bbd154
Fix Simli changelog entry placement
2025-08-05 17:07:58 -04:00
Mark Backman
35108afeb8
Merge pull request #2360 from pipecat-ai/mb/add-heygen-readme
...
Add HeyGen to the README page
2025-08-05 14:05:33 -07:00
Mark Backman
a0e2a2754a
Merge pull request #2327 from richtermb/richtermb/push-more-error-frames
...
Add source parameter to ErrorFrame and set it in FrameProcessor. Upda…
2025-08-05 14:04:52 -07:00
Mark Backman
b8d620c8bb
Merge pull request #2362 from pipecat-ai/mb/aws-stt-languages
...
AWSTranscribeSTTService add support for new languages
2025-08-05 14:00:50 -07:00
Mark Backman
f26bbe4092
Merge pull request #2363 from pipecat-ai/mb/update-14p
...
Update 14p, add 14p to evals, add Google creds to env.example
2025-08-05 14:00:13 -07:00
Mark Backman
52cb23f8d5
Merge pull request #2364 from pipecat-ai/mb/11labs-default-model
...
ElevenLabs TTS services: revert to Turbo v2.5 as default model
2025-08-05 13:59:59 -07:00
Filipi da Silva Fuchter
17e7f8a2cd
Merge pull request #2352 from pipecat-ai/filipi/webrtc_audio_frame
...
Implementing if the bot it is speaking or not based on the SpeechOutputAudioRawFrame
2025-08-05 17:26:44 -03:00
richtermb
efddc4732c
Refactor ErrorFrame: rename source field to processor for clarity and update related references in FrameProcessor.
2025-08-05 13:25:08 -07:00
richtermb
4476a76ad7
Merge branch 'main' into richtermb/push-more-error-frames
2025-08-05 13:23:24 -07:00
Filipi Fuchter
64592b274b
Fixed an issue where BotStartedSpeakingFrame and BotStoppedSpeakingFrame
...
were not emitted when using `TavusVideoService` or `HeyGenVideoService`.
2025-08-05 17:11:34 -03:00
Aleix Conchillo Flaqué
95c661bdaa
Merge pull request #2365 from pipecat-ai/aleix/update-release-evals-for-new-runner
...
scripts(evals): update to use new runner function
2025-08-05 13:07:57 -07:00
Aleix Conchillo Flaqué
5546c8e01c
scripts(evals): update to use new runner function
2025-08-05 11:46:28 -07:00
Mark Backman
14e02c1b08
ElevenLabs TTS services: revert to Turbo v2.5 as default model
2025-08-05 13:44:37 -04:00
Mark Backman
ba5a5c7187
Update 14p, add 14p to evals, add Google creds to env.example
2025-08-05 13:30:36 -04:00
Mark Backman
2378cba155
AWSTranscribeSTTService add support for new languages
2025-08-05 13:01:06 -04:00
Mark Backman
1138c92a00
Merge pull request #2217 from simliai/main
...
feat: Add Simli Trinity models support to pipecat
2025-08-05 09:01:20 -07:00
Antonyesk601
fb82dc8308
Update CHANGELOG.md
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-08-05 17:46:01 +02:00
Mark Backman
c8a15f30fa
Add HeyGen to the README page
2025-08-05 10:54:49 -04:00
antonyesk601
72168070f1
update changelog
2025-08-05 14:18:41 +00:00
Mark Backman
50083d1144
Merge pull request #2342 from pipecat-ai/mb/runner-connect-request-body
...
Development runner handles body information in the RTVI connect request
2025-08-05 05:15:55 -07:00
Mark Backman
64732518c6
Development runner handles body information in the RTVI connect request
2025-08-05 07:26:34 -04:00
Mark Backman
c3d8ea210f
CartesiaTTSService: Add CJK lang support for word timestamps
2025-08-05 07:17:40 -04:00
Filipi da Silva Fuchter
98ed614f63
Merge pull request #2357 from pipecat-ai/filipi/latency_observer
...
Added detailed latency logging to UserBotLatencyLogObserver.
2025-08-05 08:11:48 -03:00
Filipi Fuchter
e43bdff31e
Added detailed latency logging to UserBotLatencyLogObserver.
2025-08-04 19:36:30 -03:00
Mark Backman
42e48381fe
Merge pull request #2355 from pipecat-ai/mb/update-readme-for-uv
...
Update the README with uv-centric steps
2025-08-04 15:28:07 -07:00
Mark Backman
df7ba64b4a
Merge pull request #2354 from pipecat-ai/mb/revert-43-inline-script
...
Remove inline script from foundational 43a
2025-08-04 15:27:28 -07:00
Mark Backman
ac9b2e67a7
Merge pull request #2349 from pipecat-ai/mb/runner-support-daily-url-arg
...
daily runner util: remove arg parsing, add auto room, token generation
2025-08-04 13:44:25 -07:00
Mark Backman
c9918607cf
Merge pull request #2335 from pipecat-ai/mb/quickstart-runner-improvements
...
Improve quickstart logging, runner startup message
2025-08-04 13:43:42 -07:00
Mark Backman
cfda410a43
Remove foundational requirements.txt file
2025-08-04 16:38:37 -04:00
Mark Backman
c773ddf83d
Update foundational examples README
2025-08-04 16:26:11 -04:00
Mark Backman
54d5ebbc20
Update the README with uv-centric steps
2025-08-04 16:11:38 -04:00
Mark Backman
35002cd727
Remove inline script from foundational 43a
2025-08-04 15:46:18 -04:00
Mark Backman
53d75faa47
Merge pull request #2330 from pipecat-ai/mb/runner-clean-proxy-name
...
Runner: strip protocol from proxy address
2025-08-04 10:42:16 -07:00
Mark Backman
2901dddc2b
Merge pull request #2338 from pipecat-ai/mb/update-release-evals-tavus
...
Add Tavus, HeyGen, Simli to release-evals
2025-08-04 10:38:27 -07:00
Mark Backman
3a8d809837
Runner: strip protocol from proxy address
2025-08-04 13:38:02 -04:00
Mark Backman
1b3c2bee30
Merge pull request #2331 from pipecat-ai/mb/more-foundational
...
Updating more foundational examples
2025-08-04 10:37:15 -07:00
Mark Backman
69f049cb63
Merge pull request #2328 from pipecat-ai/mb/04b-example-cleanup
...
Align 04b livekit example with other foundational examples
2025-08-04 10:36:57 -07:00
Vanessa Pyne
96b1000e52
Merge pull request #2341 from getchannel/realtime-text
...
Hotfix: Correct Gemini Live API class to fix 1007 payload error.
2025-08-04 11:03:57 -05:00
Filipi da Silva Fuchter
0184a8c231
Merge pull request #2351 from pipecat-ai/filipi/tavus_transport_ready
...
Changed `TavusVideoService` to send audio or video frames only after the transport is ready, preventing warning messages at startup.
2025-08-04 11:48:27 -03:00
Filipi Fuchter
c22866ed58
Mentioning the TavusVideoService fix in the changelog.
2025-08-04 11:46:24 -03:00
Filipi Fuchter
0e533d21be
Only send audio and video from the tavus video service if the transport is ready.
2025-08-04 10:52:30 -03:00
Mark Backman
6f6f4c3dea
Merge pull request #2348 from sam-s10s/speechmatics-stt
...
Fix for Speechmatics STT
2025-08-04 06:15:39 -07:00
Mark Backman
f609971637
daily runner util: remove arg parsing, add auto room, token generation
2025-08-03 21:50:44 -04:00
Mark Backman
54ff10ae86
Merge pull request #2332 from hankehly/fix-piper-tts-json-payload
...
Fix PiperTTSService to send TTS input as JSON object
2025-08-03 17:39:04 -07:00
hankehly
77057eb829
Fix ruff formatting
2025-08-04 08:13:16 +09:00
Mark Backman
2b1a7b840d
Merge pull request #2346 from adenta/heygen-testing
...
me trying to get heygen working
2025-08-03 14:11:14 -07:00
Sam Sykes
e07db88bc0
Updated changelog.
2025-08-03 22:11:10 +01:00
Sam Sykes
c2282b0e73
Set user_id to "" (not None) for RTVIProcessor.
2025-08-03 22:08:22 +01:00
Andrew Denta
593bf09d8d
update script
2025-08-03 17:01:27 -04:00
Sam Sykes
534ed77ebf
Merge branch 'main' into speechmatics-stt
2025-08-03 21:51:35 +01:00
Andrew Denta
193299988d
me trying to get heygen working
2025-08-03 13:42:07 -04:00
Aleix Conchillo Flaqué
d589bcb345
Merge pull request #2344 from pipecat-ai/aleix/daily-python-0.19.6
...
pyproject: update daily-python to 0.19.6
2025-08-03 10:15:15 -07:00
Aleix Conchillo Flaqué
011ebc2801
Merge pull request #2345 from pipecat-ai/aleix/task-observer-signature-performance
...
TaskObserver: don't inspect on_push_frame signature for every frame
2025-08-03 10:15:00 -07:00
Aleix Conchillo Flaqué
3a72e94d0c
LLMService: only do handle function inspection once
2025-08-03 10:09:19 -07:00
Aleix Conchillo Flaqué
d6d39fc873
TaskObserver: don't inspect on_push_frame signature for every frame
2025-08-03 10:09:17 -07:00
Pete
258e83c904
Fix: Correct Gemini Live API text input to prevent 1007 WebSocket errors
...
- Restore TextInputMessage.realtimeInput structure for correct API format
- Remove invalid turnComplete message from _send_user_text method
- turnComplete is only valid for clientContent, not realtimeInput messages
- realtimeInput text completion is automatically inferred by the API
This fixes WebSocket 1007 errors caused by mixing realtimeInput and
clientContent message types in violation of the Gemini Live API contract.
2025-08-03 10:58:59 -04:00
Mark Backman
061f2086b2
Merge pull request #2343 from pipecat-ai/mb/update-pre-commit-ruff-version
...
Update pre-commit-config ruff version
2025-08-03 03:38:54 -07:00
Aleix Conchillo Flaqué
a1f3f51168
pyproject: update daily-python to 0.19.6
2025-08-02 20:02:22 -07:00
hankehly
2177a2b805
Remove trailing space
2025-08-03 10:34:27 +09:00
hankehly
68164415ce
Format changelog entry
2025-08-03 10:26:37 +09:00
hankehly
7646599b66
Add changelog entry
2025-08-03 10:23:58 +09:00
Mark Backman
e467eaf130
Merge pull request #2334 from Designedforusers/fix/tavus-transport-daily-callbacks
...
fix: Add missing transcription callbacks to TavusTransport for 0.0.77 compatibility
2025-08-02 16:09:57 -07:00
Designedforusers
9d6d53629e
style: Apply ruff formatting to fix line length
...
Fixed a line length issue in tavus.py where the on_transcription_stopped callback was exceeding the maximum line length. Split the partial() call across multiple lines for better readability and compliance with project style guidelines.
2025-08-02 18:27:09 -04:00
Mark Backman
89596cfec4
Update pre-commit-config ruff version
2025-08-02 18:06:06 -04:00
Designedforusers
5e338ecaf1
refactor: Remove redundant transcription callback methods
...
As suggested in PR review, removed the _on_transcription_stopped and
_on_transcription_error method definitions. Now using the consistent
partial(self._on_handle_callback, ...) pattern for these callbacks,
matching how all other callbacks are handled.
This simplifies the code while maintaining the same functionality.
2025-08-02 15:02:54 -04:00
Designedforusers
62319021f8
docs: Add changelog entry for TavusVideoService fix
...
Added changelog entry as requested by maintainers for the fix addressing
missing transcription callbacks in TavusVideoService.
2025-08-02 14:53:44 -04:00
Pete
cccd82a617
Refactor TextInputMessage class to replace realtimeInput with a text attribute.
...
This was sending a 1007 because it was wrapping RealtimeInput in the json.
- Updated the `TextInputMessage` class to directly store text input as a string.
- Modified the `from_text` class method to create an instance using the new `text` attribute.
2025-08-02 14:34:00 -04:00
Mark Backman
f552ba1f5e
Merge pull request #2336 from pipecat-ai/mb/suppress-pydub-warning
...
Suppress pydub (cartesia dependency) SyntaxWarning
2025-08-02 10:01:05 -07:00
Mark Backman
b9a2a9b729
Add Tavus, HeyGen, Simli to release-evals
2025-08-02 09:35:06 -04:00
Mark Backman
e43b3869c3
Suppress pydub SyntaxWarning from the cartesia module
2025-08-02 08:49:59 -04:00
Mark Backman
55731df999
Improve quickstart logging, runner startup message
2025-08-02 08:40:05 -04:00
Designedforusers
3a7ea25077
fix: Add missing transcription callbacks to TavusTransport for 0.0.77 compatibility
...
TavusTransport was broken in Pipecat 0.0.77 due to PR #2292 adding required
callbacks (on_transcription_stopped, on_transcription_error) to DailyCallbacks.
This fix adds placeholder implementations of these callbacks to TavusTransportClient,
allowing TavusTransport to initialize properly. These callbacks are not used by
Tavus (which handles avatar video, not transcription) but are required by the
DailyCallbacks validation.
Fixes initialization error:
- 2 validation errors for DailyCallbacks
- on_transcription_stopped: Field required
- on_transcription_error: Field required
2025-08-02 05:56:46 -04:00
hankehly
694922f627
Fix PiperTTSService to send TTS input as JSON object
2025-08-02 15:29:16 +09:00
Mark Backman
cc9950e72d
Updating more foundational examples
2025-08-01 19:58:40 -04:00
richtermb
6814c390ba
Update CHANGELOG to reflect the addition of the source field in ErrorFrame for improved error tracking.
2025-08-01 14:47:57 -07:00
Richter Brzeski
c2d05ad23b
Merge branch 'pipecat-ai:main' into richtermb/push-more-error-frames
2025-08-01 14:47:08 -07:00
Mark Backman
ee56d8572d
Merge pull request #2329 from pipecat-ai/mb/fix-livekit-empty-audio-frames
...
fix: LiveKitTransport, don't push empty AudioRawFrames
2025-08-01 12:53:05 -07:00
richtermb
91568eeddc
Update type hint for source in ErrorFrame to use forward declaration for improved clarity.
2025-08-01 12:52:56 -07:00
richtermb
165d6b4c1d
Update CHANGELOG to include new source field in ErrorFrame for error tracking.
2025-08-01 12:25:29 -07:00
Mark Backman
1d8abe3c1c
fix: LiveKitTransport, don't push empty AudioRawFrames
2025-08-01 14:57:53 -04:00
Mark Backman
a6e69d6aad
Merge pull request #2325 from pipecat-ai/mb/dependency-groups
...
Move dev to [dependency-groups], update uv.lock
2025-08-01 11:54:21 -07:00
Mark Backman
519da9cc61
Align 04b livekit example with other foundational examples
2025-08-01 14:28:15 -04:00
richtermb
ead4e97ab5
Add source parameter to ErrorFrame and set it in FrameProcessor. Updated error handling in AnthropicLLMService and DeepgramSTTService to include ErrorFrame with source information.
2025-08-01 11:14:50 -07:00
Mark Backman
0c021378b0
Merge pull request #2326 from pipecat-ai/readme-quickstart-link
...
Update README.md
2025-08-01 10:45:30 -07:00
Mark Backman
e22c7e8ad5
Update README.md
2025-08-01 13:40:03 -04:00
Mark Backman
b71057bf7c
Move dev to [dependency-groups], update uv.lock
2025-08-01 09:43:56 -04:00
Mark Backman
0865f6cd7d
Merge pull request #2318 from pipecat-ai/mb/add-asyncio-readme
...
Add AsyncAI TTS to README vendor list
2025-08-01 06:11:13 -07:00
Mark Backman
610b1ab065
Merge pull request #2319 from pipecat-ai/mb/use-new-runner
...
Update foundational examples to use new runner
2025-08-01 06:11:03 -07:00
Mark Backman
3a2a226668
Merge pull request #2320 from pipecat-ai/mb/uv-lock-init
...
Add initial uv.lock file
2025-08-01 06:07:53 -07:00
Mark Backman
8e4b7352fd
Merge pull request #2321 from pipecat-ai/mb/dev-requirements
...
Add dev to optional-dependencies
2025-08-01 06:02:58 -07:00
Mark Backman
637d372fe4
Add dev to optional-dependencies
2025-07-31 23:39:23 -04:00
Mark Backman
ac15fe8ae4
Add workflow to update lockfile with pyproject.toml changes
2025-07-31 23:08:21 -04:00
Mark Backman
07239c0b8b
Add initial uv.lock file
2025-07-31 22:46:44 -04:00
Mark Backman
367b2fbe3c
Update requirements.txt
2025-07-31 22:12:57 -04:00
Mark Backman
f1b1d5b130
Update foundational examples to use the development runner
2025-07-31 22:11:32 -04:00
Mark Backman
ff45b77fdf
Remove examples runner
2025-07-31 21:22:04 -04:00
Mark Backman
e522b7ae96
Add AsyncAI TTS to README vendor list
2025-07-31 19:33:37 -04:00
Mark Backman
b8eef4f93b
Merge pull request #2314 from pipecat-ai/mb/sync-quickstart-example
...
Add workflow to sync quickstart to pipecat-quickstart repo
2025-07-31 15:34:26 -07:00
Mark Backman
dcc205996a
Merge pull request #2317 from pipecat-ai/mb/release-prep-0.0.77
...
Changelog update for 0.0.77
2025-07-31 15:34:02 -07:00
Mark Backman
9f61af4d1b
Changelog update for 0.0.77
2025-07-31 18:19:05 -04:00
Sam Sykes
e8faf28e6a
Doc fix for incorrect argument name.
2025-07-31 22:30:54 +01:00
Filipi da Silva Fuchter
40d53b3d84
Merge pull request #2316 from sam-s10s/speechmatics-stt
...
Updated to SpeechmaticsSTTService
2025-07-31 18:28:16 -03:00
Sam Sykes
7c223a86c2
Fix to missing deprecated attribute enable_speaker_diarization.
2025-07-31 22:25:46 +01:00
Sam Sykes
2d3f61aa07
Updated Speechmatics Plugin ( #2225 )
...
Changes
Split out module attributes to make engine settings clearer
Removed internal audio buffer to use latest Speechmatics python SDK (0.4.0)
Use diarization for improved VAD in multi-speaker situations
Support custom dictionary / vocabulary with attributes
Deprecated attributes superseded by re-organised attributes
Diarization Enhancements
Focus on specific speakers (using speaker labels)
Ignore specific speakers (using speaker labels)
Separate transcription formats for active and inactive speakers
Support for known speakers
2025-07-31 17:51:38 -03:00
Mark Backman
e05a47744d
Merge pull request #2311 from pipecat-ai/mb/quickstart-fixups
...
Set quickstart min pipecat-ai version to 0.0.77, remove non-quickstart examples
2025-07-31 13:42:10 -07:00
Aleix Conchillo Flaqué
6ffaab2b93
CHANGELOG cosmetics
2025-07-31 13:39:37 -07:00
Aleix Conchillo Flaqué
c2d8844903
Merge pull request #2312 from pipecat-ai/aleix/srhinos/main
...
Enable Interruption Support for LLMUserResponseAggregator
2025-07-31 13:30:57 -07:00
Mark Backman
e8caba7723
Add workflow to sync quickstart to pipecat-quickstart repo
2025-07-31 15:56:18 -04:00
Mark Backman
df96ef7d37
Remove non-quickstart demos
2025-07-31 15:38:54 -04:00
Aleix Conchillo Flaqué
7553f670af
fix formatting and update CHANGELOG
2025-07-31 10:41:11 -07:00
Mark Backman
6960f5861b
Set example min pipecat-ai version to 0.0.77 due to runner requirement
2025-07-31 12:21:58 -04:00
Mark Backman
b5edbbc0ca
Merge pull request #2309 from pipecat-ai/mb/remove-runner-examples
...
Remove examples/runner-examples
2025-07-31 09:18:22 -07:00
Aleix Conchillo Flaqué
e78d9c2c95
Merge pull request #2293 from azain47/azain47/fix-piper-tts-service
...
Fix Piper TTS Service
2025-07-31 08:32:17 -07:00
Vanessa Pyne
b25547a98b
Merge pull request #2305 from pipecat-ai/vp-changelog-text-input
...
update changelog
2025-07-31 10:16:47 -05:00
Mark Backman
e80281c3c4
Remove examples/runner-examples
2025-07-31 10:59:06 -04:00
Mark Backman
d692843e5b
Merge pull request #2308 from pipecat-ai/mb/change-neuphonic-url
...
NeuphonicTTSService: change the default url value to the global endpoint
2025-07-31 07:38:57 -07:00
Mark Backman
eaad3c5d55
NeuphonicTTSService: change the default url value to the global endpoint
2025-07-31 10:24:54 -04:00
vipyne
f2a1c66379
update changelog
2025-07-31 08:55:25 -05:00
Vanessa Pyne
af8de227bb
Merge pull request #2223 from getchannel/realtime-text
...
Add text input handling to unify context for realtimeInput stream of GeminiMultimodalLiveService
2025-07-31 08:53:39 -05:00
Mark Backman
7cd78dd286
Merge pull request #2303 from pipecat-ai/mb/add-new-quickstart-demos
...
Add quickstart demos
2025-07-31 05:56:00 -07:00
Mark Backman
226b516948
Add quickstart demos
2025-07-30 22:14:10 -04:00
Mark Backman
aa85fffa57
New runner module ( #2269 )
...
* Adds pipecat.runner.run - FastAPI-based development server with automatic bot discovery
* Adds new RunnerArguments types for different transports
* Adds new runner utils for creating transports and parsing data
* Adds new Daily and LiveKit utils for setup
2025-07-30 22:02:28 -04:00
srhinos
8b97ab70ff
Enable Interruption Support for LLMUserResponseAggregator
2025-07-30 20:48:31 -04:00
Filipi da Silva Fuchter
9013b2929a
Merge pull request #2300 from pipecat-ai/filipi/fast_api_race_condition
...
Fixed a race condition in FastAPIWebsocketClient
2025-07-30 18:10:09 -03:00
Filipi Fuchter
0c6e12a9b0
Fixed a race condition in FastAPIWebsocketClient that occurred when attempting to send a message while the client was disconnecting.
2025-07-30 18:07:40 -03:00
Aleix Conchillo Flaqué
efb24071d5
Merge pull request #2301 from pipecat-ai/aleix/daily-python-0.19.5
...
pyproject: update daily-python to 0.19.5
2025-07-30 14:01:27 -07:00
Filipi da Silva Fuchter
318ebec67e
Merge pull request #2298 from pipecat-ai/filipi/google_interruptions
...
Fixed an issue in GoogleLLMService where interruptions did not work when an interruption strategy was used.
2025-07-30 17:49:07 -03:00
Aleix Conchillo Flaqué
c679227aa8
pyproject: update daily-python to 0.19.5
2025-07-30 13:19:48 -07:00
Filipi Fuchter
392853f5fa
Fixed an issue in GoogleLLMService where interruptions did not work when an interruption strategy was used.
2025-07-30 12:10:32 -03:00
Mark Backman
98d27caab3
Merge pull request #2296 from pipecat-ai/mb/switch-rime-voices
...
Added the ability to switch voices to RimeTTSService
2025-07-30 07:55:52 -07:00
Mark Backman
0fa51968bf
Added the ability to switch voices to RimeTTSService
2025-07-30 10:53:14 -04:00
Mark Backman
92aee2634b
Merge pull request #2291 from pipecat-ai/mb/remove-on-client-closed
2025-07-30 06:36:32 -07:00
Filipi da Silva Fuchter
bff6a93f31
Merge pull request #2150 from pipecat-ai/filipi/hey_gen
...
HeyGen implementation for Pipecat - HeyGenVideoService
2025-07-30 09:10:07 -03:00
Filipi Fuchter
6e921cdf45
HeyGen implementation for Pipecat - HeyGenVideoService
2025-07-30 09:07:15 -03:00
Azain.
1e2b066cf3
Fix tts.py
...
Update Piper TTS Service to work with the newer Piper GPL Version, that uses JSON as its payload.
2025-07-30 13:41:27 +05:30
Pete
2af3b6329d
Ruff format debug
2025-07-29 17:48:11 -04:00
Pete
8ca06e5887
Add InputTextRawFrame class for handling raw text input in frames
...
- Introduced `InputTextRawFrame` to represent raw text input from users or programs.
- Updated `GeminiMultimodalLiveLLMService` to process `InputTextRawFrame` and send user text via the Gemini Live API's realtime input stream.
- Enhanced `_send_user_text` method documentation for clarity on its functionality and usage.
2025-07-29 17:43:14 -04:00
Mark Backman
c145a9ef13
Merge pull request #2288 from pipecat-ai/mb/stt-mute-examples
...
Update placement of STTMuteFilter in examples to reflect the new reco…
2025-07-29 12:10:36 -07:00
Mark Backman
b523f9a4c6
Merge pull request #2248 from ashotbagh/feat/async-tts
...
feat(tts): integrate Async TTS engine into pipecat
2025-07-29 12:10:11 -07:00
Mark Backman
7f184422d0
Merge branch 'main' into feat/async-tts
2025-07-29 12:06:56 -07:00
Aleix Conchillo Flaqué
fa4c3ec6bf
Merge pull request #2287 from pipecat-ai/aleix/asyncio-trace-logging
...
utils(asyncio): use trace logging for some cancelling messages
2025-07-29 11:56:25 -07:00
Aleix Conchillo Flaqué
9fafc10844
Merge pull request #2292 from richtermb/transcription-error-callback
...
Add on_transcription_error callback to DailyCallbacks and handle tran…
2025-07-29 11:56:02 -07:00
richtermb
67107d02ed
Refactor callback invocation for on_transcription_stopped in DailyTransportClient for improved readability
2025-07-29 11:53:41 -07:00
richtermb
c1df19982c
Add on_transcription_stopped callback to DailyTransport for handling transcription stop events
2025-07-29 11:50:16 -07:00
richtermb
444b1b5b02
Add on_transcription_stopped callback to DailyCallbacks and implement handling in DailyTransport for transcription stop events
2025-07-29 11:49:28 -07:00
Mark Backman
ebfa4f2d5e
Push the STTMuteFrame upstream and downstream
2025-07-29 14:37:36 -04:00
Mark Backman
e961c438e7
Update placement of STTMuteFilter in examples to reflect the new recommendation
2025-07-29 14:36:39 -04:00
richtermb
d3d36a89e2
Add _on_transcription_error method to DailyTransport for handling transcription error events
2025-07-29 10:48:50 -07:00
richtermb
fa6e5ce4a7
Add on_transcription_error callback to DailyCallbacks and handle transcription errors in DailyTransportClient
2025-07-29 10:43:18 -07:00
Mark Backman
3ffb261864
Remove use of on_client_closed event in foundational examples
2025-07-29 13:28:33 -04:00
Mark Backman
f69a02b7a7
Merge pull request #2290 from pipecat-ai/mb/remove-examples
...
Removed most pipecat examples, relocating to pipecat-examples repo
2025-07-29 10:02:24 -07:00
Mark Backman
f1f4aed398
Remove random Dockerfile, update README links
2025-07-29 11:41:27 -04:00
Mark Backman
414c245c92
Remove android.yaml github workflow
2025-07-29 11:34:48 -04:00
Mark Backman
3f57d94c0b
Update examples README
2025-07-29 11:28:40 -04:00
Mark Backman
15e3c69ddc
Removed most pipecat examples, relocating to pipecat-examples repo
2025-07-29 11:17:01 -04:00
Ashot
39b00f5269
chore: address review comments
2025-07-29 18:20:50 +04:00
Mark Backman
4c368c78c6
Merge pull request #2289 from tomoima525/tomoima525/transcription-bucket-params
...
Add transcription_bucket param for rest helper
2025-07-29 05:05:08 -07:00
Tomoaki Imai
6eb00a99cb
update Changelog for transcription_bucket params addition
2025-07-29 20:38:12 +09:00
Tomoaki Imai
3ae8cf1916
Add transcription_bucket param for rest helper
2025-07-29 18:58:38 +09:00
Aleix Conchillo Flaqué
03e87469df
utils(asyncio): use trace logging for some cancelling messages
2025-07-28 17:43:41 -07:00
Mark Backman
70255d3c81
Merge pull request #2274 from pipecat-ai/mb/remove-message-name
...
Remove message["name"] addition when pushing
2025-07-28 17:29:23 -07:00
Mark Backman
96a72d0647
Remove message[name] addition when pushing
2025-07-28 20:13:50 -04:00
Mark Backman
27d4910694
Merge pull request #2286 from pipecat-ai/mb/fix-transcript-processor-newline
...
fix: Improve TranscriptProcessor detection for transcript type
2025-07-28 17:07:43 -07:00
Mark Backman
50242f4ad8
fix: Improve TranscriptProcessor detection for transcript type
2025-07-28 19:56:36 -04:00
Mark Backman
c9dda5251c
Merge pull request #2284 from pipecat-ai/mb/yank-74-75
...
Add yanked notices to 0.0.74 and 0.0.75 changelogs
2025-07-28 12:55:47 -07:00
Mark Backman
419cc9ac68
Add yanked notices to 0.0.74 and 0.0.75 changelogs
2025-07-28 13:36:02 -04:00
Ashot
83b4747196
chore: address review comments
2025-07-28 17:52:17 +04:00
Ashot
a13b954415
formatting/cleanup: address Copilot PR review comments
2025-07-28 17:43:17 +04:00
Ashot
f2e9562f1b
feat(tts): integrate Async TTS engine into pipecat
2025-07-28 17:42:57 +04:00
Mark Backman
afed9a61f2
Merge pull request #2268 from pipecat-ai/mb/inworld-changelog
...
Add changelog entry for InworldTTSService
2025-07-28 05:59:57 -07:00
Mark Backman
f0de27b35e
Merge pull request #2273 from pipecat-ai/mb/gitignore-plivo-stream
...
.gitignore: add plivo-chatbot streams.xml, .python-version
2025-07-28 05:59:41 -07:00
Filipi da Silva Fuchter
9d5510ee47
Merge pull request #2265 from pipecat-ai/filipi/small_webrtc_buffer_processor
...
Fixed an issue in AudioBufferProcessor when using SmallWebRTCTransport
2025-07-28 09:23:58 -03:00
Mark Backman
434c3fc527
Merge pull request #2279 from Allenmylath/patch-26
...
Update README.md
2025-07-28 04:51:58 -07:00
allenmylath
aba79a9478
Update README.md
...
Explanatory comment.Eventhought code allows for transport params.It is not clearly given in readme, what all are the options are there.
2025-07-28 11:24:27 +05:30
Mark Backman
fc96e091a9
Update NVIDIA in README
2025-07-26 15:01:52 -04:00
Mark Backman
851a27c082
Add Groq TTS to README
2025-07-26 14:58:07 -04:00
Mark Backman
a72d93dc6d
Add Inworld to README
2025-07-26 14:55:19 -04:00
Mark Backman
c971232f20
.gitignore: add plivo-chatbot streams.xml, .python-version
2025-07-26 10:19:50 -04:00
Mark Backman
4b2ba2d69f
Merge pull request #2270 from Allenmylath/patch-25
...
Update README.md
2025-07-26 04:55:59 -07:00
allenmylath
240a698fab
Update README.md
...
recreating examples without activating bedrock models will create errors . Warning and link added
2025-07-26 14:51:19 +05:30
Mark Backman
9aaae01063
Add changelog entry for InworldTTSService
2025-07-25 21:46:02 -04:00
Mark Backman
41c8d22cf3
Merge pull request #2208 from padillamt/mtp/add-inworld-tts
...
Inworld HTTP TTS Service
2025-07-25 17:13:37 -07:00
padillamt
b68f044ef7
mtpadilla: updated example to reflect parameter placement changes in base Inworld TTS class
2025-07-25 15:13:43 -07:00
padillamt
e140bd6960
mtpadilla: moved model and voice id setting into the class constructor
2025-07-25 14:04:49 -07:00
Filipi Fuchter
e86b55e2b3
Fixed an issue in AudioBufferProcessor when using SmallWebRTCTransport where, if the microphone was muted, track timing was not respected.
2025-07-25 17:01:41 -03:00
padillamt
4a9bec5b35
mtpadilla: stop metrics at result chunk
2025-07-25 11:14:20 -07:00
padillamt
37361391d9
mtpadilla: removed ability to set base_url via constructor, set internally based on streaming variable
2025-07-25 09:16:56 -07:00
Filipi da Silva Fuchter
4b3726eba4
Merge pull request #2260 from pipecat-ai/filipi/audio_resampler
...
Fixed an issue in `AudioBufferProcessor` that caused garbled audio
2025-07-25 09:27:42 -03:00
padillamt
8e66794759
mtpadilla: switch to Deepgram ASR for lower latency
2025-07-24 22:22:36 -07:00
padillamt
acc5b9f210
inworld: change to function that stops all processing metrics
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 22:07:15 -07:00
padillamt
f982ace4c5
inworld: removal of unnecessary setting of ssampling rate since matches default
2025-07-24 21:56:01 -07:00
padillamt
5fb1899aeb
inworld: removal of unnecessary default assignment as already handled
2025-07-24 21:42:42 -07:00
padillamt
7483422bd9
inworld: change set_voice uto use self._settings
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 21:23:03 -07:00
padillamt
16c20f3a99
inworld: removal of unnecessary default assignment since already done
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 21:15:34 -07:00
padillamt
d248c102c8
inworld: removal of unnecessary default assignment since already done
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 21:15:20 -07:00
padillamt
662550cc5e
mtpadilla: remove unused imports
2025-07-24 21:05:22 -07:00
padillamt
067f64389b
mtpadilla: no longer needed so making empty
2025-07-24 20:44:27 -07:00
padillamt
81048ce43a
mtpadilla: rename 07aa-interruptible-inworld-http.py to 07ab-interruptible-inworld-http.py
2025-07-24 20:42:29 -07:00
padillamt
f6440ee6e1
mtpadilla: correct Examples header in comments
2025-07-24 13:36:40 -07:00
padillamt
da8c67114a
mtpadilla: make streaming the default for example
2025-07-24 13:35:29 -07:00
Mark Backman
d8ea1311ff
Merge pull request #2254 from pipecat-ai/mb/11labs-create-context-id
...
ElevenLabsTTSService: Only reset the context_id when interruptions ar…
2025-07-24 13:32:37 -07:00
Mark Backman
2be615066c
Merge pull request #2261 from pipecat-ai/mb/foundational-requirements
...
Foundational requirements.txt: add silero, websocket optional dep, re…
2025-07-24 11:06:16 -07:00
Mark Backman
75c2ffc0b5
Check if audio context is already available, create one if not
2025-07-24 13:57:46 -04:00
Mark Backman
2297eb217e
ElevenLabsTTSService: Only reset the context_id when interruptions are enabled
2025-07-24 13:53:44 -04:00
Mark Backman
1bb821a07d
Foundational requirements.txt: add silero, websocket optional dep, remove fastapi
2025-07-24 13:49:44 -04:00
Filipi Fuchter
970b8044a0
Fixed an issue in AudioBufferProcessor that caused garbled audio when enable_turn_audio was enabled and audio resampling was required.
2025-07-24 13:25:48 -03:00
Filipi da Silva Fuchter
d8bcb81f35
Merge pull request #2259 from pipecat-ai/filipi/eleven_labs_delayed_messages
...
Play delayed messages from `ElevenLabsTTSService` if they still belong to the current context.
2025-07-24 12:07:06 -03:00
Filipi da Silva Fuchter
3ce0ab8c6d
Removing extra space.
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-07-24 12:05:17 -03:00
Filipi Fuchter
097d786431
Fixing ruff format.
2025-07-24 12:03:17 -03:00
Filipi Fuchter
662f04879c
Play delayed messages from ElevenLabsTTSService if they still belong to the current context.
2025-07-24 12:00:14 -03:00
Mark Backman
7a69f57e11
Merge pull request #2255 from pipecat-ai/mb/pyproject-versions-for-uv
...
pyproject.toml dependency updates to support better cross compatibility
2025-07-24 06:43:35 -07:00
Mark Backman
5b7b4efdc9
Add broader version support for stable core dependencies, up to the next major version
2025-07-24 09:40:52 -04:00
Mark Backman
cfa26524ca
Add support for fastapi>=0.115.6,<0.117.0
2025-07-24 09:37:42 -04:00
Mark Backman
3d4ab7158d
pyproject.toml dependency updates to support better cross compatibility
2025-07-24 09:37:42 -04:00
Mark Backman
26d1ca3c98
Merge pull request #2256 from pipecat-ai/mb/refactor-neuphonic-http
...
NeuphonicHttpTTSService: Refactor to use POST API
2025-07-24 06:36:23 -07:00
Mark Backman
083b32887e
NeuphonicHttpTTSService: Refactor to use POST API
2025-07-24 01:05:37 -04:00
padillamt
b6367965cb
mtpadilla: consolidate streaming and non-streaming options into a single class with common API, with boolean switch variable added (streaming)
2025-07-23 16:50:32 -07:00
padillamt
147bf9cfe8
mtpadilla: addition of non-streaming option with own dedicated class, and related additional non-streaming test option
2025-07-23 15:28:43 -07:00
Mark Backman
3391929127
Merge pull request #2252 from pipecat-ai/mb/example-axios-version-bump
...
Update axios in daily-pstn-server example due to transitive vulnerabi…
2025-07-23 13:30:58 -07:00
padillamt
a5d353030e
mtpadilla: small formatting fix to comments
2025-07-23 12:02:58 -07:00
padillamt
f29024bcc0
mtpadilla: update coments regarding temperature parameter
2025-07-23 11:47:26 -07:00
Mark Backman
ebf9bc2741
Merge pull request #2246 from ydlamba/ydlamba/missing-livekit-event
...
fix(livekit): emit on_audio_track_subscribed event
2025-07-23 11:27:10 -07:00
Mark Backman
f5edde42f6
Update axios in daily-pstn-server example due to transitive vulnerability with form-data
2025-07-23 14:22:13 -04:00
Filipi da Silva Fuchter
37bb7ef926
Merge pull request #2239 from pipecat-ai/filipi/daily_log
...
Added `set_log_level` to `DailyTransport`
2025-07-23 14:48:34 -03:00
Filipi Fuchter
a63d1530a4
Added set_log_level to DailyTransport.
2025-07-23 14:43:53 -03:00
Yash Dev Lamba
960bc9df5b
chore(changelog): add entry for LiveKitTransport audio subscribed event fix
2025-07-23 22:41:20 +05:30
Mark Backman
e2a153ee01
Merge pull request #2242 from pipecat-ai/mb/websockets-14
...
Upgrade websockets to support asyncio implementation
2025-07-23 08:58:08 -07:00
Mark Backman
300f19ad23
Port to the websockets asyncio implementation, support for websockets 13 and 14
2025-07-23 11:54:25 -04:00
Mark Backman
7955080da2
Change extra_headers to additional_headers, update websocket version support
2025-07-23 11:53:43 -04:00
Mark Backman
994e82c1ef
Merge pull request #2243 from pipecat-ai/mb/word-wrangler-twilio-readme
...
Update Word Wrangler phone bot README to include deployment info
2025-07-23 07:04:19 -07:00
Mark Backman
b07b947352
Merge pull request #2244 from pipecat-ai/mb/upgrade-deepgram-4.7.0
...
Deepgram: Update optional dependency to 4.7.0
2025-07-23 07:04:02 -07:00
Filipi da Silva Fuchter
a6527c3856
Merge pull request #2240 from pipecat-ai/filipi/sig_term
...
Adding support for handle_sigterm
2025-07-23 08:15:50 -03:00
antonyesk601
1cbf7ae480
fix: remove unused variable; fix: remove redundant logic
2025-07-23 08:26:44 +00:00
Yash Dev Lamba
0e6874b605
fix(livekit): emit on_audio_track_subscribed event
2025-07-23 08:23:45 +05:30
Mark Backman
9ba172c49f
Merge pull request #2236 from dbtreasure/fix/python-311-compatibility
...
Fix Python 3.11+ compatibility by pinning numba/llvmlite versions
2025-07-22 18:20:38 -07:00
dbtreasure
f710c94b6e
Address code review feedback: remove explicit llvmlite pin
...
- Remove explicit llvmlite>=0.44.0 pin as numba>=0.61.0 automatically pulls compatible version
- Add changelog entry for Python 3.11+ dependency fix
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-07-22 18:45:32 -06:00
dbtreasure
6e3a0a2d5d
Add explicit numba/llvmlite pins for Python 3.11+ compatibility
...
Fixes dependency resolution issues where transitive dependencies
through resampy would install incompatible versions:
- numba>=0.61.0 (supports Python 3.10-3.13)
- llvmlite>=0.44.0 (supports Python 3.10-3.13)
Previously, older versions (numba 0.53.1, llvmlite 0.36.0) only
supported Python 3.6-3.9, causing deployment failures on Python 3.11+.
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-07-22 18:45:02 -06:00
Mark Backman
9530b8b842
Merge pull request #2235 from pipecat-ai/mb/nltk-tokenizer
...
Update match_endofsentence to use NLTK sentence tokenizer
2025-07-22 17:22:23 -07:00
Mark Backman
26c937af87
Update match_endofsentence to use NLTK sentence tokenizer
2025-07-22 20:19:29 -04:00
Mark Backman
976f6168f0
Deepgram: Update optional dependency to 4.7.0
2025-07-22 20:15:30 -04:00
Mark Backman
0be64e0fd9
Update Word Wrangler phone bot README to include deployment info
2025-07-22 20:10:20 -04:00
Filipi Fuchter
7d527c3a6b
Mentioning the new field in the changelog.
2025-07-22 19:32:52 -03:00
Filipi Fuchter
c6f6930c27
Adding support for handle_sigterm
2025-07-22 17:24:07 -03:00
Mark Backman
c33dfe8309
Merge pull request #2233 from pipecat-ai/mb/enable-tracing-flag
...
fix: enable_tracing PipelineParam controls the service class decorators
2025-07-22 08:14:32 -07:00
Mark Backman
769cd1ef06
fix: enable_tracing PipelineParam controls the service class decorators
2025-07-22 11:10:53 -04:00
Mark Backman
6d72f60571
Merge pull request #2234 from pipecat-ai/mb/fix-minimax-pitch
...
fix: MiniMaxHttpTTSService pitch, add base_url arg
2025-07-22 08:10:01 -07:00
Mark Backman
e8d0712ac1
Merge pull request #2238 from pipecat-ai/mb/patch-form-data
...
Fix form-data vulnerability in pipecat-cloud-daily-pstn-server
2025-07-22 08:09:49 -07:00
Mark Backman
88b2c817ac
Fix form-data vulnerability in pipecat-cloud-daily-pstn-server
2025-07-22 10:08:25 -04:00
Mark Backman
f8f6c9918d
Merge pull request #2237 from pipecat-ai/mb/pipecat-cloud-example-pipeline-runner-args
...
Update Pipecat Cloud example to use handle_sigint=False in PipelineRu…
2025-07-22 06:55:56 -07:00
Mark Backman
8ee608bbfe
Update Pipecat Cloud example to use handle_sigint=False in PipelineRunner args
2025-07-22 09:52:57 -04:00
Mark Backman
fad2ba4570
Merge pull request #2204 from yousifa/mcp-FunctionCallParams
2025-07-22 05:01:32 -07:00
Mark Backman
f609f7eb53
fix: MiniMaxHttpTTSService pitch, add base_url arg
2025-07-21 21:16:35 -04:00
Mark Backman
ea09813a2b
Merge pull request #2227 from pipecat-ai/mb/fix-11labs-wordtimestamps
...
fix: Improve ElevenLabsTTSService word/timestamp calcuation accuracy
2025-07-21 16:07:07 -07:00
Mark Backman
53abfc27a7
fix: Improve ElevenLabsTTSService word/timestamp calcuation accuracy
2025-07-21 18:48:38 -04:00
padillamt
1915407ff7
inworld: removed unreferenced is_first_chunk variable
2025-07-21 15:30:48 -07:00
Mark Backman
9c72e96a2c
Merge pull request #2230 from pipecat-ai/mb/livekit-tenacity
...
Livekit: change tenacity supported versions
2025-07-21 15:28:38 -07:00
Mark Backman
f66c67c4ab
Merge pull request #2232 from pipecat-ai/mb/fix-ollama-args
...
Fix: Ollama kwargs error
2025-07-21 15:26:13 -07:00
Mark Backman
b623face03
Add Ollama function calling example 14u
2025-07-21 17:52:16 -04:00
Mark Backman
698d60f3ae
fix: OLLamaLLMService pass base_url as kwarg
2025-07-21 17:51:11 -04:00
Mark Backman
c9717a23a5
Livekit: change tenacity supported versions
2025-07-21 17:30:18 -04:00
padillamt
076a675a75
inworld: Fix...Set sample_rate=None in InworldHttpTTSService to match Cartesia pattern
2025-07-21 13:50:36 -07:00
padillamt
0d5292c4ef
inworld: typo fix in voice name
2025-07-21 13:48:13 -07:00
padillamt
4853d5d55c
inworld: updated InworldHttpTTSService initialization
2025-07-21 13:27:25 -07:00
padillamt
8eda2435a2
inworld: removed explicit references to language since our models currently infer that from the text.
2025-07-21 13:24:10 -07:00
Mark Backman
d981ce6e56
Merge pull request #2226 from pipecat-ai/mb/11labs-speed-docstring
...
Fix 11Labs speed docstring
2025-07-21 13:21:45 -07:00
padillamt
54ff946976
inworld: largely adjustments for docstring compatibility
2025-07-21 12:07:58 -07:00
Mark Backman
1bbd3bd8ab
Fix 11Labs speed docstring
2025-07-21 14:58:12 -04:00
padillamt
aadd088b50
inworld: commented out contents as per Pipecat guidance that this pattern is being retired
2025-07-21 10:52:55 -07:00
padillamt
4250aa6616
inworld: removal of backup copy, no longer needed
2025-07-21 10:11:50 -07:00
Kwindla Hultman Kramer
a20915caa7
Merge pull request #2224 from pipecat-ai/khk/mps
...
Add MPS backend auto-detection to local smart-turn v2
2025-07-21 09:24:51 -07:00
Vanessa Pyne
28cab5a606
Merge pull request #1932 from getchannel/groundingMetadata
...
Add groundingMetadata to Gemini Multimodal Live Service
2025-07-21 10:09:26 -05:00
Vanessa Pyne
cfea56064d
small merge-main nit fixes - gemini_multimodal_live events.py
2025-07-21 09:54:15 -05:00
Vanessa Pyne
8467d87cfc
small main-merge fixes - gemini.py
2025-07-21 09:52:32 -05:00
Kwindla Hultman Kramer
b20d020bea
Add MPS backend auto-detection to local smart-turn v2
2025-07-20 20:18:45 -04:00
padillamt
e3711f96a3
inworld: added detailed comments
2025-07-20 17:06:35 -07:00
Pete
948257c66e
Merge branch 'main' into groundingMetadata
2025-07-20 19:54:30 -04:00
Pete
b54d1fb7fd
Resolve merge conflict and remove duplicate File API initialization
...
- Remove duplicate file_api initialization lines
- Keep grounding metadata tracking functionality
- Maintain clean code structure
2025-07-20 19:15:40 -04:00
Pete
ec361df0d1
Fix final ruff linting issues
...
- Remove duplicate import in __init__.py
- Clean up extra blank lines in gemini.py
- Remove extra blank line in _create_single_response method
2025-07-20 18:58:54 -04:00
Pete
b1a5cddde4
Refactor whitespace and formatting in multiple files
...
- Clean up unnecessary whitespace in `gemini.py`, `events.py`, and `file_api.py`
- Ensure consistent formatting in `26g-gemini-multimodal-live-groundingMetadata.py`
- Improve readability by aligning code and removing trailing spaces
2025-07-20 18:40:12 -04:00
Pete
e165d38277
remove truncated logging from debug
2025-07-20 18:27:21 -04:00
Pete
8ba340a8a5
remove debug logging
2025-07-20 18:21:42 -04:00
Pete
8f74b97591
Refactor _send_user_text method in Gemini multimodal service to streamline event creation for turn completion
2025-07-20 18:08:45 -04:00
Pete
1d69cd1a5e
Remove debug logging from _send_user_text method in Gemini multimodal service
2025-07-20 18:04:57 -04:00
Pete
bd7a0f27cc
Add text input handling to Gemini multimodal service
...
- Updated `RealtimeInput` to include an optional `text` parameter.
- Introduced `TextInputMessage` class for encapsulating text input data.
- Implemented `_send_user_text` method to send text input to the Gemini Live API.
- Enhanced message processing to support text input alongside media chunks.
2025-07-20 17:39:31 -04:00
padillamt
5d8c184d99
inworld: commit of original text file and changes that copy openai's with Inworld TTS as only change
2025-07-18 16:30:03 -07:00
padillamt
1bc442e329
inworld: docstring fix
2025-07-18 15:13:19 -07:00
kompfner
d4e33663b2
Merge pull request #2214 from pipecat-ai/pk/fix-google-llm-context
...
Fixed an issue in `GoogleLLMContext` where it would inject the `syste…
2025-07-18 09:28:28 -04:00
marcus-daily
d7d1b16dad
Removing old import
2025-07-18 12:48:06 +01:00
marcus-daily
0bc2ea13f2
Updating changelog
2025-07-18 12:48:06 +01:00
marcus-daily
b5d1301221
Fix linter warnings
2025-07-18 12:48:06 +01:00
marcus-daily
ed8f30ec71
Add support for running smart-turn-v2 locally
2025-07-18 12:48:06 +01:00
antonyesk601
688031efd6
fix: use undeclared variable _preinitialized. fix: double send of start frame
2025-07-18 08:23:04 +00:00
kompfner
a74a935ca0
Merge pull request #1910 from matejmarinko-soniox/main
...
Add Soniox STT service integration
2025-07-17 09:29:07 -04:00
antonyesk601
0f9e69d3c7
feat: Add Simli Trinity models support to pipecat
2025-07-17 11:55:40 +00:00
padillamt
f3984aec33
inworld: added (empty) requirements for Inworld to be explicit reg dependencies
2025-07-16 13:21:32 -07:00
Paul Kompfner
7cfd56699b
Fixed an issue in GoogleLLMContext where it would inject the system_message as a "user" message into cases where it was not meant to; it was only meant to do that when there were no "regular" (non-function-call) messages in the context, to ensure that inference would run properly.
2025-07-16 16:07:53 -04:00
Matej Marinko
cb984237a7
Fix lint error
2025-07-16 16:54:28 +02:00
Matej Marinko
c969fdddb9
Rename and simplify VAD finalization parameter usage
2025-07-16 09:47:34 +02:00
padillamt
2b76823b01
inworld: added comments to track a few things to confirm
2025-07-15 18:17:30 -07:00
padillamt
ca936bd569
inworld: added Inworld to list of needed credentials
2025-07-15 18:11:50 -07:00
padillamt
c67b779b91
inworld: first commit of Inworld example file for TTS
2025-07-15 17:21:16 -07:00
padillamt
913dba3b74
inworld: class name change
2025-07-15 17:15:57 -07:00
padillamt
384838147a
inworld: removed unnecessary code from stop() and cancel()
2025-07-15 16:56:18 -07:00
padillamt
7861b911c0
inworld: first commit of __init__ and tts.py files
2025-07-15 16:50:50 -07:00
Mark Backman
9931ad2ce1
Merge pull request #2199 from Dev-Khant/add-host-support-in-Mem0
...
Add `host` support in Mem0 Memory
2025-07-15 11:41:15 -07:00
Filipi da Silva Fuchter
fd73feb645
Merge pull request #2201 from pipecat-ai/filipi/stt_issue
...
Only create the EmulateUserStartedSpeakingFrame if we have received a transcription
2025-07-15 13:56:11 -03:00
Yousif Astarabadi
ee78428a2a
formatted
2025-07-14 20:38:28 -07:00
Yousif Astarabadi
ae02249255
mcp_tool_wrapper using FunctionCallParams
2025-07-14 20:31:22 -07:00
Filipi Fuchter
727af2e6fb
Only create the EmulateUserStartedSpeakingFrame if we have received a transcription.
2025-07-14 17:38:03 -03:00
Mark Backman
8fd5576879
Merge pull request #2198 from Allenmylath/patch-24
...
Update app.py
2025-07-14 06:37:42 -07:00
kompfner
1f85dcee7c
Merge pull request #2171 from pipecat-ai/pk/aws-strands-demo
...
Minimal AWS Strands demo
2025-07-14 09:32:16 -04:00
Dev Khant
138890bc5c
Add support in Mem0 Memory
2025-07-14 18:08:25 +05:30
Filipi da Silva Fuchter
a094efc9e6
Merge pull request #2196 from pipecat-ai/mb/lmnt-model
...
LmntTTSService: update the default model to blizzard
2025-07-14 09:15:17 -03:00
allenmylath
1f9e2fdecc
Update app.py
...
misleading comment. no endpoints.py
2025-07-14 14:02:35 +05:30
Mark Backman
4a2b4660bc
LmntTTSService: update the default model to blizzard
2025-07-13 10:54:43 -07:00
Mark Backman
b3ac90015a
Merge pull request #2195 from Trinary-Projects/transformers_ver_patch
...
Update transformers dep. to >=4.48.0 for Ultravox
2025-07-11 23:31:47 -07:00
Jaideep
2fe06f0a4e
Update pyproject.toml
2025-07-12 11:34:45 +05:30
Mark Backman
1836a7484e
Merge pull request #2193 from pipecat-ai/mb/changelog-0.0.76
...
Prepare changelog for 0.0.76 release
2025-07-11 16:15:34 -07:00
Mark Backman
25a5c5aaab
Prepare changelog for 0.0.76 release
2025-07-11 16:08:08 -07:00
mattie ruth backman
24694e2558
Changelog entry
2025-07-11 14:30:12 -07:00
mattie ruth backman
2325edd9ba
Add a text entry box to the simple-chatbot example
2025-07-11 14:30:12 -07:00
mattie ruth backman
fad5713ade
Fix append-to-context function call
2025-07-11 14:30:12 -07:00
Paul Kompfner
fe8573322f
AWS Strands demos
2025-07-11 16:42:27 -04:00
Mark Backman
06c1255abe
fix: use a different aggregation timeout for emulated user speech ( #2185 )
...
* fix: use a different aggregation timeout for emulated user speech
* Add SpeechControlParamsFrame
* Update test_context_aggregator tests
2025-07-11 16:33:44 -04:00
Mark Backman
f108a67635
Merge pull request #2189 from pipecat-ai/mb/numpy-version-bump
...
Update numpy, transformers to support newer versions
2025-07-11 12:02:02 -07:00
Mark Backman
bf580d061d
Update numpy, transformers to support newer versions
2025-07-11 11:58:31 -07:00
Filipi da Silva Fuchter
b005bd7b98
Merge pull request #2184 from pipecat-ai/filipi/twilio_issue
...
Fixing an issue where Pipecat was not receiving the user's audio
2025-07-11 15:32:28 -03:00
Filipi Fuchter
75f8baab33
Mentioning the fixes in the changelog.
2025-07-11 11:56:16 -03:00
Matej Marinko
5c3fb73cef
Rename example
2025-07-11 16:07:24 +02:00
Filipi Fuchter
5c3f4180b9
Refactored VAD analyzer to process multiple audio frames in a single iteration if needed.
2025-07-11 10:59:32 -03:00
Mark Backman
6cd6e7ceed
Merge pull request #2186 from pipecat-ai/mb/fix-pre-commit-config
...
Update .pre-commit-config.yaml to use pyproject.toml linting rules
2025-07-11 06:34:01 -07:00
Filipi Fuchter
1a146c2a64
Not serializing a JSON in case we have no audio.
2025-07-11 10:15:09 -03:00
Filipi Fuchter
eaeb9e6efa
Not creating InputAudioRawFrame in case we don't have bytes. Fixed for Pilvo, Exotel and Telnyx.
2025-07-11 09:51:38 -03:00
Matej Marinko
2e84c91748
Remove outdated parameter
2025-07-11 08:52:39 +02:00
Matej Marinko
650d45c1f4
Use single sample rate parameter
2025-07-11 08:27:06 +02:00
Filipi Fuchter
f4f65024ef
Refactoring the test client to use the new version of the Pipecat Client SDK.
2025-07-10 21:57:25 -03:00
Filipi Fuchter
1200aa4fb8
Not creating InputAudioRawFrame in case we don't have bytes.
2025-07-10 21:56:34 -03:00
Filipi da Silva Fuchter
6762363685
Merge pull request #2183 from pipecat-ai/filipi/parallel_pipeline_issue
...
Fixed an issue in ParallelPipeline that caused errors when attempting to drain the queues.
2025-07-10 21:51:04 -03:00
Filipi Fuchter
b2ead325c4
Fixed an issue in ParallelPipeline that caused errors when attempting to drain the queues.
2025-07-10 21:50:35 -03:00
Mark Backman
4e24b915cc
Update .pre-commit-config.yaml to use pyproject.toml linting rules
2025-07-10 16:10:27 -07:00
kompfner
b610ee26ba
Merge pull request #2181 from pipecat-ai/pk/fix-aws-nova-sonic-pipeline-freeze
...
Fix a pipeline freeze when using AWS Nova Sonic. The freeze occurs if…
2025-07-10 16:30:55 -04:00
Paul Kompfner
2b867f1613
Fix a pipeline freeze when using AWS Nova Sonic. The freeze occurs if the user starts speaking before we've finished sending the "trigger " audio (AWS Nova Sonic can only start speaking in response to a user utterance, so we have a simulated user utterance to "trigger" the bot speaking without the user having actually spoken first).
2025-07-10 15:57:05 -04:00
Mark Backman
7b8fe565c7
Merge pull request #2182 from pipecat-ai/mb/run-example-usage
...
run.py: Add example usage to the module docstring
2025-07-10 12:48:29 -07:00
Mark Backman
a246862910
run.py: Add example usage to the module docstring
2025-07-10 11:41:49 -07:00
Filipi da Silva Fuchter
106809f3fd
Merge pull request #2166 from carolin-tavus/remove-persona-microphone-check
...
feat: Remove persona microphone check
2025-07-10 15:28:35 -03:00
carolin-tavus
f0d8499f7e
feat: avoid checking microphone enabled
2025-07-10 09:40:27 +00:00
Mark Backman
332ca3d55e
Merge pull request #2177 from pipecat-ai/mb/fix-ruff-improvements
...
Make fix-ruff.sh more flexible, use pyproject rules
2025-07-09 12:33:05 -07:00
Mark Backman
a48f5d5796
Make fix-ruff.sh more flexible, use pyproject rules
2025-07-09 11:48:17 -07:00
Mark Backman
f04f047428
Merge pull request #2176 from pipecat-ai/mb/pre-commit-config
...
Add docstring checking to .pre-commit-config.yaml
2025-07-09 11:47:25 -07:00
Mark Backman
4e61fd33ea
Add docstring checking to .pre-commit-config.yaml
2025-07-09 11:18:40 -07:00
Matej Marinko
61ac77be72
Update docs
2025-07-09 11:59:45 +02:00
Matej Marinko
c093eb5b63
Move config to main file
2025-07-09 10:20:37 +02:00
Matej Marinko
98e24131bd
Send raw result
2025-07-09 09:59:04 +02:00
Matej Marinko
7becce9e8c
Add transcript tracing
2025-07-09 09:37:58 +02:00
Matej Marinko
3cdaeb719a
Update examples to new format
2025-07-09 09:28:43 +02:00
Matej Marinko
8daaea5969
Minor code cleanup
2025-07-09 09:03:02 +02:00
matejmarinko-soniox
dc47516e14
Update src/pipecat/services/soniox/config.py
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-09 08:04:59 +02:00
Mark Backman
0fcc4f822f
Merge pull request #2173 from captaincaius/fix-nextjs-webhook-example-null-check
...
fix nextjs webhook example num_endpoints null check
2025-07-08 14:10:16 -07:00
Captain Caius
c0ed061ff5
fix nextjs webhook example num_endpoints null check
2025-07-08 13:40:26 -07:00
Mark Backman
d98b6b418d
Release prep for 0.0.75 ( #2169 )
...
* Update CHANGELOG for 0.0.75 release
* Add RTVI changes to CHANGELOG
* Update CHANGELOG, add deprecation directives to rtvi.py
---------
Co-authored-by: mattie ruth backman <mattieruth@gmail.com >
2025-07-08 15:39:44 -04:00
Mark Backman
deea29b5e8
Merge pull request #2170 from pipecat-ai/mb/update-packages-0.0.75
...
Package updates to run the release evals
2025-07-08 12:02:22 -07:00
Mark Backman
0bdbc83ed9
Package updates to run the release evals
2025-07-08 11:39:49 -07:00
Mark Backman
6c591f0990
Merge pull request #2167 from pipecat-ai/mb/fix-riva-watchdog
...
RivaSTTService: reset the watchdog in an async function
2025-07-08 11:29:44 -07:00
Mark Backman
b55b9c257b
RivaSTTService: remove reset_watchdog, which is handled in the WatchdogQueue already
2025-07-08 11:19:47 -07:00
Mark Backman
5156c21d14
Merge pull request #2168 from pipecat-ai/mb/fix-neuophonic-tts
...
Fix: NeuphonicTTSService to use latest websocket API
2025-07-08 11:17:58 -07:00
Mark Backman
a9d824753b
Fix: NeuphonicTTSService to use latest websocket API
2025-07-08 11:08:08 -07:00
Filipi da Silva Fuchter
3c6a208101
Merge pull request #2148 from pipecat-ai/filipi/aws_bedrock
...
Refactoring AWSBedrockLLMService to work async
2025-07-08 12:14:28 -03:00
Mark Backman
b1032a1ca4
Merge pull request #2151 from pipecat-ai/mb/ollama-kwargs
...
OLLamaLLMService: Pass kwargs
2025-07-08 07:21:09 -07:00
Mark Backman
931f34fccd
OLLamaLLMService: Pass kwargs
2025-07-08 07:17:18 -07:00
Mark Backman
f2509adec1
Merge pull request #2162 from pipecat-ai/mb/tts-service-aggregate-sentences
...
TTS services: Add aggregate_sentences arg
2025-07-08 07:14:58 -07:00
Filipi Fuchter
285b82eb65
Mentioning the AWSBedrockLLMService and AWSPollyTTSService refactors in the changelog.
2025-07-08 07:30:30 -03:00
Filipi Fuchter
74da197304
Refactored AWSBedrockLLMService and AWSPollyTTSService to work asynchronously using aioboto3 instead of the boto3 library.
2025-07-08 07:28:23 -03:00
Matej Marinko
0f727248d2
Merge branch 'main' of github.com:pipecat-ai/pipecat
2025-07-08 08:20:10 +02:00
mattie ruth backman
a6de16f92f
Bump all client dependencies to use client-js/react/transports 1.0.0
2025-07-07 15:56:08 -07:00
mattie ruth backman
fc09854d7f
fix cam light always on
2025-07-07 15:56:08 -07:00
mattie ruth backman
2959029151
PR Review fixes
2025-07-07 15:56:08 -07:00
mattie ruth backman
e590441b7b
Add support for about info in ready messages and add deprecation comments to deprecated types
2025-07-07 15:56:08 -07:00
mattie ruth backman
dc41ec7cb1
Updated all examples with clients to use the new PipecatClient
2025-07-07 15:56:08 -07:00
mattie ruth backman
43049c865c
Add support for new RTVI client message protocol: handling and responding
2025-07-07 15:56:08 -07:00
mattie ruth backman
c4a9fc7f88
video-transport typescript formatting
2025-07-07 15:56:08 -07:00
mattie ruth backman
faf4026cf4
Add device controls to the simple chatbot example
2025-07-07 15:56:08 -07:00
Mark Backman
f53f45a6cd
TTS services: Add aggregate_sentences arg
2025-07-07 15:38:31 -07:00
Mark Backman
e04e876f44
Merge pull request #2156 from shahrukhx01/add-additional-whisper-models
...
WhisperSTTService: Add additional whisper model variants
2025-07-07 12:53:06 -07:00
shahrukhx01
a84e7e30da
WhisperSTTService: Add additional whisper model variants
2025-07-07 21:43:48 +02:00
Mark Backman
6eed6ff779
Merge pull request #2147 from pipecat-ai/mb/user-idle-long-function-call
...
UserIdleProcessor: Account for function calls in progress
2025-07-04 14:11:16 -07:00
Mark Backman
1375211610
UserIdleProcessor: Account for function calls in progress
2025-07-04 14:05:05 -07:00
Mark Backman
4e9369a702
Merge pull request #2149 from pipecat-ai/mb/twilio-hang-up-handling
2025-07-04 12:44:17 -07:00
Mark Backman
f9e8748a96
TwilioFrameSerializer: Handle user hanging up before the serializer
2025-07-04 09:42:16 -07:00
Filipi da Silva Fuchter
20d6bf267a
Merge pull request #2146 from pipecat-ai/remove_gemini_duplicated_code
...
Removing duplicated code inside Gemini.
2025-07-04 11:59:10 -03:00
Filipi Fuchter
b573f9dab2
Removing duplicated code inside Gemini.
2025-07-04 10:57:53 -03:00
Pete
7ed4fe50d4
Update gemini.py
...
-FunctionCallFromLLM
-Delete duplicate Gemini imports
2025-07-03 19:39:44 -04:00
Pete
6f66ec1727
Update gemini.py
...
tab indentation fix
2025-07-03 18:55:21 -04:00
Pete
c7e758fc36
Merge branch 'main' into groundingMetadata
2025-07-03 18:47:47 -04:00
Pete
14c22234bb
Fix parameter name consistency in parse_server_event function
...
- Change function body to use 'str' parameter consistently
- Matches pattern used in OpenAI Realtime Beta service
- Fixes bug where parameter was named 'str' but body used 'message_str'
- Maintains consistency with existing codebase patterns
2025-07-03 18:02:24 -04:00
Pete
d565e9ae53
Update grounding metadata example with final refinements
...
- Reorganize imports and transport_params structure
- Remove copyright header for consistency
- Enhance grounding metadata logging with better formatting
- Remove unnecessary PipelineParams configuration
- Update message content formatting
Completes incorporation of draft PR #2121 changes
2025-07-03 17:53:55 -04:00
Pete
4951c97eab
Clean up verbose logging in grounding metadata implementation
...
- Remove debug logging from grounding metadata event handlers
- Simplify logging in _process_grounding_metadata method
- Clean up example file logging for better readability
- Remove verbose event parsing comments
Based on suggestions from draft PR #2121
2025-07-03 17:49:27 -04:00
Pete
9b38f3e2fa
Delete examples/foundational/26f-gemini-multimodal-live-files-api.py
2025-07-03 17:15:18 -04:00
Mark Backman
dbc76389d8
Merge pull request #2140 from pipecat-ai/mb/fix-26-imports
...
Fix: missing import in 26f foundational example
2025-07-03 14:12:54 -07:00
Aleix Conchillo Flaqué
c27f838444
Merge pull request #2124 from pipecat-ai/aleix/frame-processor-no-push-queue
...
FrameProcessor: remove unnecessary push task
2025-07-03 14:03:05 -07:00
Aleix Conchillo Flaqué
ce84485e26
Merge pull request #2142 from pipecat-ai/aleix/publish-workflow-message
...
github: update publish message to make it clear
2025-07-03 14:02:51 -07:00
Mark Backman
6cf254e2f9
Fix: missing import in 26f foundational example, update twilio transport_params to FastAPIWebsocketParams
2025-07-03 13:58:18 -07:00
Aleix Conchillo Flaqué
02b63c28a5
FrameProcessor: remove unnecessary push task
...
When we call `FrameProcessor.push_frame()` we end up calling
`FrameProcessor.queue_frame()` on the next or previous processor which already
uses the input queue and guarantees frame ordering. So, there's no need to have
a two queues next to each other.
2025-07-03 13:57:32 -07:00
Aleix Conchillo Flaqué
57c6ce7ffa
github: update publish message to make it clear
2025-07-03 13:55:02 -07:00
Aleix Conchillo Flaqué
2f3272ea2f
Merge pull request #2135 from pipecat-ai/aleix/pipecat-0.0.74
...
update CHANGELOG for 0.0.74
2025-07-03 13:46:00 -07:00
Aleix Conchillo Flaqué
f5c2d57e4b
update CHANGELOG for 0.0.74
2025-07-03 13:44:21 -07:00
Aleix Conchillo Flaqué
baa878272d
scripts(evals): added 07a-interruptible-speechmatics.py
2025-07-03 13:44:21 -07:00
Aleix Conchillo Flaqué
093285868e
scripts(evals): update timeout back to 90 seconds
2025-07-03 13:37:17 -07:00
Filipi da Silva Fuchter
6c9d058ec2
Merge pull request #2139 from pipecat-ai/filipi/changelog_improvements
...
Mentioning the SpeechmaticsSTTService in the changelog.
2025-07-03 17:36:55 -03:00
Filipi Fuchter
5df7be6892
Mentioning the SpeechmaticsSTTService in the changelog.
2025-07-03 17:35:30 -03:00
Mark Backman
2deca816ae
Merge pull request #2137 from pipecat-ai/mb/fish-audio-normalize
...
FishAudioTTSService: arg cleanup, add new InputParam and arg
2025-07-03 13:29:14 -07:00
Mark Backman
b8d2fceced
Merge pull request #2138 from pipecat-ai/mb/fix-google-llm-import-order
...
GoogleLLMService: Linting fixes
2025-07-03 13:26:32 -07:00
Sam Sykes
7596d71460
Speechmatics STT + multi-speaker conversations ( #2036 )
...
* initial config
* skeleton
* Added a README (to be added to).
* Payloads coming from the ASR.
* doc update
* handle the partials and finals
* enable diarization in the example
* support sending messages to pipecat pipeline
* requirements fix in README
* updated example (with amusement)
* updated example to match master
* updated docs
* support for diarization tags
* logic fix for wrapper
* Use an internal SpeechFrame for speaker_id (not user_id).
* only include speaker tags on finalised transcript (as this may skew end of utterance detection)
* updated docs
* correction to docs and updated example
* updated requirement
* Fix for using default EU server.
* Updates from PR comments.
* Refactor based on comments in the original PR.
Primary focus on documentation, naming conventions and how `user_id` is used.
* Check for SMX installed when importing.
* Variable name change
* Comment correction.
* Support for Esporanto and Uyghur
* Impoved language support
* function name change
* Locale fix
* intercept
* interim changes
* pass the pipeline task to the module for adding events to the top of the pipeline
* logging for the pipeline
* Reduce timeout for content aggregator.
* staged update
* testing with Azure
* Updated context (Azure was dropping punctuation) and using better ElevenLabs model.
* Updated to RT 0.3.0 and use OpenAI (not Azure).
* Missing OpenAI import; parameter name change for output locale validation.
* Revert to `0.2.0` of RT SDK.
* fix for assignment of `output_locale_code`.
* update Speechmatics library to 0.3.1
* new transcription example
* updated asyncio task handling
* Updated doc strings
* enable OpenTelemetry logging
* removed import from stt for __init__
* updated examples and default values
* updated examples
* prevent lock up when closing the STT connection
2025-07-03 17:25:13 -03:00
Mark Backman
096067b097
GoogleLLMService: Linting fixes
2025-07-03 13:23:13 -07:00
Mark Backman
ec09505f6b
FishAudioTTSService: Add normalize as InputParam, model_id as arg
2025-07-03 13:14:15 -07:00
Mark Backman
251ea756c8
FishTTSService: deprecate model, add reference_id
2025-07-03 12:56:24 -07:00
Aleix Conchillo Flaqué
8f6544efe2
Merge pull request #2133 from pipecat-ai/vp-changelog-fileapi
...
docs: add changelog line for gemini files api
2025-07-03 11:13:02 -07:00
otaqwawi
6045a8ad8c
Add option to change the base URL for Google Generative AI. ( #2113 )
...
* Add option to change the base URL for Google Generative AI.
This would be useful to support private instance or gateway of the API
* fix: add proper type hints for http_options in Google LLM service
2025-07-03 11:12:35 -07:00
Aleix Conchillo Flaqué
b184d62634
Merge pull request #2134 from pipecat-ai/aleix/evals-cancel-expired-tasks
...
cancel expire evals tasks
2025-07-03 10:07:27 -07:00
Aleix Conchillo Flaqué
1a8d512abb
scripts(evals): make sure we cancel pending tasks after timeout
2025-07-03 10:01:42 -07:00
vipyne
a62be8ea32
docs: add changelog line for gemini files api
2025-07-03 11:44:34 -05:00
Mark Backman
c230d94ff0
Merge pull request #2125 from pipecat-ai/mb/deprecate-handle-function-call-start
...
Add docs deprecation for handle_function_call_start
2025-07-03 12:27:17 -04:00
Aleix Conchillo Flaqué
e7b02773f5
Merge pull request #2131 from pipecat-ai/aleix/dtmf-aggregator-dangling-tasks
...
DtmfAggregator: cancel interruption task to avoid a dangling task
2025-07-03 08:34:50 -07:00
Aleix Conchillo Flaqué
ed83248a6b
Merge pull request #2130 from pipecat-ai/aleix/pipeline-task-cancel-queue
...
PipelineTask: cancel idle queue before cancelling task
2025-07-03 08:32:31 -07:00
Aleix Conchillo Flaqué
af8b4901d4
DtmfAggregator: cancel interruption task to avoid a dangling task
2025-07-03 08:18:48 -07:00
Aleix Conchillo Flaqué
64c8230960
PipelineTask: cancel idle queue before cancelling task
2025-07-03 08:18:21 -07:00
Aleix Conchillo Flaqué
bf664534cc
PipelineTask: cancel idle queue before cancelling task
2025-07-03 08:15:31 -07:00
Filipi da Silva Fuchter
274a04e535
Merge pull request #2129 from carolin-tavus/carolin-tavus/add-persona-validation
...
Add persona validation (check that microphone is enabled)
2025-07-03 11:49:42 -03:00
carolin-tavus
cb81f3d50e
format
2025-07-03 14:38:20 +00:00
carolin-tavus
30a3b24287
Add persona validation (check that microphone is enabled)
2025-07-03 14:04:04 +00:00
Filipi da Silva Fuchter
8aacf71956
Merge pull request #1623 from phamtrung0633/victor/azure-tts-interruption-fix
...
Azure TTS fixed by clearing the audio queue before synthesizing the next text
2025-07-03 10:51:54 -03:00
Victor
72d503d3a3
Azure TTS fixed by clearing the audio queue before synthesizing the next text
2025-07-03 10:48:26 -03:00
Aleix Conchillo Flaqué
453a904290
Merge pull request #2123 from pipecat-ai/aleix/dev-requirements-25-07-02
...
update dev-requirements (dependabot)
2025-07-02 23:00:40 -07:00
Mark Backman
368bff4fb4
Merge pull request #2101 from pipecat-ai/mb/fix-websocket-example-dir
...
fix: remove javascript directory from the websocket README
2025-07-02 22:55:47 -04:00
Mark Backman
4ae045d704
Add docs deprecation for handle_function_call_start
2025-07-02 19:53:48 -07:00
Mark Backman
8c71939425
Merge pull request #2122 from pipecat-ai/mb/deprecation-docstrings
...
Add deprecation directives, add indexing, only autodoc members
2025-07-02 21:31:02 -04:00
Aleix Conchillo Flaqué
a437c2d365
update examples (dependabot)
2025-07-02 16:33:24 -07:00
Aleix Conchillo Flaqué
a1784e3237
update dev-requirements (dependabot)
2025-07-02 16:09:13 -07:00
Mark Backman
abee0f853c
Add deprecation directives, add indexing, only autodoc members
2025-07-02 15:44:02 -07:00
Aleix Conchillo Flaqué
e9d358ed17
Merge pull request #2119 from pipecat-ai/aleix/llm-messages-append-update-run-llm
...
add run_llm to LLMMessagesAppendFrame and LLMMessagesUpdateFrame
2025-07-02 13:53:36 -07:00
Aleix Conchillo Flaqué
c5d54d06bb
add run_llm to LLMMessagesAppendFrame and LLMMessagesUpdateFrame
2025-07-02 13:53:13 -07:00
Filipi da Silva Fuchter
c16eed7ca2
Merge pull request #2091 from pipecat-ai/filipi/sample_rate
...
Creating a new stream resampler which avoids clicks.
2025-07-02 16:22:46 -03:00
Filipi Fuchter
76388a10b5
Deprecating the create_default_resampler and adding the changelog.
2025-07-02 16:20:58 -03:00
Filipi Fuchter
38bcc033a2
Improving the docs about when to use: SOXRAudioResampler x SOXRStreamAudioResampler
2025-07-02 16:20:48 -03:00
Filipi Fuchter
5af563cd91
Configured the services to use create_stream_resampler instead of create_default_resampler
2025-07-02 16:20:34 -03:00
Filipi Fuchter
3de271161c
Fixing the ruff script to also try to fix docstrings.
2025-07-02 16:19:57 -03:00
Filipi Fuchter
c19f9bc43a
Creating a new stream resampler which avoids clicks.
2025-07-02 16:19:47 -03:00
Mark Backman
ef85d245ed
Merge pull request #2120 from haayhappen/patch-1
...
Update README.md
2025-07-02 15:18:28 -04:00
Fynn Merlevede
25749bd4c0
Update README.md
...
fix: use correct protocol in READme
2025-07-02 20:57:38 +02:00
Mark Backman
e19c5464fe
Merge pull request #2114 from pipecat-ai/mb/bump-google-genai-version
...
Upgrade google-genai version to 1.24.0
2025-07-02 14:25:29 -04:00
Mark Backman
5c2ea3b804
Upgrade google-genai version to 1.24.0
2025-07-02 11:18:37 -07:00
Aleix Conchillo Flaqué
c27348d470
Merge pull request #2118 from pipecat-ai/aleix/daily-python-0.19.4
...
pyproject: update daily-python to 0.19.4
2025-07-02 10:38:54 -07:00
Aleix Conchillo Flaqué
de5f9c9217
pyproject: update daily-python to 0.19.4
2025-07-02 09:51:36 -07:00
Aleix Conchillo Flaqué
f9086ee3a2
Merge pull request #2110 from pipecat-ai/aleix/daily-add-virtual-speaker-support
...
DailyTransport: allow receiving audio in a single track
2025-07-02 09:50:02 -07:00
Vanessa Pyne
43298a9026
Merge pull request #2077 from yousifa/mcp-http-gemini-support
...
Mcp http gemini support
2025-07-02 11:47:25 -05:00
Vanessa Pyne
d80e228c6f
Merge branch 'main' into mcp-http-gemini-support
2025-07-02 11:47:18 -05:00
Mark Backman
2902362886
Merge pull request #2115 from pipecat-ai/mb/docstring-cleanup
...
Docstring cleanup, fix missing examples imports
2025-07-02 11:35:11 -04:00
Mark Backman
1cd303ad7f
Merge pull request #2090 from pipecat-ai/mb/silero-np-error
...
Remove redundant import and global in SileroOnnxModel
2025-07-02 11:28:11 -04:00
Mark Backman
f590a476e7
Gemini Live fixes, plus additional docstrings
2025-07-02 08:27:23 -07:00
Mark Backman
e71cb3ba68
Docstring cleanup, fix missing examples imports
2025-07-02 08:27:23 -07:00
Filipi da Silva Fuchter
510a9af2e5
Merge pull request #2116 from pipecat-ai/filipi/fix_ios_chatbot_demo
...
Fixed an issue to disconnect the iOS chatbot demo.
2025-07-02 12:13:51 -03:00
Filipi Fuchter
5328f84df4
Fixed an issue to disconnect the iOS chatbot demo.
2025-07-02 12:06:15 -03:00
Yousif Astarabadi
18817fd81b
added docstring in public GeminiFileAPI module
2025-07-02 00:09:48 -07:00
Yousif Astarabadi
4bcc536fd2
added arg description in docstring for gemini live init
2025-07-02 00:03:27 -07:00
Yousif Astarabadi
1ab2ddd317
fix lint error
2025-07-01 23:55:34 -07:00
Yousif
09aa168840
Merge branch 'pipecat-ai:main' into mcp-http-gemini-support
2025-07-01 23:54:42 -07:00
Vanessa Pyne
05753fb207
Merge pull request #1786 from getchannel/main
...
Add File API to GeminiMultimodalLive
2025-07-01 20:29:12 -05:00
Pete
715e3f8543
Merge branch 'pipecat-ai:main' into main
2025-07-01 20:42:28 -04:00
Pete
9c9d4b35a4
remove audio_transcriber from gemini.py
...
unecessary import removed.
2025-07-01 20:36:54 -04:00
getchannel
2ee935f784
Update gemini.py
2025-07-01 20:31:58 -04:00
Aleix Conchillo Flaqué
58aedc88a4
DailyTransport: allow receiving audio in a single track
2025-07-01 17:29:10 -07:00
getchannel
0e60385871
add FileAPI to gemini.py
2025-07-01 20:14:31 -04:00
Mark Backman
a4188f7986
Merge pull request #2103 from pipecat-ai/mb/add-user-id-to-transcript
...
Add user_id to transcription frames
2025-07-01 18:28:12 -04:00
vipyne
c7cbfe7a4f
remove grounding metadata commits
2025-07-01 17:21:38 -05:00
vipyne
f1c9f5040b
Update examples/foundational/26f-gemini-multimodal-live-files-api.py
2025-07-01 16:27:25 -05:00
vipyne
79e51051c7
New lint rules and remove unused example file
2025-07-01 16:27:25 -05:00
Pete
a63d0da528
Update gemini.py
2025-07-01 16:27:25 -05:00
getchannel
4fd8df208f
Add groundingMetadata events.py
2025-07-01 16:27:25 -05:00
getchannel
44d3bd30fa
Add groundingMetadata and logging gemini.py
2025-07-01 16:27:25 -05:00
getchannel
6e6e932370
Create 26g-gemini-multimodal-live-groundingMetadata.py
2025-07-01 16:27:25 -05:00
getchannel
baccf50417
update correct upload endpoint file_api.py
2025-07-01 16:27:25 -05:00
getchannel
7b1071b30d
Create 26f-gemini-multimodal-live-files-api.py
...
This is an example to test usage of the Files API integration. Specifically with the Gemini Multimodal Live Service.
2025-07-01 16:27:25 -05:00
getchannel
bd7ca94196
Update gemini.py
2025-07-01 16:27:25 -05:00
getchannel
1ec1aa76e9
Rename file_api to file_api.py
...
added proper .py to file name.
2025-07-01 16:27:25 -05:00
getchannel
77c369c3c7
add file_api __init__.py
2025-07-01 16:27:25 -05:00
getchannel
9171d4b040
add FileData class events.py
2025-07-01 16:27:25 -05:00
getchannel
e02b95fca5
Create file_api
2025-07-01 16:27:25 -05:00
getchannel
d45a07b5e5
add FileAPI to gemini.py
2025-07-01 16:27:25 -05:00
Mark Backman
0cdcfcee8d
Remove redundant import and global in SileroOnnxModel
2025-07-01 13:29:47 -07:00
Mark Backman
324546b4e7
Merge pull request #2098 from StrongMind/aws-session-token
...
Add support for session token in AWS Nova Sonic service
2025-07-01 16:25:38 -04:00
Filipi da Silva Fuchter
c8ee67a636
Merge pull request #2085 from pipecat-ai/filipi/freeze-test-python-3.10
...
Fixing pipeline freeze when using Python 3.10
2025-07-01 17:17:38 -03:00
Filipi Fuchter
b87c57c951
Adding missing docstring to the watchdog event
2025-07-01 17:12:18 -03:00
Filipi Fuchter
721f662bbe
Making cancel sentinel classes private
2025-07-01 17:09:05 -03:00
Filipi Fuchter
fccd48bfff
Fixing pipeline freeze when using Python 3.10
2025-07-01 17:05:18 -03:00
Filipi Fuchter
5310d903ec
Adding the requirements and needed variables for the freeze-test example.
2025-07-01 17:04:27 -03:00
Mark Backman
8cbce555e4
Add user_id to stt_traced decorator
2025-07-01 13:01:48 -07:00
Mark Backman
f6112713e8
Add user_id to TranscriptionFrame and InterimTranscriptionFrame pushed by STTServices
2025-07-01 12:59:20 -07:00
Mark Backman
cc637f4dea
Clean up docstrings after DirectFunction merge ( #2105 )
...
* Add missing import for FunctionCallParams
* Update docstrings in direct_function
* Docstring fixes for run.py
* Remove unused imports in llm_service
* Add missing docstrings to llm_service
* Remove FunctionCallParams import
* Wording improvements
* Type checking for FunctionCallParams
2025-07-01 15:22:30 -04:00
kompfner
7f76a14c54
Merge pull request #2104 from pipecat-ai/pk/changelog-fix
...
Whoops—fix mistake in CHANGELOG (`FlowsFunctionSchema` -> `FunctionSc…
2025-07-01 15:06:14 -04:00
Yousif Astarabadi
58675f4d5a
renamed clean schema to alternate schema
2025-07-01 11:50:12 -07:00
Paul Kompfner
d50e6db312
Whoops—fix mistake in CHANGELOG (FlowsFunctionSchema -> FunctionSchema)
2025-07-01 14:24:27 -04:00
kompfner
de74284a8e
Merge pull request #2051 from pipecat-ai/pk/direct-functions
...
Implement "direct functions", which allow you to bypass specifying a …
2025-07-01 14:19:33 -04:00
Aleix Conchillo Flaqué
4c9a295b28
Merge pull request #2095 from pipecat-ai/aleix/examples-smallwebrtc-sdp-munging
...
examples: add --esp32 for SDP munging if host name specified
2025-07-01 09:07:42 -07:00
Mark Backman
0968f36d3e
fix: remove javascript directory from the websocket README
2025-07-01 09:51:02 -04:00
Mark Backman
fd570b0377
Update the remaining docstrings, update pre-commit hook, add docstring formatting CI, update CONTRIBUTING with formatting guidance ( #2089 )
2025-07-01 00:37:04 -04:00
Paul Shippy
68ea5ee570
Add to change log
2025-06-30 17:39:42 -07:00
Paul Shippy
f891140a74
Update sample to take in session token
2025-06-30 17:35:50 -07:00
Paul Shippy
5ed2d7ac2b
Add session token option for AWS
2025-06-30 17:31:31 -07:00
Pete
a297e4208e
Merge branch 'main' into groundingMetadata
2025-06-30 19:48:55 -04:00
Aleix Conchillo Flaqué
b713527da0
examples: add --esp32 for SDP munging if host name specified
2025-06-30 13:27:52 -07:00
Kwindla Hultman Kramer
224d2cedc8
Merge pull request #2088 from pipecat-ai/khk/gemini-thinking-default
...
Turn off thinking for Gemini models by default
2025-06-30 10:32:54 -07:00
Kwindla Hultman Kramer
55cfea776f
Merge branch 'main' into khk/gemini-thinking-default
2025-06-30 10:32:42 -07:00
Paul Kompfner
d7a2078e0b
Added CHANGELOG entry describing "direct" functions
2025-06-30 10:59:36 -04:00
Paul Kompfner
a3e540eb32
Rename examples/foundational/14s-function-calling-direct.py to examples/foundational/14t-function-calling-direct.py, since a new "14s" example was added
2025-06-30 10:44:55 -04:00
Paul Kompfner
e01c20be84
Remove unused import and tweak a comment
2025-06-30 10:36:47 -04:00
Paul Kompfner
ce3ca418c2
Unit tests for "direct" functions
2025-06-30 10:36:47 -04:00
Paul Kompfner
15b9a5faf6
Implement "direct functions", which allow you to bypass specifying a function configuration (as a FunctionSchema or in a provider-specific format) and use the Python function directly. Metadata is gathered automatically from the function signature and docstring.
2025-06-30 10:36:42 -04:00
Kwindla Hultman Kramer
3afa30894f
Turn off thinking for Gemini models by default
2025-06-28 12:23:35 -07:00
Mark Backman
0ecfa827e6
Improve docstrings for services and processors ( #2087 )
2025-06-28 13:39:45 -04:00
Aleix Conchillo Flaqué
e1b0db75eb
Merge pull request #2086 from pipecat-ai/aleix/watchdog-coroutine-helper
...
add watchdog coroutine helper
2025-06-27 11:10:10 -07:00
Aleix Conchillo Flaqué
b0c773189f
AWSNovaSonicLLMService: fix error with watchdog_coroutine()
2025-06-27 11:09:40 -07:00
Aleix Conchillo Flaqué
3064326834
utils.asyncio: added watchdog_coroutine()
2025-06-27 11:09:40 -07:00
Mark Backman
c67e50fe34
Merge pull request #2084 from pipecat-ai/mb/update-evals-nova-sonic
...
Add 40-aws-nova-sonic to release evals list
2025-06-27 09:47:59 -04:00
Mark Backman
9d45e3eca1
Merge pull request #2079 from pipecat-ai/mb/fix-42-incorrect-import
...
fix: example 42 incorrect import
2025-06-27 09:47:47 -04:00
Mark Backman
43a24d15f6
Add 40-aws-nova-sonic to release evals list
2025-06-27 08:34:39 -04:00
Yousif Astarabadi
cafbda1668
remove openai from mcp run http example
2025-06-26 20:21:07 -07:00
Yousif Astarabadi
86c26fd64c
moved needs_mcp_clean_schema to LLMService
2025-06-26 20:09:12 -07:00
Yousif Astarabadi
0c20668008
fixed linter errors
2025-06-26 20:08:26 -07:00
Yousif Astarabadi
92df8dc43c
fix formatting
2025-06-26 20:08:23 -07:00
Yousif Astarabadi
9d5f5844b8
clean mcp schema for gemini models, update http mcp example to use gemini
2025-06-26 20:07:54 -07:00
Mark Backman
2cf31884d0
fix: example 42 incorrect import
2025-06-26 21:52:14 -04:00
Aleix Conchillo Flaqué
19354c6f2d
Merge pull request #2078 from pipecat-ai/aleix/hotfix-0.0.73
...
just a quick hotfix for 0.0.73
2025-06-26 17:31:40 -07:00
Aleix Conchillo Flaqué
0b2079ad41
update CHANGELOG for 0.0.73
2025-06-26 17:02:12 -07:00
Aleix Conchillo Flaqué
5f18c3af70
OpenAIRealtimeLLMContext: fix circular dependency
2025-06-26 17:01:45 -07:00
Aleix Conchillo Flaqué
0a40285d43
update FrameProcessor.watchdog_timers_enabled references
2025-06-26 16:26:12 -07:00
Vanessa Pyne
5b1c328541
Merge pull request #2075 from pipecat-ai/vp-mcp-lint
...
mcp_service: lint
2025-06-26 15:25:39 -05:00
vipyne
37929533af
mcp_service: lint
2025-06-26 15:00:20 -05:00
Vanessa Pyne
3b92113680
Merge pull request #2030 from yousifa/mcp-streaming-http
...
MCPClient streamable_http transport support
2025-06-26 14:57:31 -05:00
Yousif
46b52cb9bb
Merge branch 'main' into mcp-streaming-http
2025-06-26 12:30:43 -07:00
Mark Backman
f0bcc9d9ba
Add MCPClient docstrings. Removed google specific cleanup, changed example to openai
2025-06-26 12:29:45 -07:00
Yousif Astarabadi
1cac028bfe
example using http transport for mcp client
2025-06-26 12:16:35 -07:00
Yousif Astarabadi
4956886819
updated error message with StreamableHttpParameters
2025-06-26 12:16:28 -07:00
Yousif Astarabadi
c720cfc7c7
updated streamablehttp to use StreamableHttpParameters type
2025-06-26 12:16:26 -07:00
Yousif Astarabadi
8fcef5628f
added streamablehttp support, bumped mcp version, added additional headers and streamable_http params to MCPClient
2025-06-26 12:16:19 -07:00
Aleix Conchillo Flaqué
c4a72802f0
Merge pull request #2074 from pipecat-ai/aleix/pipecat-0.0.72
...
update CHANGELOG for 0.0.72
2025-06-26 12:10:14 -07:00
Aleix Conchillo Flaqué
917394803c
update CHANGELOG for 0.0.72
2025-06-26 11:42:52 -07:00
Mark Backman
01040ddcdd
Merge pull request #2071 from pipecat-ai/mb/services-docstrings-update
...
Add/update docstrings to LLM services
2025-06-26 14:42:32 -04:00
Aleix Conchillo Flaqué
7947497f7e
Merge pull request #2073 from a6kme/patch-1
...
Start HeartBeat when all processors have processed StartFrame
2025-06-26 11:34:46 -07:00
Aleix Conchillo Flaqué
539ca5856f
Merge pull request #2072 from pipecat-ai/aleix/utils-watchdog-cleanup
...
utils(asyncio): simplify watchdog helpers
2025-06-26 11:29:21 -07:00
Abhishek
89c801f82c
Start HeartBeat when all processors have processed StartFrame
...
Some of the processors like STTService and TTSService don't push StartFrame ahead in the pipeline, unless they have connected with their service providers. This delays StartFrame in downstream processors.
If we receive HeartBeat frame before StartFrame, we will get AttributeError `'Processor' object has no attribute '_FrameProcessor__input_queue'`.
Idea is to start HeartBeats after StartFrame has been processed by all the Processors in the pipeline.
2025-06-26 23:28:37 +05:30
Aleix Conchillo Flaqué
3de4f22d34
utils(asyncio): simplify watchdog helpers
2025-06-26 09:40:42 -07:00
Mark Backman
0e4d2be98c
Update AzureRealtimeBetaLLMService docstrings
2025-06-26 12:12:00 -04:00
Mark Backman
d8ce108ccd
Update OpenAIRealtimeBetaLLMService docstrings
2025-06-26 12:06:47 -04:00
Mark Backman
d123cd4b2b
Update GeminiMultimodalLiveLLMService docstrings
2025-06-26 11:47:30 -04:00
Aleix Conchillo Flaqué
4d34aa7cd6
Merge pull request #2069 from pipecat-ai/aleix/utils-asyncio-package
...
move things to new utils.asyncio package
2025-06-26 08:26:47 -07:00
Aleix Conchillo Flaqué
b860e94582
move things to new utils.asyncio package
2025-06-26 08:24:25 -07:00
Aleix Conchillo Flaqué
9d653e3788
Merge pull request #2068 from pipecat-ai/aleix/task-manager-dont-warn-reset-watchdog
...
TaskManager: don't warn on reset_watchdog()
2025-06-26 08:23:51 -07:00
Mark Backman
9e518cf2ba
Update AWSNovaSonicLLMService docstrings
2025-06-26 11:21:18 -04:00
Mark Backman
2856372ad6
Update TogetherLLMService docstrings
2025-06-26 11:01:35 -04:00
Mark Backman
efbf574613
Update SambaNovaLLMService docstrings
2025-06-26 11:00:40 -04:00
Mark Backman
c018eb2f0e
Update QwenLLMService docstrings
2025-06-26 10:57:42 -04:00
Mark Backman
d7bfe54b7c
Update PerplexityLLMService docstrings
2025-06-26 10:56:48 -04:00
Mark Backman
137282b7a9
Update OpenRouterLLMService docstrings
2025-06-26 10:53:42 -04:00
Mark Backman
769f8c8f34
Update OpenPipeLLMService docstrings
2025-06-26 10:53:05 -04:00
Mark Backman
8b8a37ae7c
Update OLLamaLLMService docstrings
2025-06-26 10:48:19 -04:00
Mark Backman
56e2b006f5
Update NimLLMService docstrings
2025-06-26 10:47:26 -04:00
Mark Backman
79cca05e43
Update GroqLLMService docstrings
2025-06-26 10:46:07 -04:00
Mark Backman
166c8e8e82
Update GrokLLMService docstrings
2025-06-26 10:39:46 -04:00
Mark Backman
9b64d2c325
Update GoogleLLMService docstrings
2025-06-26 10:37:22 -04:00
Mark Backman
03e3e9fae9
Update FireworksLLMService docstrings
2025-06-26 10:28:35 -04:00
Mark Backman
65234ae41a
Update DeepSeekLLMService docstrings
2025-06-26 10:27:36 -04:00
Mark Backman
3828df8cf9
Update CerebrasLLMService docstrings
2025-06-26 10:26:42 -04:00
Mark Backman
9cbe85bf99
Update AzureLLMService docstrings
2025-06-26 10:25:17 -04:00
Mark Backman
7bf805b829
Update AWSBedrock docstrings
2025-06-26 10:23:40 -04:00
Mark Backman
990ee436e1
Add Anthropic docstrings
2025-06-26 07:42:22 -04:00
Mark Backman
1cd42066a6
Merge pull request #2067 from pipecat-ai/mb/update-docstrings-for-ref-docs
...
Update base service class docstrings for better docs auto-generation
2025-06-26 07:07:59 -04:00
Filipi da Silva Fuchter
ba43558049
Merge pull request #2066 from pipecat-ai/filipi/sentry_freeze_test
...
Enabling watchdog and sentry into the freeze-test
2025-06-26 08:01:51 -03:00
Mark Backman
951c8d34da
Add special case handling for STT, TTS, LLM
2025-06-26 00:15:09 -04:00
Mark Backman
ac61139243
Add OpenAI LLM docstrings
2025-06-26 00:06:57 -04:00
Mark Backman
5b8f1fe3e3
Add Cartesia TTS docstrings
2025-06-25 23:50:55 -04:00
Mark Backman
0aa197e4a4
Add docstrings to DeepgramSTTService
2025-06-25 23:36:04 -04:00
Mark Backman
f04e058c96
Programmatically set the copyright date in docs
2025-06-25 23:29:37 -04:00
Mark Backman
6ef2ae12b7
Mock mcp imports
2025-06-25 23:29:37 -04:00
Mark Backman
fe6bbdaefe
Skip dataclass attributes to remove duplicate entries
2025-06-25 23:29:37 -04:00
Mark Backman
cc66fddca9
Modify docs auto-gen rules to remove duplicate parameters listing
2025-06-25 23:29:37 -04:00
Mark Backman
04b70ddf13
Add MCPClient docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
bb3bb8d9c6
Improve WebsocketService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
f80f62c7d1
Add VisionService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
2007ae4317
Add ImageGenService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
a1e5a1eff4
Add AIService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
691999b402
Add AIServices docstring
2025-06-25 22:38:11 -04:00
Mark Backman
33f3a4cea1
Add TTSService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
ab1d2dbe6a
Add STTService docstrings
2025-06-25 22:27:07 -04:00
Mark Backman
f622b281d0
Make call_start_function a private function in llm_service
2025-06-25 22:23:13 -04:00
Mark Backman
fb12bf9b4c
Update LLMService docstrings
2025-06-25 22:23:13 -04:00
Aleix Conchillo Flaqué
27af50087e
TaskManager: don't warn on reset_watchdog()
2025-06-25 17:29:45 -07:00
Filipi Fuchter
03502bed52
Enabling watchdog and sentry into the freeze-test
2025-06-25 20:53:30 -03:00
Aleix Conchillo Flaqué
27c7e2d150
Merge pull request #2063 from pipecat-ai/aleix/watchdog-timers-remove-start-watchdog
...
no need to call start_watchdog() only reset_watchdog()
2025-06-25 16:47:44 -07:00
Aleix Conchillo Flaqué
e81d387971
TaskManager: rely on add_done_callback()
2025-06-25 16:44:20 -07:00
Aleix Conchillo Flaqué
ef1ade3a71
allow enabling watchdog timers per frame processor or task
2025-06-25 16:36:19 -07:00
Aleix Conchillo Flaqué
4f032f5b96
update keepalive times depending on watchdog timers
2025-06-25 15:55:16 -07:00
Aleix Conchillo Flaqué
72cb967780
update CHANGELOG with watchdog timers updates
2025-06-25 15:55:16 -07:00
Aleix Conchillo Flaqué
357934a644
watchdog timers are disabled by default use enable_watchdog_timers
2025-06-25 15:55:16 -07:00
Aleix Conchillo Flaqué
327973657f
TaskManager: remove wathcdog timer when main task is done
2025-06-25 11:26:21 -07:00
Aleix Conchillo Flaqué
d2730e6741
GooglSTTService: cleanup request queues
2025-06-25 11:12:32 -07:00
Aleix Conchillo Flaqué
eb5ecab104
no need to call start_watchdog() only reset_watchdog()
2025-06-25 11:12:32 -07:00
Mark Backman
202055a9b8
Merge pull request #2065 from pipecat-ai/mb/fix-configdict-openai-realtime
...
fix: add missing ConfigDict import in openai_realtime_beta/events
2025-06-25 11:40:35 -04:00
Mark Backman
7034a9e3fd
fix: add missing ConfigDict import in openai_realtime_beta/events
2025-06-25 11:32:29 -04:00
Pete
1cf0b35ac1
Merge branch 'main' into groundingMetadata
2025-06-24 22:00:16 -04:00
Filipi da Silva Fuchter
8f7ed12262
Merge pull request #2061 from pipecat-ai/not_force_bot_speaking
...
Not forcing the bot resume speaking in case we receive no transcription.
2025-06-24 20:57:46 -03:00
Aleix Conchillo Flaqué
96b5320ef9
Merge pull request #2055 from pipecat-ai/aleix/fix-sentry-async
...
SentryMetrics: send metrics to sentry asynchronously
2025-06-24 16:32:01 -07:00
Filipi Fuchter
d5cd742237
Not forcing the bot resume speaking in case we receive no transcription.
2025-06-24 20:12:49 -03:00
Aleix Conchillo Flaqué
1f1da8942d
SentryMetrics: send metrics to sentry asynchronously
2025-06-24 15:56:08 -07:00
Mark Backman
7953e1e9d9
Merge pull request #2054 from pipecat-ai/mb/telnyx-catch-hangup-error
...
fix: Telnyx, catch error when user has hung up the call first
2025-06-24 18:04:19 -04:00
Mark Backman
d6f7ecc0a3
fix: Telnyx, catch error when user has hung up the call first
2025-06-24 17:28:00 -04:00
Mark Backman
3eed316049
Merge pull request #2020 from snova-jorgep/snova-jorgep/sambanova-integration
...
Add Sambanova LLM and STT integration
2025-06-24 17:04:24 -04:00
Jorge Piedrahita Ortiz
851cf079c3
Merge branch 'main' into snova-jorgep/sambanova-integration
2025-06-24 16:00:28 -05:00
jhpiedrahitao
dfb0da32a9
fmt
2025-06-24 15:59:40 -05:00
Aleix Conchillo Flaqué
f450da57e5
Merge pull request #2056 from pipecat-ai/khk/fix-22d
...
Update google libraries used in google audio-in examples
2025-06-24 13:47:59 -07:00
Aleix Conchillo Flaqué
2ec6b6c995
Merge pull request #2060 from pipecat-ai/aleix/watchdog-timeout-secs
...
FrameProcessor: use watchdog_timeout_secs
2025-06-24 13:36:39 -07:00
Aleix Conchillo Flaqué
53b769a8ec
FrameProcessor: use watchdog_timeout_secs
2025-06-24 13:33:47 -07:00
Filipi da Silva Fuchter
4f9adc173a
Merge pull request #2004 from pipecat-ai/filipi/pipeline_freeze
...
Pipeline freeze improvements
2025-06-24 17:20:38 -03:00
Filipi Fuchter
dc4a58877e
Fixing merge conflict.
2025-06-24 17:12:40 -03:00
Filipi Fuchter
a6243a6fe7
Merge branch 'main' into filipi/pipeline_freeze
...
# Conflicts:
# CHANGELOG.md
# src/pipecat/pipeline/task.py
# src/pipecat/processors/frame_processor.py
# src/pipecat/transports/base_input.py
2025-06-24 17:11:21 -03:00
Aleix Conchillo Flaqué
cf5f1b541a
Merge pull request #2049 from pipecat-ai/aleix/introduce-watchdog-timers
...
introduce watchdog timers
2025-06-24 13:00:57 -07:00
Filipi Fuchter
70e6c48233
Mentioning the fixes in the changelog.
2025-06-24 16:56:46 -03:00
Filipi Fuchter
51f7d14d0a
Merge branch 'main' into filipi/pipeline_freeze
2025-06-24 16:44:07 -03:00
Filipi Fuchter
4853d5d1fc
Handling the case where user stopped speaking but no new aggregation received.
2025-06-24 16:42:10 -03:00
Aleix Conchillo Flaqué
076a8938f0
add start_watchdog/reset_watchdog to tasks
2025-06-24 11:56:20 -07:00
Aleix Conchillo Flaqué
5a3457ba33
introduce task watchdog timers
2025-06-24 11:56:20 -07:00
Aleix Conchillo Flaqué
2fc224384d
Merge pull request #2059 from pipecat-ai/aleix/heartbeatframe-control-frames
...
HeartbeatFrames are now control frames
2025-06-24 11:55:18 -07:00
Aleix Conchillo Flaqué
a4e6ea5a3f
HeartbeatFrames are now control frames
2025-06-24 11:27:39 -07:00
Vanessa Pyne
d3c211f293
Merge pull request #2058 from pipecat-ai/vp-mcp-sse-up
...
follow up to #1887 - proper MCP SSE support
2025-06-24 13:06:01 -05:00
vipyne
20047c369e
mcp: update examples to use SseServerParameter
2025-06-24 12:58:39 -05:00
vipyne
dd1ff237a8
lint mcp_service
2025-06-24 12:58:33 -05:00
Vanessa Pyne
39d80d0b0e
Merge pull request #1887 from ezun-kim/feat/mcp-sse-params
...
Fix SSE server connection handling for MCP client
2025-06-24 12:58:05 -05:00
Kwindla Hultman Kramer
7a48316534
update google libraries used in google audio-in examples
2025-06-24 09:52:04 -07:00
Filipi da Silva Fuchter
031a93ac46
Merge pull request #2053 from pipecat-ai/sentry_dsn_environment_variable
...
Creating an environment variable for sentry dsn.
2025-06-24 12:10:20 -03:00
Mark Backman
ea6cc1aa95
Merge pull request #2052 from pipecat-ai/mb/11labs-keepalive
...
Send context_id when available in ElevenLabsTTSService keepalive message
2025-06-24 11:07:07 -04:00
Filipi Fuchter
365260ec44
Creating an environment variable for sentry dsn.
2025-06-24 11:57:14 -03:00
Mark Backman
2eb244c80a
Send context_id when available in ElevenLabsTTSService keepalive message
2025-06-24 10:52:49 -04:00
Mark Backman
aee3011d61
Merge pull request #2037 from pipecat-ai/mb/11labs-close-context
...
Fix: Correctly close the context for ElevenLabsTTSService
2025-06-24 07:44:22 -04:00
Aleix Conchillo Flaqué
40496e7b0f
Merge pull request #2034 from pipecat-ai/khk/pause-frames
...
small fix for processor pause/resume frames
2025-06-23 17:08:41 -07:00
Kwindla Hultman Kramer
6b24f89fa7
small fix for processor pause/resume frames
2025-06-23 16:44:32 -07:00
Filipi Fuchter
2097800042
Allowing to clear the turn analyser
2025-06-23 18:50:37 -03:00
Filipi Fuchter
6739318e68
Forcing user stopped speaking due to timeout to receive audio frame!
2025-06-23 18:50:02 -03:00
Filipi Fuchter
d0bd563d42
Logging the BaseException inside the cancel_task.
2025-06-23 18:48:44 -03:00
Filipi Fuchter
74280829fc
Fixed an issue with the FastAPIWebsocketClient to disconnect in case the websocket is already closed.
2025-06-23 18:48:03 -03:00
Filipi Fuchter
3fde8880f2
Fixed a couple of places inside the FrameProcessor where we should not raise the exceptions.
2025-06-23 18:47:54 -03:00
Filipi Fuchter
98d39e0d38
Logging the last 10 frames received in case idle timeout is detected.
2025-06-23 18:47:17 -03:00
Filipi Fuchter
c9cebb5ffe
Created an example for testing the bot and try to create freezing conditions.
2025-06-23 18:46:58 -03:00
Mark Backman
f52ac6e99c
Merge pull request #1998 from pipecat-ai/mb/fix-38-smart-turn-fal
2025-06-23 17:15:29 -04:00
Mark Backman
787a6b1c6a
Merge pull request #2038 from pipecat-ai/mb/openai-realtime-model-update
...
Update OpenAIRealtimeBetaLLMService model to gpt-4o-realtime-preview-…
2025-06-23 16:30:31 -04:00
Mark Backman
d00a91074e
Update OpenAIRealtimeBetaLLMService model to gpt-4o-realtime-preview-2025-06-03
2025-06-23 16:26:42 -04:00
Mark Backman
4e11497a38
Merge pull request #2048 from thibaudbrg/patch-1
...
Fix missing video_in_enabled in vision bot.py for Moondream template
2025-06-23 16:11:50 -04:00
Tibo
0443d5202a
Fix missing video_in_enabled in vision bot.py for Moondream template
...
The parameter video_in_enabled=True was missing in DailyParams, which prevented image capture
from working. Without this parameter, UserImageRequestFrame would be sent but no actual image data would be captured from participants.
This fix enables the "Let me take a look" functionality to work as
intended by allowing the transport to capture video frames for vision processing with Moondream.
2025-06-23 21:17:41 +02:00
Mark Backman
633c25cb13
Merge pull request #2039 from pipecat-ai/mb/remove-lang-validation
...
OpenAIRealtimeBetaLLMService accepts language for all InputAudioTrans…
2025-06-23 14:41:09 -04:00
jhpiedrahitao
d07f45132f
update changelog
2025-06-23 12:54:00 -05:00
jhpiedrahitao
a51280afa6
add 13 and 14 type foundational examples for sambanova iontegration
2025-06-23 12:53:32 -05:00
Jorge Piedrahita Ortiz
be14eb2460
Merge branch 'pipecat-ai:main' into snova-jorgep/sambanova-integration
2025-06-23 12:23:00 -05:00
jhpiedrahitao
e26dbffcbe
update sambanova init imports
2025-06-23 12:22:08 -05:00
Mark Backman
59992fd24a
Merge pull request #2044 from pipecat-ai/mb/daily-rest-docstring
...
Add missing arg docstring in DailyRESTHelper
2025-06-23 11:24:44 -04:00
Mark Backman
455362ccaf
Merge pull request #2022 from pipecat-ai/mb/turn-tracking-end-cancel-frame
...
TurnTrackingObserver ends turn upon seeing EndFrame, CancelFrame
2025-06-23 11:24:27 -04:00
Mark Backman
16c0e2460b
TurnTrackingObserver ends turn upon seeing EndFrame, CancelFrame
2025-06-23 11:08:51 -04:00
Matej Marinko
c54084b7a4
Fix deadlock on STT service stop
2025-06-23 14:18:29 +02:00
Mark Backman
92246f7125
Add missing arg docstring in DailyRESTHelper
2025-06-22 13:44:59 -04:00
Pete
e3fe040017
Update gemini.py
2025-06-21 14:43:15 -04:00
Pete
ae5e3e2dc4
Merge branch 'main' into groundingMetadata
2025-06-21 12:16:32 -04:00
Pete
77378d2779
Merge branch 'pipecat-ai:main' into groundingMetadata
2025-06-21 12:08:49 -04:00
Pete
4106f0dabe
Merge branch 'pipecat-ai:main' into main
2025-06-21 10:54:25 -04:00
Mark Backman
7737335ec9
OpenAIRealtimeBetaLLMService accepts language for all InputAudioTranscription models
2025-06-21 10:08:46 -04:00
Mark Backman
5cc9b7e0d1
Fix: Correctly close the context for ElevenLabsTTSService
2025-06-20 15:47:03 -04:00
Mark Backman
8c6a441064
Merge pull request #2035 from smokyabdulrahman/feat/aws-polly-lexicon-names-support
...
Support AWS Polly Lexicon Names parameter
2025-06-20 10:03:27 -04:00
Alrahma
fddc058ce2
add CHANGELOG entry
2025-06-20 14:15:24 +01:00
Alrahma
89750086c5
Support AWS Polly Lexicon Names parameter
...
Documentation reference
[AWS Managing
Lexicons](https://docs.aws.amazon.com/polly/latest/dg/managing-lexicons.html )
2025-06-20 09:47:46 +01:00
Aleix Conchillo Flaqué
e69406c7e2
Merge pull request #2032 from pipecat-ai/aleix/aws-nova-sonic-function-calls
...
AWSNovaSonicLLMService: fix function calling
2025-06-19 14:42:47 -07:00
Aleix Conchillo Flaqué
878ae42d84
AWSNovaSonicLLMService: fix function calling
2025-06-19 14:26:34 -07:00
Aleix Conchillo Flaqué
d34ebfc126
Merge pull request #2027 from pipecat-ai/aleix/task-on-idle-timeout-repeated
...
PipelineTask: fix repeated on_idle_timeout
2025-06-19 14:13:10 -07:00
Aleix Conchillo Flaqué
028f7b2d65
PipelineTask: fix repeated on_idle_timeout
2025-06-19 09:14:10 -07:00
Mark Backman
0aa3ec50f2
Merge pull request #2023 from pipecat-ai/mb/allow-interruptions-true
...
allow_interruptions=True
2025-06-19 10:24:53 -04:00
Mark Backman
9146def21b
Update examples to use default allow_interruptions, fixes to align examples
2025-06-19 10:07:32 -04:00
Aleix Conchillo Flaqué
ebb23a5a8c
Merge pull request #2024 from pipecat-ai/aleix/audio-buffer-processor-sync-issues
...
AudioBufferProcessor: treat all streams as intermittent
2025-06-18 18:26:38 -07:00
Aleix Conchillo Flaqué
b118082984
AudioBufferProcessor: treat all streams as intermittent
...
This fixes an issue with STTMuteFilter that prevents user audio to be pushed
downstream.
2025-06-18 18:23:31 -07:00
Mark Backman
b5c0ac5f25
allow_interruptions=True
2025-06-18 20:33:40 -04:00
Filipi da Silva Fuchter
dc78e874af
Merge pull request #2021 from pipecat-ai/gladia_stt_improvements_changelog
...
Adding the GladiaSTTService improvements in the changelog.
2025-06-18 18:25:36 -03:00
Filipi Fuchter
c30bde0a2b
Adding the GladiaSTTService improvements in the changelog.
2025-06-18 16:19:58 -03:00
Filipi da Silva Fuchter
171597fbe9
Merge pull request #1952 from jqueguiner/feat/gladia-auto-reconnect
...
feat: Enhance GladiaSTTService with reconnection and audio buffer management features
2025-06-18 16:14:58 -03:00
jhpiedrahitao
fae2d272d5
fmt
2025-06-18 10:53:06 -05:00
jhpiedrahitao
03a067d3e6
add sambanova llm and stt
2025-06-18 10:50:42 -05:00
Mark Backman
f5d028f3b3
Merge pull request #2017 from pipecat-ai/mb/fix-11labs-voice-settings
...
fix: ElevenLabsTTSService voice settings not being sent
2025-06-18 09:56:46 -04:00
Mark Backman
e5b7dbba90
fix: ElevenLabsTTSService voice settings not being sent
2025-06-18 09:49:17 -04:00
Filipi da Silva Fuchter
7ffba1e0b3
Merge pull request #1950 from pipecat-ai/filipi/tavus_custom_tracks
...
Sending audio to Tavus using custom tracks
2025-06-18 07:57:19 -03:00
Filipi Fuchter
72cdbf0b78
Mentioning the Tavus improvements in the changelog.
2025-06-18 07:46:04 -03:00
Filipi Fuchter
8b4a86f629
Ignoring the audio level when creating the custom tracks.
2025-06-18 07:45:54 -03:00
Filipi Fuchter
fa15e64fc9
Test script that mimics the behavior expected to be supported by Tavus.
2025-06-18 07:45:38 -03:00
Filipi Fuchter
564f064c71
Refactoring TavusVideoService to send audio using WebRTC audio tracks instead of app-messages.
2025-06-18 07:44:51 -03:00
Filipi Fuchter
4062c7afa0
Refactoring TavusTransport to send audio using WebRTC audio tracks instead of app-messages.
2025-06-18 07:44:38 -03:00
Jean-Louis Queguiner
8071c4ba1c
Merge branch 'main' into feat/gladia-auto-reconnect
2025-06-18 08:57:21 +02:00
jqueguiner
3d0ffbc832
🐛 (stt.py): handle websocket connection closure gracefully and log warnings
...
♻️ (stt.py): refactor reconnection logic into a separate method for clarity
✨ (stt.py): implement exponential backoff for reconnection attempts to improve reliability
2025-06-18 08:52:43 +02:00
Filipi da Silva Fuchter
1cac94bf97
Merge pull request #1925 from pipecat-ai/filipi/websocket_transport_example_twilio
...
Websocket client web app to test Twilio.
2025-06-17 16:24:18 -03:00
Mark Backman
c94c51d44f
Fix: 38-smart-turn-fal
2025-06-17 15:10:52 -04:00
Mark Backman
96958933af
Merge pull request #2016 from pipecat-ai/aleix/example-params-allow-async-objects
...
examples: create transport params async
2025-06-17 15:08:37 -04:00
Filipi Fuchter
2300c2632e
Refactoring how we are organizing the twilio chatbot examples and improving the readmes
2025-06-17 16:08:35 -03:00
Filipi Fuchter
cbd0529674
Merge branch 'main' into filipi/websocket_transport_example_twilio
2025-06-17 15:54:31 -03:00
Filipi da Silva Fuchter
5614e35ac4
Merge pull request #2015 from pipecat-ai/bumping_pipecat_required_versions
...
Bumping pipecat-ai-krisp required version
2025-06-17 15:42:20 -03:00
Aleix Conchillo Flaqué
c11172caba
examples: create transport params async
2025-06-17 11:37:42 -07:00
Filipi Fuchter
11b6e409bb
Bumping pipecat-ai-krisp required version
2025-06-17 15:22:31 -03:00
Aleix Conchillo Flaqué
3dca95aa3c
Merge pull request #2014 from pipecat-ai/aleix/daily-python-0.19.3
...
update daily-python to 0.19.3
2025-06-17 10:10:23 -07:00
Aleix Conchillo Flaqué
7ddc706434
update daily-python to 0.19.3
2025-06-17 09:30:28 -07:00
Aleix Conchillo Flaqué
20eebb08e9
update CHANGELOG with AWSTranscribeSTTService Polish support
2025-06-16 10:34:56 -07:00
Aleix Conchillo Flaqué
4abf41b85a
Merge pull request #2011 from wuodar/wuodar/polish-lang-aws-transcribe
...
Support polish language in Amazon Transcribe
2025-06-16 10:33:55 -07:00
Aleix Conchillo Flaqué
e426f7ee7c
Merge pull request #2012 from pipecat-ai/aleix/frame-pause-resume-frames
...
FrameProcessor: handle new FrameProcessorPauseFrame/FrameProcessorResumeFrame
2025-06-16 10:32:38 -07:00
Aleix Conchillo Flaqué
14dc6a7984
FrameProcessor: handle new FrameProcessorPauseFrame/FrameProcessorResumeFrame
2025-06-16 10:31:33 -07:00
Mark Backman
e0a24a3f07
Merge pull request #2006 from pipecat-ai/mb/expose-function-calls-in-progress
...
Expose has_function_calls_in_progress property
2025-06-16 12:49:07 -04:00
Mark Backman
d1bee22d73
Expose has_function_calls_in_progress property
2025-06-16 12:45:16 -04:00
Jon Taylor
d73f7908f2
Merge pull request #2008 from pipecat-ai/khk/groq-audio
...
fix groq wav file header parsing
2025-06-16 14:09:09 +01:00
Aleix Conchillo Flaqué
a4ea0d2b82
dev-requirements: update pyright 1.1.400 and ruff 0.11.13
2025-06-15 21:05:03 -07:00
Kacper Włodarczyk
e2c15169b8
feat: support polish language in Amazon Transcribe
2025-06-15 21:44:06 +02:00
Kwindla Hultman Kramer
fe16ed3c73
added changelog entry
2025-06-15 10:49:40 -07:00
Filipi Fuchter
80ce097f90
Using relative URL for the websocket.
2025-06-15 10:49:25 -03:00
Filipi Fuchter
eceaf8a46b
Making the path to the web client relative
2025-06-14 21:07:15 -03:00
Kwindla Hultman Kramer
1e3fa4a9c7
fix groq wav file header parsing
2025-06-14 17:41:44 -04:00
Pete
2ed1ed6821
Merge branch 'pipecat-ai:main' into main
2025-06-14 16:23:27 -04:00
Filipi da Silva Fuchter
dc640a7591
Merge pull request #2001 from pipecat-ai/filipi/google_stt_reconnection_issue
...
Fixed an issue with `GoogleSTTService` where it was constantly reconnecting
2025-06-13 08:29:18 -03:00
Filipi Fuchter
1f072d182c
Merge branch 'main' into filipi/google_stt_reconnection_issue
...
# Conflicts:
# CHANGELOG.md
2025-06-13 08:26:00 -03:00
Mark Backman
1d64e04ed5
Merge pull request #2002 from pipecat-ai/mb/google-fix-ttfb
...
Fix: GoogleLLMService TTFB
2025-06-12 12:10:01 -04:00
Mark Backman
22f4f0b79e
Update 14e example name
2025-06-12 11:45:59 -04:00
Mark Backman
69c63293fb
fix: GoogleLLMService TTFB value
2025-06-12 11:43:27 -04:00
Filipi Fuchter
c1db13ceeb
Fixed an issue with GoogleSTTService where it was constantly reconnecting before starting to receive audio from the user.
2025-06-12 12:07:33 -03:00
Matej Marinko
6d3a38842d
Merge branch 'main' of github.com:pipecat-ai/pipecat
2025-06-12 11:32:38 +02:00
Filipi Fuchter
70eadee0aa
Bumping the @pipecat-ai/websocket-transport dependency.
2025-06-11 18:30:16 -03:00
Pete
7360f79413
Merge branch 'pipecat-ai:main' into main
2025-06-11 13:16:19 -04:00
Aleix Conchillo Flaqué
228afe01ed
Merge pull request #1993 from pipecat-ai/aleix/pipecat-0.0.71
...
update CHANGELOG for 0.0.71
2025-06-10 14:42:09 -07:00
Aleix Conchillo Flaqué
61a5154e49
update CHANGELOG for 0.0.71
2025-06-10 14:34:30 -07:00
Sunah Suh
d3df75aaa0
Add additional_span_attributes param to PipelineTask for extra otel… ( #1992 )
2025-06-10 17:32:24 -04:00
Aleix Conchillo Flaqué
c59180dd6e
udpate CHANGELOG
2025-06-10 14:23:02 -07:00
Mark Backman
e4c2310632
Merge pull request #1990 from pipecat-ai/mb/more-cartesia-stt
...
Add Cartesia STT docs link to README, fix set_model error
2025-06-10 17:19:11 -04:00
Aleix Conchillo Flaqué
e1735a2da1
Merge pull request #1991 from pipecat-ai/aleix/pipecat-0.0.70
...
update CHANGELOG for 0.0.70
2025-06-10 14:08:52 -07:00
Aleix Conchillo Flaqué
c101c9c8e1
update CHANGELOG for 0.0.70
2025-06-10 13:37:28 -07:00
Aleix Conchillo Flaqué
96dc162de5
Merge pull request #1988 from pipecat-ai/aleix/update-examples-22b
...
examples(22b): remove unnecessary parallel pipeline branch
2025-06-10 12:58:37 -07:00
Mark Backman
257dbe3104
Fix model param error
2025-06-10 15:14:47 -04:00
Mark Backman
cd98657e3c
Add Cartesia STT docs link to README
2025-06-10 15:09:13 -04:00
Aleix Conchillo Flaqué
03eb22fe0a
examples(22b): remove unnecessary parallel pipeline branch
2025-06-10 09:05:58 -07:00
Pete
8d55e13750
remove audio_transcriber from gemini.py
...
unecessary import removed.
2025-06-10 11:22:16 -04:00
Pete
737e8e79c9
Merge branch 'main' into groundingMetadata
2025-06-10 11:12:35 -04:00
Pete
4d977fede0
Merge branch 'main' into main
2025-06-10 11:07:59 -04:00
Filipi Fuchter
0073a868d4
Websocket client web app to test Twilio.
2025-06-10 11:34:02 -03:00
Mark Backman
0bb61d72ab
Merge pull request #1984 from pipecat-ai/mb/cartesia-stt-cleanup
...
CartesiaSTTService cleanup
2025-06-10 10:30:18 -04:00
Mark Backman
f758508a82
Merge pull request #1978 from pipecat-ai/mb/rime-languages
...
Add languages to RimeHttpTTSService, extend lang support to German an…
2025-06-10 10:27:15 -04:00
Mark Backman
69d0218d7e
Add languages to RimeHttpTTSService, extend lang support to German and French
2025-06-10 10:20:41 -04:00
Aleix Conchillo Flaqué
eb5e5ab1df
update CHANGELOG
2025-06-09 20:22:39 -07:00
Aleix Conchillo Flaqué
093697906c
Merge pull request #1954 from WebinarGeek/wg/gladia-informal-translations
...
Gladia informal translations
2025-06-09 20:21:40 -07:00
Aleix Conchillo Flaqué
efe96b7ed1
Merge pull request #1986 from pipecat-ai/aleix/daily-python0.19.2
...
pyproject: update daily-python to 0.19.2
2025-06-09 19:46:14 -07:00
Aleix Conchillo Flaqué
7ecdd41ab9
pyproject: update daily-python to 0.19.2
2025-06-09 17:29:07 -07:00
Mark Backman
aec70d61e9
CartesiaSTTService cleanup
2025-06-09 15:20:57 -04:00
Mark Backman
2efac13344
Merge pull request #1983 from pipecat-ai/mb/exotel-resampling
...
Resample audio in ExotelFrameSerializer
2025-06-09 14:41:08 -04:00
Mark Backman
15aeb11c36
Resample audio in ExotelFrameSerializer
2025-06-09 14:02:25 -04:00
Mark Backman
e705f4d984
Merge pull request #1972 from Vaibhav159/vl_add_exotel_serializer
...
adding exotel serializer
2025-06-09 13:54:26 -04:00
Shrey Gupta
96fa62fdfe
[Add] Support for Cartesia AI STT ( #1982 )
2025-06-09 14:51:01 -03:00
Mark Backman
845c70797a
Merge pull request #1975 from pipecat-ai/mb/11labs-flush-context-reset
...
fix: ElevenLabsTTSService reset context when flushing audio
2025-06-09 13:21:25 -04:00
kompfner
16048956c3
Merge pull request #1956 from pipecat-ai/pk/make-add-observer-sync
...
Make `PipelineTask.add_observer()` synchronous. This allows callers t…
2025-06-09 13:19:34 -04:00
Mark Backman
cf2f4b5902
fix: ElevenLabsTTSService reset context when flushing audio
2025-06-09 13:17:55 -04:00
marcus-daily
db46f33f34
Update to Android transports 0.3.7
2025-06-09 17:09:59 +01:00
Aleix Conchillo Flaqué
25d1515daf
Merge pull request #1979 from pipecat-ai/aleix/buffer-tts-before-playback
...
buffer audio from TTS service before pushing frames
2025-06-09 08:43:55 -07:00
Paul Kompfner
a3469cd59f
Add CHANGELOG entry describing PipelineTask.add_observer() being made synchronous
2025-06-09 11:37:30 -04:00
Paul Kompfner
513ce26200
Add unit test exercising synchronous usage of PipelineTask.add_observer() right after initializing the PipelineTask (before anything else is done with it)
2025-06-09 11:30:24 -04:00
Paul Kompfner
1cd96f94ff
Make PipelineTask.add_observer() synchronous. This allows callers to call it before run()ning the PipelineTask first. Without this change, if they tried to do that, they would get an error because the TaskManager's event loop hadn't been set yet.
2025-06-09 11:30:24 -04:00
Aleix Conchillo Flaqué
901dd041f0
buffer audio from TTS service before pushing frames
2025-06-09 07:29:09 -07:00
Vaibhav159
a2ee94651e
removing resampling
2025-06-07 12:53:55 +05:30
Aleix Conchillo Flaqué
abdce063f1
Merge pull request #1973 from pipecat-ai/aleix/assemblyai-yield-none
...
AssemblyAISTTService: yield None instead of Frame()
2025-06-06 15:12:16 -07:00
Aleix Conchillo Flaqué
a33ce5e4bf
AssemblyAISTTService: yield None instead of Frame()
2025-06-06 14:41:01 -07:00
Filipi da Silva Fuchter
c9575eaef9
Merge pull request #1911 from pipecat-ai/filipi/websocket_transport_example
...
Adding support to WebsocketTransport
2025-06-06 17:25:07 -03:00
Filipi Fuchter
1e74476a71
Refactoring to use the observer inside the pipelinetask, and moving to start the bot inside on_client_ready.
2025-06-06 17:22:50 -03:00
Filipi Fuchter
82935884c4
Mentioning the new websocket example in the changelog.
2025-06-06 17:17:11 -03:00
Filipi Fuchter
d774a23768
Improving the readme to mention that can choose which server websocket to use.
2025-06-06 17:12:05 -03:00
Filipi Fuchter
e9f041e170
Removing the old websocket-server example
2025-06-06 17:09:01 -03:00
Filipi Fuchter
1f51b6e4f1
A Pipecat example demonstrating how to use WebsocketTransport
2025-06-06 17:08:43 -03:00
Filipi Fuchter
028650249c
Adding support in ProtobufFrameSerializer to deserialize MessageFrame.
2025-06-06 17:07:39 -03:00
Vaibhav159
534197239f
updating changelog
2025-06-07 00:24:54 +05:30
Vaibhav159
d2f4bb574c
adding exotel serializer
2025-06-07 00:22:41 +05:30
jqueguiner
25ff8ef37b
✨ (config.py): add new configuration options for lip-sync optimization, context adaptation, and additional context to enhance translation accuracy
...
♻️ (stt.py): increase default max buffer size from 5MB to 20MB to accommodate larger audio data
♻️ (stt.py): simplify audio sending logic by removing chunking and sending the entire buffered audio at once for improved performance
2025-06-05 16:51:29 -07:00
Aleix Conchillo Flaqué
07fb1a2c39
Merge pull request #1967 from counterleft/unused-http-client-session
...
Remove instantiation of unused http client session from certain examples
2025-06-05 12:59:01 -07:00
Aleix Conchillo Flaqué
581b800c43
Merge pull request #1961 from ken-kuro/patch-1
...
fix(piper-tts): typo
2025-06-05 12:57:58 -07:00
Aleix Conchillo Flaqué
30ca39287f
Merge pull request #1962 from ken-kuro/patch-2
...
fix(fastapi_websocket): typo
2025-06-05 12:57:22 -07:00
Aleix Conchillo Flaqué
01fa9698de
Merge pull request #1960 from pipecat-ai/aleix/disable-uvloop
...
disable uvloop by default and just let the user set it
2025-06-05 12:12:47 -07:00
Brian Mathiyakom
10bd969636
Remove instantiation of unused http client session
...
These examples don't make any HTTP requests with `session` so there
doesn't seem be a need to create one in the first place. Probably a
copy-paste from a previous example.
2025-06-05 11:45:13 -07:00
Kendrick Ha
f7761f2b61
fix(fastapi_websocket): typo
2025-06-05 13:55:28 +07:00
Kendrick Ha
49ff38a21f
fix(piper-tts): typo
2025-06-05 13:50:56 +07:00
Aleix Conchillo Flaqué
8d161306c7
disable uvloop by default and just let the user set it
2025-06-04 21:25:06 -07:00
Vanessa Pyne
027a82dff1
Merge pull request #1958 from pipecat-ai/vp-livekit-fix
...
fix: transports/services/livekit.py typo
2025-06-04 12:27:47 -05:00
vipyne
cb409d58e0
fix: transports/services/livekit.py typo
2025-06-04 11:14:21 -05:00
Dan Berg
094e2f8151
Fix formatting
2025-06-03 17:21:51 +02:00
Dan Berg
71d121aeb9
Update CHANGELOG.md explaining informal on Gladia TranslationConfig
2025-06-03 17:15:29 +02:00
Dan Berg
b1a88af43c
Add informal to Gladia TranslationConfig
2025-06-03 17:10:52 +02:00
Filipi da Silva Fuchter
f73eb4ebd9
Merge pull request #1949 from pipecat-ai/filipi/transport_destination_issue
...
Fixed transport destination issue
2025-06-03 08:41:34 -03:00
Filipi Fuchter
31ca9be299
Fixing missing await to self.reset.
2025-06-03 08:37:47 -03:00
jqueguiner
02cc6f3d56
Enhance GladiaSTTService with reconnection and audio buffer management features
...
- Added parameters for maximum reconnection attempts, reconnection delay, and maximum audio buffer size.
- Implemented automatic reconnection logic with exponential backoff.
- Introduced audio buffer management to handle audio data efficiently, including trimming excess data.
- Updated connection handling to ensure proper cleanup and management of WebSocket connections.
- Enhanced audio sending logic to support buffered audio transmission after reconnections.
2025-06-03 03:16:57 -07:00
Filipi Fuchter
1642c082d1
Describing the fix in the changelog.
2025-06-02 22:28:31 -03:00
Filipi Fuchter
892d213442
Fixing issue to keep the transport_destination.
2025-06-02 22:16:10 -03:00
Filipi Fuchter
fc24267e09
Waiting for the LLM response to reset.
2025-06-02 22:15:53 -03:00
Aleix Conchillo Flaqué
9b71bdc608
Merge pull request #1947 from pipecat-ai/aleix/pipecat-0.0.69
...
update CHANGELOG for 0.0.69
2025-06-02 12:51:51 -07:00
Aleix Conchillo Flaqué
310be89895
update CHANGELOG for 0.0.69
2025-06-02 12:07:50 -07:00
Aleix Conchillo Flaqué
71fbd57e12
Merge pull request #1938 from pipecat-ai/aleix/custom-interruption-strategies
...
allow custom interruption strategies
2025-06-02 12:05:50 -07:00
Aleix Conchillo Flaqué
ab4b48c823
examples(04a): fix daily_runner import
2025-06-02 12:01:26 -07:00
Aleix Conchillo Flaqué
532767cfa1
LLMUserContextAggregator: reset strategies when reseting the aggregator
2025-06-02 12:01:26 -07:00
Aleix Conchillo Flaqué
5512de3221
allow custom interruption strategies
2025-06-02 12:01:26 -07:00
Mark Backman
13546d5e8f
Merge pull request #1946 from pipecat-ai/mb/fix-11labs-context
...
fix: Use AudioContextWordTTSService context methods in ElevenLabsTTSS…
2025-06-02 14:55:49 -04:00
Mark Backman
c6f1aa8086
fix: Use AudioContextWordTTSService context methods in ElevenLabsTTSService
2025-06-02 14:49:05 -04:00
Mark Backman
5606c47cb7
Merge pull request #1945 from pipecat-ai/mb/gemini-2.0
...
Reverting Gemini Live model back to gemini-2.0-flash-live-001
2025-06-02 14:25:30 -04:00
Filipi da Silva Fuchter
7f7cd96211
Merge pull request #1944 from pipecat-ai/fixing_tavus_transport
...
Adding the direction when pushing the frame.
2025-06-02 15:21:58 -03:00
Filipi Fuchter
b828bfd890
Adding the direction when pushing the BotStartedSpeaking and BotStoppedSpeaking frames.
2025-06-02 15:05:56 -03:00
Mark Backman
31d084eb78
Reverting Gemini Live model back to gemini-2.0-flash-live-001
2025-06-02 13:29:05 -04:00
Mark Backman
ab18b280e9
Merge pull request #1943 from pipecat-ai/mb/add-transcription-19-openai
...
Add a TranscriptProcessor to 19-openai-realtime-beta.py
2025-06-02 13:01:52 -04:00
Mark Backman
24e89c4081
Merge pull request #1936 from pipecat-ai/mb/fix-01-quickstart
...
Add daily to the foundational examples requirements.txt
2025-06-02 12:55:36 -04:00
Mark Backman
e129390f56
Add a TranscriptProcessor to 19-openai-realtime-beta.py
2025-06-02 11:38:49 -04:00
Mark Backman
4d7c87bb4c
Merge pull request #1941 from pipecat-ai/vp-observer-up
...
chore: move observers arg in p2p-webrtc example; add deprecated to in…
2025-06-02 11:17:48 -04:00
Mark Backman
dac3f82a75
Merge pull request #1934 from counterleft/use-disconnect-on-small-webrtc-connection-example
...
Fix type checker error with missing function call in the small WebRTC transport example
2025-06-02 11:17:30 -04:00
Mark Backman
fd860921f1
Add daily to the foundational examples requirements.txt
2025-06-02 11:10:49 -04:00
vipyne
0482ccd48b
chore: move observers arg in p2p-webrtc example; add deprecated to in line comments
2025-06-02 09:41:09 -05:00
Dominic Stewart
b8b1990617
Fix example env file ( #1939 )
...
* Fixed typo in the example env files
2025-06-02 15:12:43 +09:00
Dominic Stewart
70951b1198
Add simplified pstn examples ( #1822 )
...
* Add simplified pstn examples
* Add daily_twilio_sip_dial_out example
2025-06-02 14:50:21 +09:00
Mark Backman
6d24514ace
Merge pull request #1937 from pipecat-ai/mb/fix-message-for-logging
...
fix: correctly display non-roman characters
2025-06-01 12:49:48 -04:00
Aleix Conchillo Flaqué
49915ceb84
Merge pull request #1683 from pipecat-ai/aleix/run-function-calls-sequentially
...
run function calls sequentially or in parallel
2025-06-01 09:47:35 -07:00
Mark Backman
925b13e337
fix: correctly display non-roman characters
2025-06-01 12:29:26 -04:00
Aleix Conchillo Flaqué
ef3143d558
LLMService: don't run function calls if none are given
2025-05-31 14:01:56 -07:00
Mark Backman
ed84637b55
Add additional function call for testing to 14e, 14r, 19, 19a, 26b
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
897a944478
examples(14,14a): add restaurant recommendation function call
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
d86343c38d
examples: update to use on_function_calls_started event
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
297afdd126
LLMService: add new FunctionCallsStartedFrame
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
f0cbdc4e68
LLMService: add on_function_calls_started event
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
40b52cadde
LLMService: s/FunctionCallLLM/FunctionCallFromLLM/ s/FunctionCallRunner/FunctionCallRunnerItem/
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
04bf85ddfe
LLMService: allow executing tasks sequentially and in parallel
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
4809684a13
LLMService: cancel function calls on interruptions by default
2025-05-31 13:57:50 -07:00
Aleix Conchillo Flaqué
1eb50ad88f
LLMService: pass LLM function calls all at once
2025-05-31 13:57:36 -07:00
Aleix Conchillo Flaqué
52569bcdb2
LLMService: don't allow running functions concurrently for now
2025-05-31 13:57:36 -07:00
Aleix Conchillo Flaqué
a50a407415
LLMService: run function calls sequentially
2025-05-31 13:57:35 -07:00
Aleix Conchillo Flaqué
9f223442c2
Merge pull request #1935 from pipecat-ai/aleix/script-evals
...
improve evals
2025-05-30 19:14:59 -07:00
Mark Backman
c647114bb9
Merge pull request #1927 from pipecat-ai/mb/gemini-tracing
2025-05-30 22:01:44 -04:00
Mark Backman
43719ec737
Update CHANGELOG
2025-05-30 21:36:39 -04:00
Mark Backman
8602557985
Refactor Gemini tracing to more closely match OpenAI Realtime, add TTFB metrics
2025-05-30 21:36:00 -04:00
Mark Backman
dd1f7d0875
Add tracking to OpenAI Realtime
2025-05-30 21:36:00 -04:00
Mark Backman
ec39e794d3
_handle_transcription
2025-05-30 21:36:00 -04:00
Mark Backman
7b1a937d4c
Add tracing for Gemini Live
2025-05-30 21:36:00 -04:00
Mark Backman
0fd38d8115
Merge pull request #1931 from pipecat-ai/mb/num-words
...
Add support for interruption strategies
2025-05-30 21:14:02 -04:00
Mark Backman
7a4efc6212
Code review feedback
2025-05-30 21:09:15 -04:00
Brian Mathiyakom
2eb2c5a413
Use disconnect() because close() doesn't exist
...
SmallWebRTCConnection doesn't have a `close()`. There's a `_close()` but I assume that's private due to its naming. The closest function that uses `_close()` is `disconnect()`. I assume then, that the intended resource freeing function call should be to `disconnect()`.
2025-05-30 17:14:53 -07:00
Aleix Conchillo Flaqué
2fcfb0aa9f
evals: don't use Deepgram's smart formatting
2025-05-30 16:55:55 -07:00
Aleix Conchillo Flaqué
f1df079512
evals: allow running a single eval
2025-05-30 16:55:55 -07:00
getchannel
8070e156d8
Add groundingMetadata events.py
2025-05-30 18:07:09 -04:00
Aleix Conchillo Flaqué
d77bedbafb
evals: move scripts/release to script/evals and add README
2025-05-30 15:04:05 -07:00
getchannel
43c6f1f5cd
Add groundingMetadata and logging gemini.py
2025-05-30 18:01:15 -04:00
getchannel
f53f5445ba
Create 26g-gemini-multimodal-live-groundingMetadata.py
2025-05-30 17:36:36 -04:00
Mark Backman
b34c593c54
Add changelog entry
2025-05-30 16:48:42 -04:00
Mark Backman
62efbc3342
Add foundational example 42
2025-05-30 16:48:42 -04:00
Mark Backman
2d609a0bde
Update LLmUserContextAggregator to conditionally push_aggregation
2025-05-30 16:48:42 -04:00
Mark Backman
6bc4b4a17f
Update BaseInputTransport to not push StartInterruptionFrame when InterruptionConfig is set and bot is speaking
2025-05-30 16:48:42 -04:00
Mark Backman
b489e52080
Add InterruptionConfig
2025-05-30 16:15:20 -04:00
getchannel
7263d11ee4
update correct upload endpoint file_api.py
2025-05-30 13:41:55 -04:00
getchannel
f2d5b9ad69
Create 26f-gemini-multimodal-live-files-api.py
...
This is an example to test usage of the Files API integration. Specifically with the Gemini Multimodal Live Service.
2025-05-30 13:04:52 -04:00
getchannel
40c7e3c52c
Update gemini.py
2025-05-30 12:19:40 -04:00
Aleix Conchillo Flaqué
a8aaeec52b
Merge pull request #1926 from pipecat-ai/aleix/pause-base-input-transport
...
handle StopFrame in base input transport and stop pushing frames
2025-05-30 08:27:20 -07:00
Mark Backman
ad7eec181e
Merge pull request #1923 from philipp-eisen/philipp/fix-ttfb_ms-implementation
...
Fix implementation of ttfb_ms metric
2025-05-30 11:03:42 -04:00
Aleix Conchillo Flaqué
b33897ffb9
SmallWebRTCTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
1c3d3f2f4b
WebsocketClientTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
9a5a1edb6b
WebsocketServerTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
f2eb869b02
FastAPIWebsocketTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
0c7e3cfcb2
LiveKitTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
24e19db29e
TavusTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
bc6d7b7bbd
examples(phone-chatbot): don't show dangling tasks in first pipeline
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
cad271068e
BaseInputTransport: handle StopFrame and pause pushing frames
2025-05-30 07:51:49 -07:00
Philipp Eisen
3425293115
Ensure correct formatting
2025-05-30 15:41:45 +02:00
Mark Backman
20dbfec3a9
Merge pull request #1876 from m-ods/m-ods/assemblyai-universal-streaming
...
Update AssemblyAI Streaming STT
2025-05-30 08:55:43 -04:00
marcus-daily
170057a75a
Updating dependency version
2025-05-30 12:38:32 +01:00
marcus-daily
b86b761e0b
Fixing Yaml syntax
2025-05-30 12:38:32 +01:00
marcus-daily
da0d2f0266
Small WebRTC transport demo app for Android
2025-05-30 12:38:32 +01:00
Martin Schweiger
321ea27c34
changelog entry
2025-05-30 17:15:58 +08:00
Philipp Eisen
b712e6b9aa
Switch ttfb metric to use seconds instead
2025-05-30 11:13:26 +02:00
Martin Schweiger
b3652e6527
set vad_force_turn_endpoint to True by default
2025-05-30 17:07:54 +08:00
Philipp Eisen
bc97f397ef
Switch to using float instead of int, but keep ms
2025-05-30 10:27:20 +02:00
Martin Schweiger
e5da3f6e68
add tracing
2025-05-30 10:55:19 +08:00
Martin Schweiger
8400539acf
set formatted_finals true by default
2025-05-30 10:40:01 +08:00
Martin Schweiger
b5eac8dfed
add message to TranscriptionFrame result
2025-05-30 10:39:07 +08:00
Martin Schweiger
ba312b5591
Merge branch 'main' into m-ods/assemblyai-universal-streaming
2025-05-30 10:29:49 +08:00
Martin Schweiger
f23572b318
Merge branch 'main' into m-ods/assemblyai-universal-streaming
2025-05-30 10:11:02 +08:00
Martin Schweiger
db838634e7
fix: double finals bug
2025-05-30 10:00:31 +08:00
Martin Schweiger
7f2e848a5c
use FrameProcessor class methods
2025-05-30 09:40:46 +08:00
Martin Schweiger
096e854d50
remove .dict()
2025-05-30 09:31:20 +08:00
Martin Schweiger
3ffe8b3155
remove parse_obj
2025-05-30 09:29:51 +08:00
Mark Backman
a471f49b61
Merge pull request #1889 from pipecat-ai/mb/add-dtmf-aggregator
...
Add DTMFAggregator
2025-05-29 17:13:28 -04:00
Mark Backman
4d2a02f318
Refactor to create task on StartFrame, also cleanup
2025-05-29 17:10:54 -04:00
Mark Backman
0bec7db03b
Emit a BotInterruptionFrame when the first keypress of a sequence is received
2025-05-29 17:07:18 -04:00
Mark Backman
74827f983f
Add tests, improve frame timing
2025-05-29 17:07:18 -04:00
Mark Backman
0ed46f457e
Add DTMFAggregator
2025-05-29 17:07:17 -04:00
Aleix Conchillo Flaqué
36b731be73
Merge pull request #1915 from pipecat-ai/aleix/uvloop-event-loop
...
use uvloop as the new event loop on Linux and macOS
2025-05-29 14:06:44 -07:00
Aleix Conchillo Flaqué
62fbdd4e81
Merge pull request #1922 from pipecat-ai/aleix/output-transport-cleanup
...
output transports cleanup
2025-05-29 14:06:17 -07:00
Aleix Conchillo Flaqué
ca7b0650c2
examples: capture camera or screen. allow setting framerate
2025-05-29 13:16:44 -07:00
Aleix Conchillo Flaqué
67dd146038
output transports cleanup
2025-05-29 13:16:44 -07:00
Aleix Conchillo Flaqué
fb66df2efd
use uvloop as the new event loop on Linux and macOS
2025-05-29 11:24:21 -07:00
Aleix Conchillo Flaqué
2395ca0057
Merge pull request #1921 from pipecat-ai/aleix/transcription-frame-result
...
add STT result field to TranscriptionFrame/InterimTranscriptionFrame
2025-05-29 11:22:38 -07:00
Aleix Conchillo Flaqué
d203789490
add STT result field to TranscriptionFrame/InterimTranscriptionFrame
2025-05-29 11:21:44 -07:00
Aleix Conchillo Flaqué
7ea0e31cd4
Merge pull request #1924 from pipecat-ai/aleix/new-examples-package
...
add new pipecat.examples package and make runner public
2025-05-29 11:18:22 -07:00
Mark Backman
d3bf13a503
Merge pull request #1917 from pipecat-ai/mb/fix-twilio-chatbot-client
...
fix: update websocket_client to use FrameProcessorSetup.task_manager
2025-05-29 14:05:27 -04:00
Mark Backman
ea91970499
Update the twilio-chatbot client to work with the updated server, which requires call_sid
2025-05-29 14:02:49 -04:00
Mark Backman
803b3f2cc4
fix: update websocket_client to use FrameProcessorSetup
2025-05-29 14:02:47 -04:00
Aleix Conchillo Flaqué
1788ba6c5c
add new pipecat.examples package and make runner public
2025-05-29 10:43:12 -07:00
Philipp Eisen
5209bd3d9f
Fix implemetation of ttfb_ms metric
2025-05-29 19:24:04 +02:00
Aleix Conchillo Flaqué
cb9178f1ec
Merge pull request #1914 from pipecat-ai/aleix/base-output-daily-handle-dtmf-frames
...
output transport can now handle DTMF keypress
2025-05-29 09:35:01 -07:00
Aleix Conchillo Flaqué
5676920a6a
BaseOutputTransport/DailyTransport: allow sending DTMF keypress
2025-05-29 09:33:29 -07:00
Aleix Conchillo Flaqué
513221d9fd
added OutputDTMFUrgentFrame
2025-05-29 09:32:57 -07:00
Mark Backman
a33d0b4b53
Merge pull request #1904 from pipecat-ai/mb/aws-bedrock-no-op-tool
...
Add no_op tool to AWSBedrockLLMService
2025-05-29 10:29:19 -04:00
Mark Backman
bee242b781
Safer check when using the no_operation tool
2025-05-29 10:25:20 -04:00
Mark Backman
fa1c98ff29
Add no_op tool to AWSBedrockLLMService
2025-05-29 10:25:19 -04:00
Mark Backman
ae3a7d9bed
Merge pull request #1920 from alexflorensa/alexflorensa/set-deepgram-model-name
...
fix(deepgram-stt): set model name to Deepgram STT
2025-05-29 09:41:56 -04:00
Matej Marinko
ee5fea4221
Fix auto finalization cycle
2025-05-29 14:58:35 +02:00
Matej Marinko
db7b60cfe9
Auto finalize fix
2025-05-29 13:24:53 +02:00
alexflorensa
0c2efb312c
fix(deepgram-stt) Set model name to Deepgram STT
2025-05-29 12:08:16 +02:00
Matej Marinko
51b79bd6a1
Minor code style changes
2025-05-29 10:11:11 +02:00
Matej Marinko
95fe762776
Fix typo
2025-05-29 09:23:37 +02:00
Aleix Conchillo Flaqué
cf8eeaab0b
Merge pull request #1909 from pipecat-ai/aleix/daily-expose-transcription-functions
...
DailyTransport: expose start_transcription/stop_transcription
2025-05-28 17:06:40 -07:00
Vanessa Pyne
2f8cb3ce76
Merge pull request #1804 from pipecat-ai/vp-text-webrtc-chatbot
...
add text chatbot example using small webrtc transport
2025-05-28 14:25:42 -05:00
vipyne
821da723c0
update SmallWebRTCTransport text examples with new run_example
2025-05-28 13:54:45 -05:00
Filipi Fuchter
575b97ba60
Some improvements and cleanups in the SmallWebRTCTransport text examples.
2025-05-28 13:54:45 -05:00
vipyne
cc0819b709
examples: add text and audio over webrtc transport
...
update filenames
add high level comments to 41* examples
2025-05-28 13:54:45 -05:00
vipyne
318d6f042b
examples: add text chatbot example using small webrtc transport
...
examples: send small webrtc UI updates in RTVIServerMessageFrame
add explanation about RTVI server messages being specific to
small-webrtc-prebuilt UI
2025-05-28 13:54:45 -05:00
Aleix Conchillo Flaqué
05ae3a1703
DailyTransport: expose start_transcription/stop_transcription
2025-05-28 11:21:26 -07:00
Aleix Conchillo Flaqué
8e54805e62
Merge pull request #1908 from pipecat-ai/aleix/add-manifest-file-to-reduce-sdist
...
add MANIFEST.in to reduce sdist tarball size
2025-05-28 10:15:38 -07:00
Aleix Conchillo Flaqué
64399a72f3
add MANIFEST.in to reduce sdist tarball size
2025-05-28 10:09:39 -07:00
Aleix Conchillo Flaqué
6c33f0b0bd
Merge pull request #1907 from pipecat-ai/aleix/pipecat-0.0.68
...
update CHANGELOG for pipecat 0.0.68
2025-05-28 09:41:34 -07:00
Aleix Conchillo Flaqué
aca304b395
update CHANGELOG for pipecat 0.0.68
2025-05-28 09:08:08 -07:00
Aleix Conchillo Flaqué
db5c9e67be
Merge pull request #1906 from pipecat-ai/aleix/daily-python-0.19.1
...
pyproject: update daily-python to 0.19.1
2025-05-28 09:05:13 -07:00
Aleix Conchillo Flaqué
2313cec792
pyproject: update daily-python to 0.19.1
2025-05-28 00:36:40 -07:00
Matej Marinko
2968c846ce
Add Soniox STT service
2025-05-28 09:35:21 +02:00
Aleix Conchillo Flaqué
83acaf692a
Merge pull request #1890 from pipecat-ai/aleix/examples-multi-transport
...
add support for multiple transports to foundational examples
2025-05-28 00:27:01 -07:00
Aleix Conchillo Flaqué
e9aeb2662b
scripts: allow specifying a name for the test run
2025-05-28 00:22:55 -07:00
Aleix Conchillo Flaqué
356f4039e4
scripts: allow storing logs for release evals
2025-05-27 21:10:22 -07:00
Aleix Conchillo Flaqué
736c7f1f30
scripts: allow storing audio for release evals
2025-05-27 18:09:25 -07:00
Aleix Conchillo Flaqué
2994448036
introduce release evals
...
This is an initial attempt to implement evals for all (or most) of our
foundational examples. Before we release, we want to make sure all of them work
and reply properly. Until now this has been done manually, hopefully this will
be useful to speed up our release process.
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
d476d9ea05
examples: remove "on_client_closed"
...
This has been replaced for "on_client_disconnected" in SmallWebRTCTransport to
match other transports and therefore it is not necessary anymore.
2025-05-27 17:42:52 -07:00
Filipi Fuchter
bf31bce440
Updated SmallWebRTCTransport to align with how other transports handle on_client_disconnected
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
6393e89022
examples(foundational): update handle_signint depending on transport
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
884268fce3
examples(foundational): allow running examples with twilio
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
071a9307c9
transport(websocket): do not require a frame serializer
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
2cdfaa0a82
examples(foundational): support multiple transports
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
ecf878e14d
DailyTransport: allow requesting video frames with any framerate
2025-05-27 17:42:50 -07:00
Aleix Conchillo Flaqué
4eed335bc7
PipelineTask: check if pipeline has already been cancelled
2025-05-27 17:40:39 -07:00
Aleix Conchillo Flaqué
2e57bb74d2
BaseObject: do not raise exception if event handler not registered
2025-05-27 17:40:35 -07:00
Aleix Conchillo Flaqué
0a39769cd0
Merge pull request #1901 from pipecat-ai/aleix/deepgram-sdk-4.1.0
...
pyproject: update deepgram-sdk to 4.1.0
2025-05-27 17:20:54 -07:00
Aleix Conchillo Flaqué
bdb6a9e5d1
Merge pull request #1903 from pipecat-ai/aleix/openpipe-4.50.0
...
pyproject: update openpipe to 4.50.0
2025-05-27 17:20:30 -07:00
Aleix Conchillo Flaqué
f88e0eb96d
pyproject: update openpipe to 4.50.0
2025-05-27 15:22:55 -07:00
Aleix Conchillo Flaqué
0099f60d29
deepgram: fix an issue with user provided LiveOptions
2025-05-27 15:19:17 -07:00
Filipi da Silva Fuchter
eaf9f20c56
Merge pull request #1898 from pipecat-ai/tavus_transport_fixes
...
Fixing TavusTransport with some TTS services.
2025-05-27 16:33:19 -03:00
Aleix Conchillo Flaqué
e987c4741a
pyproject: update deepgram-sdk to 4.1.0
2025-05-27 10:32:48 -07:00
Aleix Conchillo Flaqué
6242278abd
Merge pull request #1895 from pipecat-ai/aleix/more-avoid-mutable-default-values
...
more avoiding mutable default constructor values
2025-05-27 10:08:42 -07:00
Mark Backman
30850a431a
Merge pull request #1886 from pipecat-ai/mb/add-otel-llm-output
...
Add LLM response tracing to OTel tracing
2025-05-27 11:58:57 -04:00
Mark Backman
1e7407c042
Merge pull request #1899 from pipecat-ai/mb/genai-to-standard-messages
...
fix: Update GoogleLLMContext to_standard_messages to be compatible with google-genai
2025-05-27 11:57:44 -04:00
Mark Backman
6d94f31ff2
Update foundational example 33 to work with google-genai
2025-05-27 11:20:21 -04:00
Mark Backman
ebb3d1cfd3
fix: Update GoogleLLMContext to_standard_messages to be compatible with google-genai
2025-05-27 11:20:21 -04:00
Filipi Fuchter
acce9489d7
Creating the silence based on the chunk size.
2025-05-27 11:26:34 -03:00
Filipi Fuchter
3d442620f9
Removing not used imports.
2025-05-27 10:42:06 -03:00
Martin Schweiger
f1d7eb8565
final touches
2025-05-27 21:29:50 +08:00
Filipi Fuchter
798b935ff6
The remaining audio should not be sent as done.
2025-05-27 10:28:40 -03:00
Filipi Fuchter
3039a1444e
Refactoring the TavusVideoService to match the same the behavior of the bot started speaking and bot stopped speaking.
2025-05-27 10:26:41 -03:00
Mark Backman
aa7d15beb3
fix: move LLM call outside tracing try block to prevent double execution
2025-05-26 22:06:31 -04:00
Filipi Fuchter
2b3d2cb342
Fixing the issue when using the TavusVideoService with some TTS services.
2025-05-26 22:55:20 -03:00
Filipi Fuchter
5a58357429
Fixing the issue when using the TavusTransport with some TTS services.
2025-05-26 18:34:52 -03:00
Mark Backman
366add2536
Merge pull request #1878 from pipecat-ai/mb/add-plivo-serializer
...
Add PlivoFrameSerializer
2025-05-26 11:07:13 -04:00
Mark Backman
e13c9fd42e
Add PlivoFrameSerializer
2025-05-26 11:00:01 -04:00
Mark Backman
2a6c01f634
Merge pull request #1885 from pipecat-ai/mb/update-langfuse-example
2025-05-26 10:14:02 -04:00
Mark Backman
bf29722e78
Merge pull request #1884 from pipecat-ai/mb/readme-otel-twilio-telnyx
2025-05-26 10:13:23 -04:00
Mark Backman
db227ad15f
Merge pull request #1897 from pipecat-ai/mb/fix-websocket-client-example
...
Fix mismatched html tag in websocket client example
2025-05-26 09:26:53 -04:00
Mark Backman
514716042b
Fix mismatched html tag in websocket client example
2025-05-26 08:25:03 -04:00
Aleix Conchillo Flaqué
7a767e680c
more avoiding mutable default constructor values
2025-05-25 21:00:35 -07:00
Martin Schweiger
320b52eb1e
Merge branch 'm-ods/assemblyai-universal-streaming' of https://github.com/m-ods/pipecat into m-ods/assemblyai-universal-streaming
2025-05-26 09:13:08 +08:00
Martin Schweiger
428cee75c5
Add User-Agent header to AssemblyAI websocket connection
2025-05-26 09:10:55 +08:00
Martin Schweiger
5479a55b2c
Add websockets dependency to assemblyai extra
2025-05-26 09:08:56 +08:00
Mark Backman
d1f2a5d04f
Merge pull request #1868 from aristid/google-streaming-tts
...
Add Google streaming TTS as a base TTS service
2025-05-24 12:42:47 -04:00
aristid
09ba319f3e
Merge branch 'main' into google-streaming-tts
2025-05-24 17:16:22 +02:00
ezun-kim
3da711ba8b
Fix SSE server connection handling for MCP client
...
### Summary
This PR improves the MCP (Model Context Protocol) client's SSE (Server-Sent Events) server connection handling by replacing the generic string parameter with a proper `SseServerParameters` class.
### Changes
- **Breaking Change**: Changed `server_params` type from `Union[StdioServerParameters, str]` to `Union[StdioServerParameters, SseServerParameters]`
- Added import for `SseServerParameters` from `mcp.client.session_group`
- Updated SSE client connection to use structured parameters instead of a simple URL string
- Fixed error message to correctly reflect the expected parameter types
- Improved logging by changing info-level log to debug-level for consistency
### Details
#### Before
The SSE client connection only accepted a URL string:
```python
async with self._client(self._server_params) as (read, write):
```
#### After
Now properly unpacks SSE server parameters:
```python
async with self._client(
url=self._server_params.url,
headers=self._server_params.headers,
timeout=self._server_params.timeout,
sse_read_timeout=self._server_params.sse_read_timeout
) as (read, write):
```
### Benefits
- **Type Safety**: Stronger type checking with dedicated `SseServerParameters` class
- **Extended Configuration**: Support for custom headers (authentication), timeouts, and SSE-specific settings
- **Better Error Messages**: Clear type error messages when incorrect parameters are provided
- **Improved Debugging**: Debug logging of SSE server parameters for troubleshooting
### Migration Guide
Users need to update their SSE server initialization:
```python
# Before
client = MCPClient("https://example.com/sse ")
# After
from mcp.client.session_group import SseServerParameters
client = MCPClient(SseServerParameters(
url="https://example.com/sse ",
headers={"Authorization": "Bearer token"},
timeout=30,
sse_read_timeout=60
))
```
### Testing
- [ ] Tested with StdioServerParameters (unchanged behavior)
- [ ] Tested with SseServerParameters with various configurations
- [ ] Verified error handling for invalid parameter types
---
This is a necessary change to support production-ready SSE connections with proper authentication and timeout handling.
2025-05-24 22:35:57 +09:00
Mark Backman
6f524fb816
Add LLM response to OTel tracing
2025-05-24 09:15:39 -04:00
unknown
d3e2a9e5c0
Change default voice and fix formatting
2025-05-24 15:14:39 +02:00
Mark Backman
b4cd7d7941
Langfuse OTel env.example improvements
2025-05-24 08:17:10 -04:00
Mark Backman
cd03b91115
Update README: Add OTel, Add serializers
2025-05-24 07:23:59 -04:00
Aleix Conchillo Flaqué
f86d002ceb
Merge pull request #1881 from pipecat-ai/aleix/daily-input-audio-and-video-task-fix
...
daily input audio and video task fix
2025-05-23 19:39:25 -07:00
Aleix Conchillo Flaqué
940926b5ec
TavusVideoService: no need to enable audio/video outputs
2025-05-23 19:29:34 -07:00
Aleix Conchillo Flaqué
85c096df0b
DailyTransport: create audio/video input tasks when input flag is enabled
2025-05-23 19:28:18 -07:00
Filipi da Silva Fuchter
76d93522ac
Merge pull request #1820 from pipecat-ai/tavus_video_service
...
Tavus improvements
2025-05-23 23:11:00 -03:00
Filipi Fuchter
31492831cc
Updating the changelog and readme to reflect the Tavus changes.
2025-05-23 23:04:04 -03:00
Filipi Fuchter
8221dd594e
Creating a Tavus example using the DailyTransport.
2025-05-23 23:03:40 -03:00
Filipi Fuchter
6346ca1a84
Creating a Tavus example using the SmallWebRTCTransport.
2025-05-23 23:03:24 -03:00
Filipi Fuchter
4a3404883f
Creating a Tavus example using the new TavusTransport.
2025-05-23 23:03:16 -03:00
Filipi Fuchter
1ebca35313
Queuing the app messages if the SmallWebrtcTransport is not connected yet.
2025-05-23 23:03:04 -03:00
Filipi Fuchter
e0d1381f87
Refactoring the TavusVideoService to allow to work with any transport.
2025-05-23 23:02:49 -03:00
Filipi Fuchter
86e6841569
Creating TavusTransport and TavusTransportClient.
2025-05-23 23:02:37 -03:00
Aleix Conchillo Flaqué
28b7a92a00
Merge pull request #1880 from pipecat-ai/aleix/daily-resize-event-loop-fix
...
BaseOutputTransport: don't block event loop during image resize
2025-05-23 18:32:00 -07:00
Aleix Conchillo Flaqué
4db5b18694
BaseOutputTransport: don't block event loop during image resize
2025-05-23 18:30:28 -07:00
Aleix Conchillo Flaqué
a628e921c0
Merge pull request #1879 from pipecat-ai/aleix/daily-fix-video-task
...
DailyTransport: fix video task variable
2025-05-23 17:56:08 -07:00
Aleix Conchillo Flaqué
6ca6ff37c9
DailyTransport: fix video task variable
2025-05-23 17:54:25 -07:00
Aleix Conchillo Flaqué
456db3710a
Merge pull request #1828 from pipecat-ai/aleix/daily-use-audio-renderers
...
DailyTransport: replace virtual speaker and microphones
2025-05-23 13:31:51 -07:00
Aleix Conchillo Flaqué
50f024c6f9
LiveKitTransport: use UserAudioRawFrame instead of InputAudioRawFrame
2025-05-23 11:27:53 -07:00
Aleix Conchillo Flaqué
a4de75a8c0
Merge pull request #1867 from pipecat-ai/aleix/user-bot-latency-log-observer
...
observers: added UserBotLatencyLogObserver
2025-05-23 09:23:03 -07:00
Aleix Conchillo Flaqué
88e8fcdaca
observers: added UserBotLatencyLogObserver
2025-05-23 09:17:53 -07:00
unknown
bfe9952c9a
Remove sleep(0), add doc string etc.
2025-05-23 12:11:08 +02:00
Martin Schweiger
7f568e3e7e
Merge branch 'main' into m-ods/assemblyai-universal-streaming
2025-05-23 17:39:00 +08:00
Martin Schweiger
9b8800ac1d
update stt.py
2025-05-23 17:32:31 +08:00
Martin Schweiger
fd53712567
add models for new streaming service
2025-05-23 17:32:12 +08:00
Aleix Conchillo Flaqué
7f74c2465c
SileroVADAnalyzer: improve non-matching sample rate log
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
30d67a78eb
examples(chatbot-audio-recording): use same sample rate to avoid downsampling
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
c3cfd1f0ce
DailyTransport: process audio, video and event callbacks in separate tasks
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
69ac70eed8
DailyTransport: replace virtual microphone with custom microphone track
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
fcf49e79cc
DailyTransport: use participant audio renderers instead of virtual speaker
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
8d4894846d
pyproject: update to daily-python 0.19.0
2025-05-23 01:47:09 -07:00
Vanessa Pyne
a809b710c5
Merge pull request #1844 from pipecat-ai/vp-docsinreadme
...
add docs link at top of readme
2025-05-22 21:52:18 -05:00
vipyne
f6289e9db2
add docs link at top of readme
2025-05-22 21:51:29 -05:00
Mark Backman
26b4c4df22
Merge pull request #1870 from pipecat-ai/mb/gemini-2.5-flash-update
...
Update GeminiMultimodalLiveLLMService to use Gemini 2.5 Flash Native …
2025-05-22 18:19:55 -04:00
Mark Backman
f3a9844295
Merge pull request #1860 from pipecat-ai/mb/organize-otel-demos
...
Reorganize OpenTelemetry demos, add top-level README
2025-05-22 18:15:20 -04:00
Mark Backman
692821bdae
Merge pull request #1873 from pipecat-ai/mb/readme-sarvam
...
Add SarvamTTSService to README
2025-05-22 18:14:40 -04:00
Mark Backman
ee143d5b3a
Update GeminiMultimodalLiveLLMService to use Gemini 2.5 Flash Native Audio Dialog model
2025-05-22 18:13:41 -04:00
Mark Backman
7e178a634a
Merge pull request #1871 from pipecat-ai/mb/claude-sonnet-4-update
...
Update default model for Anthropic to Claude Sonnet 4
2025-05-22 18:12:47 -04:00
Mark Backman
fe88a3d80b
Add SarvamTTSService to README
2025-05-22 18:11:11 -04:00
Mark Backman
a196eac290
Merge pull request #1872 from pipecat-ai/mb/add-sarvam-tts
...
Add SarvamTTSService
2025-05-22 18:02:36 -04:00
Mark Backman
3c819955a2
Add SarvamTTSService
2025-05-22 16:23:08 -04:00
Mark Backman
ca0d7bbbed
Update default model for Anthropic to Claude Sonnet 4
2025-05-22 15:13:33 -04:00
Mark Backman
f93bd1e817
Merge pull request #1864 from pipecat-ai/mb/fix-11lab-set-model-voice
...
Fix: ElevenLabsTTSService, change voice and model
2025-05-22 14:36:24 -04:00
Mark Backman
415bc6ca0a
Fix: ElevenLabsTTSService, change voice and model
2025-05-22 14:28:50 -04:00
Mark Backman
8543c8d11d
Merge pull request #1869 from pipecat-ai/mb/update-readme-nova-sonic
...
Add AWS Nova Sonic to README
2025-05-22 14:07:35 -04:00
Mark Backman
bf5ad64575
Add AWS Nova Sonic to README
2025-05-22 14:03:28 -04:00
unknown
d42d02d809
Add Google streaming TTS as a base TTS service. Rename non-streaming service to GoogleHttpTTSService.
2025-05-22 11:21:06 +02:00
Aleix Conchillo Flaqué
0718f79ff2
Merge pull request #1866 from pipecat-ai/aleix/base-observers-are-base-objects
...
BaseObserver: inherit from BaseObject so we can have events
2025-05-21 16:07:38 -07:00
Aleix Conchillo Flaqué
9bbce225ce
BaseObserver: inherit from BaseObject so we can have events
2025-05-21 16:04:44 -07:00
Mark Backman
fb35fd6d71
Merge pull request #1859 from pipecat-ai/mb/otel-attribute-naming
...
Update OTel attribute names
2025-05-21 12:10:15 -04:00
Mark Backman
b4fd92aed6
Merge pull request #1862 from marctorsoc/clean-links-in-md-text-filter
...
Add link cleaning in MD text filter
2025-05-21 09:20:27 -04:00
Mark Backman
36931825b3
Merge pull request #1854 from sklinglernv/fix/elevenlab-tts
...
fix(elevenlabs tts): message parameter naming
2025-05-21 09:17:29 -04:00
marc.torsoc
ca35299dcd
add link cleaning and a test for it
2025-05-21 12:08:53 +02:00
Severin Klingler
e74b900914
revert most of the changes except keyword naming fix
2025-05-21 09:24:03 +02:00
Mark Backman
25115668a7
Reorganize OpenTelemetry demos, add top-level README
2025-05-20 23:30:46 -04:00
Mark Backman
fb94db3e64
Update to use GenAI naming
2025-05-20 22:56:02 -04:00
Mark Backman
c4778e770e
Merge pull request #1835 from marcklingen/langfuse-tracing
...
Add examples/open-telemetry-tracing-langfuse
2025-05-20 18:22:55 -04:00
Mark Backman
3860cdf97b
Update OTel attribute names
2025-05-20 18:00:46 -04:00
Aleix Conchillo Flaqué
f3aec0c4ac
Merge pull request #1829 from pipecat-ai/aleix/pipeline-task-add-observer
...
PipelineTask: add add_observer()
2025-05-20 13:18:24 -07:00
Aleix Conchillo Flaqué
d333094149
PipelineTask: add add_observer() and remove_observer()
2025-05-20 13:16:06 -07:00
Aleix Conchillo Flaqué
609ff4e66c
Merge pull request #1841 from pipecat-ai/aleix/base-text-aggregator-async
...
make BaseTextAggregator and BaseTextFilter functions async
2025-05-20 13:13:54 -07:00
Aleix Conchillo Flaqué
cbccbcd9e7
BaseTextFilter: make functions async
2025-05-20 13:11:44 -07:00
Aleix Conchillo Flaqué
54b1d7fcc1
BaseTextAggregator: make functions async
2025-05-20 13:11:42 -07:00
Aleix Conchillo Flaqué
54388c0d9b
Merge pull request #1850 from pipecat-ai/aleix/transcription-message-user-id
...
TranscriptionMessage: add user_id field
2025-05-20 13:10:42 -07:00
Aleix Conchillo Flaqué
228c866aaa
Merge pull request #1857 from pipecat-ai/aleix/avoid-mutable-default-values
...
avoid mutable default constructor values
2025-05-20 13:10:24 -07:00
Aleix Conchillo Flaqué
a09bd648af
avoid mutable default constructor values
2025-05-20 11:59:28 -07:00
Vanessa Pyne
3e4ae61c75
Merge pull request #1856 from pipecat-ai/vp-mcp-debug
...
mcp: fix typo in tool call response
2025-05-20 13:59:11 -05:00
vipyne
7655c432c2
mcp: fix typo in tool call response
2025-05-20 11:16:59 -05:00
Aleix Conchillo Flaqué
25dd651757
TranscriptionMessage: add user_id field
2025-05-19 15:47:54 -07:00
Mark Backman
462aecea3e
Merge pull request #1839 from pipecat-ai/mb/cartesia-speed
...
Add support for Cartesia's speed parameter, update clients and APIs, deprecate emotion
2025-05-19 17:57:25 -04:00
Mark Backman
5f37df790b
Merge pull request #1848 from pipecat-ai/mb/fix-word-wrangler-transport-params
...
Fix: Add audio_in_enabled to Word Wrangler TransportParams
2025-05-19 17:52:05 -04:00
Mark Backman
8e4e03541c
Update CHANGELOG
2025-05-19 17:51:27 -04:00
Aleix Conchillo Flaqué
c1252fc7eb
Merge pull request #1840 from pipecat-ai/aleix/base-object-dont-create-tasks
...
BaseObject: don't create event handler tasks if none is registered
2025-05-19 14:12:31 -07:00
Mark Backman
ed1077cc9a
Fix: Add audio_in_enabled to Word Wrangler TransportParams
2025-05-19 15:53:29 -04:00
Mark Backman
4c761a7b22
Merge pull request #1847 from pipecat-ai/mb/update-otel
...
Keep span identifiers in attributes only
2025-05-19 14:37:42 -04:00
Mark Backman
9bc3df7803
Keep span identifiers in attributes only
2025-05-19 12:25:13 -04:00
Aleix Conchillo Flaqué
5e5060a6fe
BaseObject: don't create event handler tasks if none is registered
2025-05-19 09:24:56 -07:00
Aleix Conchillo Flaqué
2b66eddaa1
Merge pull request #1830 from pipecat-ai/aleix/pipeline-task-frame-events
...
PipelineTask: add new started/stopped/ended/cancelled events
2025-05-19 08:32:28 -07:00
Mark Backman
916b9d6c6d
Add an example for CartesiaHttpTTSService
2025-05-19 11:31:47 -04:00
Mark Backman
bd09ccd608
Update CartesiaHttpTTSService to work with the new cartesia 2.0 client
2025-05-19 11:31:28 -04:00
Mark Backman
682f8e4d45
Bump the cartesia_version for CartesiaTTSService, and cartesia package for CartesiaHttpTTSService
2025-05-19 11:10:03 -04:00
Mark Backman
c9d0af9ee0
Deprecate emotion, add new speed parameter
2025-05-19 09:43:24 -04:00
Severin Klingler
e1299d59bf
fix(elevenlabs tts): Fix message paramter naming and make use of contexts to send out TTSStoppedFrames()
2025-05-19 15:22:13 +02:00
Mark Backman
61da6437ea
Merge pull request #1834 from pipecat-ai/mb/gemini-live-tokens
...
Fix: Make LLMTokenUsage more robust
2025-05-19 09:04:07 -04:00
Marc Klingen
798705469b
Update README.md
2025-05-18 21:11:20 +02:00
Marc Klingen
459a753de3
add reference to main otel example
2025-05-18 19:56:12 +02:00
Marc Klingen
1092ce70b3
add video of langfuse trace
2025-05-18 19:46:38 +02:00
Marc Klingen
9511c189bd
revert original folder
2025-05-18 19:42:13 +02:00
Marc Klingen
66fea9e2ee
create new example folder
2025-05-18 19:41:17 +02:00
Marc Klingen
69ae83516e
use http exporter
2025-05-18 19:11:06 +02:00
Mark Backman
144ea36c81
Fix: Make LLMTokenUsage more robust
2025-05-18 07:41:16 -04:00
Mark Backman
7a8ab9a900
Merge pull request #1672 from golbin/main
...
Use "use_original_timestamps" only for sonic-2 model
2025-05-18 07:24:58 -04:00
Jin Kim
c4b35055b4
Update CHANGELOG.md
2025-05-18 16:54:29 +09:00
Jin Kim
a4c04e7c17
Opt out Sonic models from use_original_timestamps
2025-05-18 16:52:37 +09:00
Jin Kim
a6f7e7fc30
Merge branch 'pipecat-ai:main' into main
2025-05-18 16:48:24 +09:00
Aleix Conchillo Flaqué
d5ebc883b3
PipelineTask: add new started/stopped/ended/cancelled events
2025-05-17 22:46:22 -07:00
Mark Backman
deb43df0a4
Merge pull request #1824 from pipecat-ai/mb/gemini-live-transcribe-user-audio
...
Update GeminiMultimodalLiveLLMService to use Gemini's user transcription
2025-05-16 22:51:04 -04:00
Mattie Ruth
88e472b3f1
Update Modal Readme ( #1825 )
2025-05-16 17:40:57 -04:00
Mark Backman
f59fb8167d
Merge pull request #1784 from thsunkid/thu/handle-transcript-gpt4o-audio
...
Handle audio transcript from gpt-4o-audio and clean up logs
2025-05-16 13:20:16 -04:00
Mark Backman
fac6f526f7
Add comments and docstrings
2025-05-16 10:54:50 -04:00
Mark Backman
2f78d74ce6
Change Gemini Live to use Gemini provided usage metrics
2025-05-16 10:53:01 -04:00
Mark Backman
d3942dda52
Gemini Live to transcribe user audio
2025-05-16 10:53:01 -04:00
Mark Backman
c00e9a8d3a
Merge pull request #1819 from kaikato/lmnt-model-langs
...
LmntTTSService: add model param and additional languages
2025-05-16 08:49:55 -04:00
kaikato
c3b95767f3
LmntTTSService: add model param and additional languages
2025-05-16 04:24:57 +00:00
Mark Backman
90f27a3090
Merge pull request #1816 from pipecat-ai/mb/add-minimax-tts
...
Add MiniMax TTS
2025-05-15 18:05:13 -04:00
Mark Backman
b6f09defc9
Add MiniMax TTS
2025-05-15 18:02:29 -04:00
Aleix Conchillo Flaqué
172813bcfb
Merge pull request #1815 from pipecat-ai/aleix/remove-silerovad-processor
...
remove SileroVAD() frame processor
2025-05-15 13:44:44 -07:00
Aleix Conchillo Flaqué
95c25efab7
remove SileroVAD() frame processor
2025-05-15 11:55:20 -07:00
Aleix Conchillo Flaqué
a51af35024
Merge pull request #1814 from pipecat-ai/aleix/examples-dependabot-05142025
...
examples: updates for dependabot 05/14/2025
2025-05-15 11:38:45 -07:00
Mark Backman
119fd5ba7d
Merge pull request #1025 from fatwang2/main
...
added hailuo tts service
2025-05-15 14:29:24 -04:00
Aleix Conchillo Flaqué
0718a812bd
examples: updates for dependabot 05/14/2025
2025-05-14 22:51:08 -07:00
Mark Backman
3814501b48
Merge pull request #1811 from pipecat-ai/mb/dont-require-tracing-dep
...
Fix: Resolve an issue where tracing imports were required
2025-05-14 12:35:47 -04:00
Mark Backman
7a5205dbda
Fix: Resolve an issue where tracing imports were required
2025-05-14 12:29:08 -04:00
Thu Nguyen
15a5028d23
Revert log changes
2025-05-14 22:28:25 +08:00
Thu Nguyen
fee2648ac0
Handle audio transcript from gpt-4o-audio and clean up logs
2025-05-14 13:02:22 +07:00
Varun Singh
04c02c9a20
Merge pull request #1810 from pipecat-ai/vr000m-receiving-custom-sip-headers
...
added handling for sipHeaders
2025-05-13 23:02:14 -07:00
getchannel
e27da96cdc
Rename file_api to file_api.py
...
added proper .py to file name.
2025-05-13 22:01:02 -04:00
Varun Singh
0ff7195a83
Update README.md
...
updating docs
2025-05-13 19:08:43 -04:00
Varun Singh
3b91aa013a
added handling for sipHeaders
2025-05-13 16:00:05 -07:00
Mark Backman
50f6235edb
Add support for OpenTelemetry tracing ( #1729 )
...
* Also added TurnTrackingObserver, TurnTraceObserver, foundational 29, open-telemetry-example
2025-05-13 17:18:11 -04:00
Aleix Conchillo Flaqué
6f4d94f91b
Merge pull request #1800 from pipecat-ai/aleix/frame-processors-setup
...
introduce frame processors setup
2025-05-13 13:18:06 -07:00
Aleix Conchillo Flaqué
83a4c7d443
RTVIProcessor: remove unused code
2025-05-13 11:26:37 -07:00
Aleix Conchillo Flaqué
8171fec925
SmallWebRTCConnection: complain if av package not found
2025-05-13 11:26:37 -07:00
Aleix Conchillo Flaqué
175f352ea7
add FrameProcessor.setup() to setup processors before StartFrame
2025-05-13 11:26:35 -07:00
Filipi da Silva Fuchter
5290161ac4
Merge pull request #1746 from pipecat-ai/simple_chatbot-react-native
...
Simple chatbot: React Native client
2025-05-13 10:48:09 -03:00
Filipi Fuchter
8762019ed7
Not setting the local audio level when the user stopped speaking.
2025-05-13 10:46:30 -03:00
Filipi Fuchter
61a59fa158
Fixing useNavigation typescript warning.
2025-05-13 10:36:39 -03:00
Filipi Fuchter
55eea20c8e
Renaming expo environment variable
2025-05-13 10:32:27 -03:00
kompfner
9a621f0c54
Merge pull request #1805 from pipecat-ai/pk/aws-nova-sonic-aggregate-user-transcription-text
...
AWS Nova Sonic service - aggregate user transcription text; it was fr…
2025-05-13 09:13:58 -04:00
Paul Kompfner
55fc24e933
AWS Nova Sonic service - aggregate user transcription text; it was fragmented across many conversation history messages before
2025-05-13 09:13:28 -04:00
Filipi da Silva Fuchter
b14608f09b
Merge pull request #1799 from pipecat-ai/daily_audio_source
...
Using audio source for capturing Daily's participant audio
2025-05-13 08:15:10 -03:00
Mark Backman
4a25c57337
Merge pull request #1806 from pipecat-ai/aleix/run-test-observers
...
tests: allow passing observers to run_test()
2025-05-12 22:10:44 -04:00
Aleix Conchillo Flaqué
f800e35ccb
tests: allow passing observers to run_test()
2025-05-12 17:53:02 -07:00
Vanessa Pyne
12d49a9b9d
Merge pull request #1801 from pipecat-ai/vp-fix-typo
...
update examples
2025-05-12 15:33:56 -05:00
vipyne
b25b251a44
update examples
2025-05-12 14:07:17 -05:00
Mattie Ruth
64b2a75a94
Update Modal App: ( #1755 )
...
* Update Modal App:
Updated Modal App to include:
1. Latest Modal API usage
2. Ability to launch different Pipecat pipelines, much like the
simple chatbot example
3. Ability to choose which pipeline is launched via the
/connect endpoint
4. Added a pipeline option for connecting to a self-hosted LLM
on Modal
5. Improved READMEs
6. Added a web client for interacting with the Modal deployment
tmp
* Update README
2025-05-12 12:45:43 -05:00
Aleix Conchillo Flaqué
b33a60f3a5
Merge pull request #1793 from pipecat-ai/khk/deepgram-async-fix
...
Fix Deepgram TTS streaming
2025-05-12 09:59:46 -07:00
Filipi Fuchter
d22dbb1a6d
Fixing ruff format.
2025-05-12 10:36:21 -03:00
Filipi Fuchter
983199a6cd
New example capturing the audio from the participant using the custom audio source.
2025-05-12 10:18:43 -03:00
Filipi Fuchter
133d7ee33a
Fixing the default audio source for capture_participant_audio
2025-05-12 10:16:32 -03:00
Mark Backman
0bd888afc7
Merge pull request #1796 from nikp06/patch-1
...
Wrong deprecation warning when importing ai_services.py
2025-05-12 09:12:48 -04:00
nikp06
537bd1c58d
Update ai_services.py
...
fix: correct deprecation warning format in ai_services module
2025-05-12 12:01:13 +02:00
Kwindla Hultman Kramer
5ef519fe2c
Fix Deepgram TTS to use stream_raw()
2025-05-11 15:40:31 -07:00
Mark Backman
20498fb47f
Merge pull request #1790 from AngeloGiacco/angelo/fix-api-key
...
[elevenlabs tts ] fix api key
2025-05-10 19:16:27 -04:00
Angelo Giacco
b57dfb3b5d
fix lint
2025-05-10 16:36:26 +01:00
Angelo Giacco
0355ed4aa1
move api key to ws header
2025-05-10 16:34:01 +01:00
Angelo Giacco
1e76cc7bdc
fix: elevenlabs api key
2025-05-10 16:09:20 +01:00
Vanessa Pyne
18c0374126
Merge pull request #1785 from pipecat-ai/vp-small-filenmae-change
...
39-aws-nova-sonic.py -> 40-aws-nova-sonic.py
2025-05-09 12:19:09 -05:00
Aleix Conchillo Flaqué
7072fba7e7
Merge pull request #1780 from pipecat-ai/aleix/deprecate-google-generativeai
...
GoogleLLMService: deprecate google-generativeai
2025-05-09 09:18:30 -07:00
Aleix Conchillo Flaqué
3d702a5c39
minor examples cleanup
2025-05-09 09:16:10 -07:00
Aleix Conchillo Flaqué
f31efa42c9
GoogleLLMService: deprecate google-generativeai
2025-05-09 09:14:43 -07:00
getchannel
d86502e79a
add file_api __init__.py
2025-05-09 10:53:31 -04:00
getchannel
59c7744590
add FileData class events.py
2025-05-09 10:52:04 -04:00
getchannel
949971dea9
Create file_api
2025-05-09 10:51:24 -04:00
getchannel
cd4a893c65
add FileAPI to gemini.py
2025-05-09 10:50:27 -04:00
vipyne
74b369ff20
39-aws-nova-sonic.py -> 40-aws-nova-sonic.py
2025-05-09 08:30:59 -05:00
Filipi Fuchter
46eed0a59a
Bumping to use the latest version of @pipecat-ai/react-native-daily-transport, and removing code not needed.
2025-05-08 18:18:00 -03:00
kompfner
9643296e29
Merge pull request #1779 from pipecat-ai/pk/aws-nova-sonic-missing-params-export
...
Add missing `Params` export to AWS Nova Sonic module
2025-05-08 16:04:38 -04:00
Paul Kompfner
c83c5b5a34
Add missing Params export to AWS Nova Sonic module
2025-05-08 15:23:25 -04:00
Filipi Fuchter
277e2d7fc0
Merge branch 'main' into simple_chatbot-react-native
2025-05-08 09:03:16 -03:00
Mark Backman
7280e390d9
Merge pull request #1774 from pipecat-ai/mb/moondream-ex-server
...
Add load_dotenv to moondream example server
2025-05-07 19:02:30 -04:00
Mark Backman
4efc3f0a39
Merge pull request #1775 from pipecat-ai/mb/patient-ex-env
...
Add load_dotenv to patient-intake server file
2025-05-07 19:02:20 -04:00
Mark Backman
cb7e7a8aa3
Add load_dotenv to patient-intake server file
2025-05-07 18:40:04 -04:00
Mark Backman
9136402846
Add load_dotenv to moondream example server
2025-05-07 18:29:27 -04:00
Filipi Fuchter
56ca7360ae
Fixing versions
2025-05-05 19:11:59 -03:00
Filipi Fuchter
d5ab3251f0
Bumping the dependencies, updating readme, adding .gitignore.
2025-05-05 18:43:04 -03:00
Filipi Fuchter
915c284420
Fixing readme
2025-05-05 18:32:04 -03:00
Filipi Fuchter
40154824e8
Creating a RN example for simple-chatbot
2025-05-05 18:17:39 -03:00
Jin Kim
cf2f249f8a
Use "use_original_timestamps" only for sonic-2 model
2025-04-27 19:33:14 +09:00
fatwang2
8cda4512ad
Merge branch 'pipecat-ai:main' into main
2025-02-06 10:50:25 +08:00
fatwang2
fc90bdc638
changed to HailuoHttpTTSService
2025-01-19 09:43:48 +08:00
fatwang2
5a88165a26
Merge branch 'pipecat-ai:main' into main
2025-01-19 09:40:08 +08:00
fatwang2
3466842cd4
add hailuo tts service
2025-01-17 12:46:05 +08:00