Aleix Conchillo Flaqué
ab61d09ec1
Merge pull request #2502 from pipecat-ai/aleix/pipecat-0.0.81
...
update CHANGELOG for 0.0.81
2025-08-25 09:28:21 -07:00
Aleix Conchillo Flaqué
e4afc0a13c
update CHANGELOG for 0.0.81
2025-08-25 08:22:28 -07:00
Mark Backman
dde3d2395b
Merge pull request #2491 from pipecat-ai/mb/update-quickstart
2025-08-23 06:34:37 -07:00
Aleix Conchillo Flaqué
30b36c3d6e
Merge pull request #2497 from pipecat-ai/aleix/pipeline-task-fix-cancellation
...
PipelineTask: handle cancellations gracefully
2025-08-22 22:37:12 -07:00
Mark Backman
de4dfc3ed4
Update deployment steps
2025-08-23 00:19:26 -04:00
Aleix Conchillo Flaqué
a0128516ff
PipelineTask: handle cancellations gracefully
2025-08-22 19:04:31 -07:00
Aleix Conchillo Flaqué
db3b8c7325
Merge pull request #2496 from pipecat-ai/aleix/release-evals-always-provide-eval-prompt
...
scripts(evals): always require an eval prompt
2025-08-22 18:11:33 -07:00
Aleix Conchillo Flaqué
9273ec0f25
scripts(evals): always require an eval prompt
2025-08-22 16:57:47 -07:00
Mark Backman
8dfa1187be
Merge pull request #2402 from pipecat-ai/mb/voicemail-detection
...
Add voicemail detection
2025-08-22 14:51:13 -07:00
Mark Backman
e17fd580c6
Update README
2025-08-22 15:56:56 -04:00
mattie ruth backman
3e3d50a855
Fix issue with request images from the camera introduced in smallwebrtctransport
2025-08-22 15:02:33 -04:00
Mark Backman
402661ae03
Prevent user speaking frames from entering the classifier branch after a conversation is detected
2025-08-22 14:09:45 -04:00
Mark Backman
69c6a95b8a
Simplify frames in the NotifierGate
2025-08-22 14:09:45 -04:00
Mark Backman
4d49210a73
Rename system_prompt to custom_system_prompt; improve dev ex for classification prompt requirements
2025-08-22 14:09:45 -04:00
Aleix Conchillo Flaqué
5f8a22ef2f
Merge pull request #2493 from pipecat-ai/aleix/runner-task-asyncio-cancellation
...
PipelineRunner/PipelineTask: fix asyncio task cancellation
2025-08-22 09:13:58 -07:00
Aleix Conchillo Flaqué
606ad0826a
Merge pull request #2492 from pipecat-ai/aleix/wait-for-task-deprecated
...
FrameProcessor: wait_for_task is now deprecated
2025-08-22 09:13:34 -07:00
Mark Backman
57028255ee
Update changelog, mention text LLMs only
2025-08-22 12:12:17 -04:00
Mark Backman
87ebbab758
Only set/clear voicemail_event when voicemail is detected
2025-08-22 12:12:17 -04:00
Mark Backman
bd401e8d6f
Rename TTSBuffer to TTSGate
2025-08-22 12:12:17 -04:00
Mark Backman
f0dfab23e7
Cleanup
2025-08-22 12:12:17 -04:00
Mark Backman
fbc907c371
Change path to extensions
2025-08-22 12:12:17 -04:00
Mark Backman
40b5ef485d
Add base NotifierGate class and ClassifierGate, ConversationGate subclasses
2025-08-22 12:12:17 -04:00
Mark Backman
b30af3e155
Tests specify USER_SPEAKS_FIRST or BOT_SPEAKS_FIRST
2025-08-22 12:12:17 -04:00
Mark Backman
446bb5cddf
Refactor callback to event
2025-08-22 12:12:17 -04:00
Mark Backman
1c1ee94074
Add 44 to evals, update evals to support user speaking first
2025-08-22 12:12:17 -04:00
Mark Backman
ac30083b45
Add CHANGELOG entry
2025-08-22 12:12:17 -04:00
Mark Backman
ce579d4266
Make on_voicemail_detected callback required, cleanup logging
2025-08-22 12:12:17 -04:00
Mark Backman
5a07b30c7a
Class name changes, add TTSStarted/StoppedFrame to the TTSBuffer
2025-08-22 12:12:17 -04:00
Mark Backman
9da33f3897
Handle multiple user inputs from the user when a voicemail is detected; add a configurable timeout to emitting the callback
2025-08-22 12:12:17 -04:00
Mark Backman
5ca82ec61e
Final docstrings, comments, and cleanup
2025-08-22 12:12:17 -04:00
Mark Backman
0067c7df47
Add aggregation to classifier LLM output and validate prompt
2025-08-22 12:12:17 -04:00
Mark Backman
ab03db5b0c
Updated prompt, add custom system_prompt input
2025-08-22 12:12:17 -04:00
Mark Backman
238d6bf9ab
Add buffering logic
2025-08-22 12:12:17 -04:00
Mark Backman
90ae85bab2
More updates—added new voicemail module
2025-08-22 12:12:17 -04:00
Mark Backman
29e09b2053
POC demo in progress
2025-08-22 12:12:17 -04:00
mattie ruth backman
bad9977e8c
PR feedback and more explicit about only supporting exporting 1 video
2025-08-22 11:24:22 -04:00
mattie ruth backman
b987579d54
update smallWebRTC screen support to support the utils format for listening to screenshares
2025-08-22 11:24:22 -04:00
mattie ruth backman
40f1f4ff11
Add support to smallWebRTCTransport for receiving screenshare videos
2025-08-22 11:24:22 -04:00
Aleix Conchillo Flaqué
a3ad31d0f6
README: recommended python version is 3.12
2025-08-21 23:50:00 -07:00
Aleix Conchillo Flaqué
8044c4170d
PipelineRunner/PipelineTask: fix asyncio task cancellation
2025-08-21 23:50:00 -07:00
Aleix Conchillo Flaqué
bc51e7abc6
FrameProcessor: wait_for_task is now deprecated
2025-08-21 21:17:47 -07:00
Aleix Conchillo Flaqué
256ecf4d71
Merge pull request #2490 from pipecat-ai/aleix/speechmatics-exceptions
...
Speechmatics exception handling
2025-08-21 19:48:43 -07:00
Aleix Conchillo Flaqué
c16969c4f5
Merge pull request #2489 from pipecat-ai/aleix/daily-python-0.19.7
...
pyproject: update daily-python to 0.19.7
2025-08-21 19:48:31 -07:00
Mark Backman
8ef64d8c8d
Update quickstart, make it deployable
2025-08-21 22:32:34 -04:00
Aleix Conchillo Flaqué
4947d08733
GladiaSTTService: update loggin levels
2025-08-21 18:42:23 -07:00
Aleix Conchillo Flaqué
b61846534d
SpeechmaticsSTTService: improve exception handling and loggin
2025-08-21 18:42:23 -07:00
Aleix Conchillo Flaqué
8f01cd220a
pyproject: update daily-python to 0.19.7
2025-08-21 18:40:01 -07:00
Aleix Conchillo Flaqué
3abaaf80e0
Merge pull request #2487 from pipecat-ai/aleix/watchdog-timers-removal
...
remove watchdog timers and specific asyncio implementations
2025-08-21 18:37:35 -07:00
Aleix Conchillo Flaqué
13890fa021
github(tests): use python 3.12 to run unit tests/coverage
2025-08-21 18:09:56 -07:00
Aleix Conchillo Flaqué
802af28888
update pytest-asyncio to 1.1.0
2025-08-21 18:09:56 -07:00
Aleix Conchillo Flaqué
24a628c85e
remove watchdog timers and specific asyncio implementations
...
Watchdog timers have been removed. They were introduced in 0.0.72 to help
diagnose pipeline freezes. Unfortunately, they proved ineffective since they
required developers to use Pipecat-specific queues, iterators, and events to
correctly reset the timer, which limited their usefulness and added friction.
2025-08-21 18:09:56 -07:00
Mark Backman
ddab95835b
Merge pull request #2474 from pipecat-ai/mb/add-frames-pipeline-idle
...
Add UserStarted/StoppedSpeakingFrames to idle_timeout_frames
2025-08-21 03:45:46 -07:00
Mark Backman
cb13f4b4cb
Add user speaking and transcription frames to idle_timeout_frames
2025-08-21 06:43:10 -04:00
Aleix Conchillo Flaqué
4793277d34
Merge pull request #2480 from pipecat-ai/aleix/replace-asyncio-waitfor
...
replace asyncio.wait_for for wait_for2.wait_for
2025-08-20 17:43:32 -07:00
Aleix Conchillo Flaqué
28c729cc36
replace asyncio.wait_for for wait_for2.wait_for
2025-08-20 15:26:57 -07:00
Aleix Conchillo Flaqué
4d07c7b77c
Merge pull request #2479 from pipecat-ai/aleix/simplify-dtmf-aggregator
...
DTMFAggregator: no need for interruption task
2025-08-20 15:15:35 -07:00
Aleix Conchillo Flaqué
4ff0567025
BaseObject: allow keyword arguments
2025-08-20 15:14:31 -07:00
Aleix Conchillo Flaqué
1377dec01b
DTMFAggregator: no need for interruption task
...
Now that system frames are queued there's no need to have an additional task to
push a `BotInterruptionFrame`.
2025-08-20 14:35:04 -07:00
Aleix Conchillo Flaqué
42f4d73a63
Merge pull request #2478 from pipecat-ai/aleix/fix-wait-for2-import
...
timeout: fix wait_for2 import
2025-08-20 14:29:19 -07:00
Aleix Conchillo Flaqué
f1c1ebf852
timeout: fix wait_for2 import
2025-08-20 14:24:16 -07:00
Aleix Conchillo Flaqué
eb6d43f6cb
Merge pull request #2476 from pipecat-ai/aleix/add-asyncio-timeout
...
implement custom asyncio.wait_for()
2025-08-20 14:20:22 -07:00
Aleix Conchillo Flaqué
f387776985
add custom asyncio.wait_for()
...
This patch uses `wait_for2` package to implement `asyncio.wait_for()` for
Python < 3.12.
In Python 3.12, `asyncio.wait_for()` is implemented in terms of
`asyncio.timeout()` which fixed a bunch of issues. However, this was never
backported (because of the lack of `async.timeout()`) and there are still many
remainig issues, specially in Python 3.10, in `async.wait_for()`.
See https://github.com/python/cpython/pull/98518
2025-08-20 14:09:05 -07:00
Aleix Conchillo Flaqué
5286591826
Merge pull request #2464 from pipecat-ai/aleix/frame-processor-updates
...
various frame processor updates
2025-08-20 10:11:49 -07:00
Aleix Conchillo Flaqué
6831e63ec9
PipelineTask: use PipelineSource/PipelineSink and remove tasks
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
12bcb7db64
ParallelPipeline: use PipelineSource/PipelineSink and remove tasks
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
1b48b1d860
Pipeline: allow passing user source and sink processors
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
d161e2767f
FrameProcessor: allow pausing/resuming system frames
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
4e3af00b6d
tests: try to use default SleepFrame time
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
4015aedb86
tests: fix unit tests
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
75a6ee839b
BaseObserver: added new on_process_frame
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
13ce02c896
FrameProcessor: add new entry_processors() method
2025-08-20 10:08:54 -07:00
Aleix Conchillo Flaqué
2fd5885dc3
pipeline: implement processors property
2025-08-20 07:40:21 -07:00
Aleix Conchillo Flaqué
d743586bfb
BasePipeline: move processors_with_metrics() to FrameProcessor
2025-08-20 07:40:21 -07:00
Aleix Conchillo Flaqué
8051017895
pipeline: wrap with pipelines, use direct mode and reduce tasks
2025-08-20 07:40:21 -07:00
Aleix Conchillo Flaqué
dc7bf98ce5
Pipeline: improve performance by using direct mode
2025-08-20 07:40:21 -07:00
Aleix Conchillo Flaqué
609a43a191
FrameProcessor: added processors/next/previous properties
2025-08-20 07:40:19 -07:00
Aleix Conchillo Flaqué
4fb04422d9
FrameProcessor: remove unused set_parent/get_parent
2025-08-20 07:40:02 -07:00
Mark Backman
2f74a7e674
Merge pull request #2469 from pipecat-ai/mb/11labs-text-normalization
...
Add apply_text_normalization to ElevenLabs TTS services
2025-08-19 18:21:33 -07:00
Mark Backman
5205f56087
Add apply_text_normalization to ElevenLabs TTS services
2025-08-19 21:19:00 -04:00
Mark Backman
694c792af3
Merge pull request #2470 from pipecat-ai/mb/11labs-settings-reconnect
...
Update ElevenLabsTTSService: update runtime configuration
2025-08-19 18:18:14 -07:00
Mark Backman
406e82a842
Merge pull request #2438 from pipecat-ai/mb/delete-old-docs
...
Remove stale docs
2025-08-19 12:22:54 -07:00
Mark Backman
837de5f893
Merge pull request #2468 from pipecat-ai/mb/fix-mistral-docs-errors
...
Fix Mistral docstrings build errors
2025-08-19 12:22:26 -07:00
Mark Backman
10b9b1da2f
Merge pull request #2471 from pipecat-ai/mb/add-13j
...
Add foundational 13j for Azure STT
2025-08-19 12:10:03 -07:00
Mark Backman
7854a2ec83
Add foundational 13j for Azure STT
2025-08-19 14:36:31 -04:00
Mark Backman
ac7c69078f
Merge pull request #2442 from pipecat-ai/mb/retry-completion
...
retry_on_timeout: Anthropic, AWS Bedrock
2025-08-19 11:23:43 -07:00
Mark Backman
c9b4356ea6
Update changelog
2025-08-19 14:21:18 -04:00
Mark Backman
b3e4421191
Add retry_on_timeout to AWSBedrockLLMService
2025-08-19 14:20:35 -04:00
Mark Backman
84058c3948
Add retry_on_timeout to AnthropicLLMService
2025-08-19 14:20:35 -04:00
Mark Backman
aebc781419
Update ElevenLabsTTSService to update when voice_settings change
2025-08-19 13:51:10 -04:00
Mark Backman
4160446f4c
Update ElevenLabsTTSService: reconnect on model and language changes
2025-08-19 11:32:54 -04:00
Mark Backman
05a14af184
Fix Mistral docstrings build errors
2025-08-19 10:31:03 -04:00
Filipi da Silva Fuchter
89d2ef2bde
Merge pull request #2465 from pipecat-ai/filipi/heygen_changing_log_level
...
Changing heygen log level to trace.
2025-08-19 07:50:11 -03:00
Filipi Fuchter
f550015efb
Changing heygen log level to trace.
2025-08-18 18:00:25 -03:00
Mark Backman
8fa44863fb
Merge pull request #2455 from pipecat-ai/vp-log-line
...
log: add Disconnected from ElevenLabs debug log
2025-08-15 14:12:28 -07:00
vipyne
088cb56922
log: add Disconnected from ElevenLabs debug log
2025-08-15 15:05:07 -05:00
Aleix Conchillo Flaqué
a789e5feea
Merge pull request #2451 from pipecat-ai/aleix/audio-buffer-processor-overlap
...
AudioBufferProcessor: fix overlap when buffer size is set
2025-08-14 15:31:50 -07:00
Aleix Conchillo Flaqué
16ca44131c
Merge pull request #2452 from pipecat-ai/aleix/runner-daily-direct-handlesigint
...
Runner: set handle_sigint to True for Daily direct
2025-08-14 15:25:05 -07:00
Mark Backman
418860cf26
Merge pull request #2450 from pipecat-ai/mb/fix-openai-changelog-entry
...
fix: Move OpenAI retry changelog entry to the correct release
2025-08-14 15:23:00 -07:00
Aleix Conchillo Flaqué
e2fc8b3dce
Runner: set handle_sigint to True for Daily direct
2025-08-14 14:55:52 -07:00
Aleix Conchillo Flaqué
8b641089f8
AudioBufferProcessor: fix overlap when buffer size is set
2025-08-14 14:44:08 -07:00
Mark Backman
d36ed755ce
fix: Move OpenAI retry changelog entry to the correct release
2025-08-14 17:34:35 -04:00
Mark Backman
7aaf64fe55
Merge pull request #2447 from pipecat-ai/mb/update-foundational-readme
...
Improve the foundational example README
2025-08-14 09:51:01 -07:00
Mark Backman
5f52008974
Improve the foundational example README
2025-08-14 11:29:04 -04:00
Mark Backman
d520677b23
Merge pull request #2408 from pipecat-ai/mb/add-mistral-llm
...
Add MistralLLMService
2025-08-14 08:19:18 -07:00
Mark Backman
42bd1e9d40
Add Mistral to README and pyproject.toml
2025-08-14 11:15:52 -04:00
Mark Backman
7f0494aa04
Override build_chat_completion_params for Mistral
2025-08-14 10:32:18 -04:00
Mark Backman
b7ae2989ac
Add foundational 14w-function-calling.py
2025-08-14 10:00:46 -04:00
Mark Backman
2b2b0f8121
Add MistralLLMService
2025-08-14 09:57:14 -04:00
Mark Backman
5ca33a2b00
Merge pull request #2445 from pipecat-ai/mb/fix-changelog-asyncai
...
fix: Changelog for Async AI bugfix
2025-08-14 06:48:08 -07:00
Mark Backman
938dcb613d
fix: Changelog for Async AI bugfix
2025-08-14 09:13:03 -04:00
Mark Backman
bc748cf9d0
Merge pull request #2444 from ashotbagh/fix/asyncai-force-flush
...
fix(asyncai): force flush WS TTS to eliminate stalls
2025-08-14 06:10:16 -07:00
Ashot
3b55d16a49
fix(asyncai): force flush WS TTS to eliminate stalls
2025-08-14 16:34:34 +04:00
Mark Backman
d7f31e0cbd
Merge pull request #2387 from pipecat-ai/mb/retry-chat-completion
...
Retry chat completions for OpenAILLMService and its subclasses
2025-08-13 14:39:40 -07:00
Mark Backman
c662a2d820
Merge pull request #2437 from pipecat-ai/mb/19-english
...
Foundational 19: Respond in English
2025-08-13 11:57:24 -07:00
Mark Backman
2c220ca54e
Remove stale docs
2025-08-13 14:11:41 -04:00
Mark Backman
89f0ff17c0
Merge pull request #2430 from pipecat-ai/aleix/pipecat-0.0.80
...
update CHANGELOG for 0.0.80
2025-08-13 09:41:43 -07:00
Mark Backman
b5465364fa
Foundational 19: Respond in English
2025-08-13 12:37:13 -04:00
Aleix Conchillo Flaqué
c024eb7b8c
update CHANGELOG for 0.0.80
2025-08-13 11:46:24 -04:00
Mark Backman
608570e89d
Merge pull request #2433 from pipecat-ai/mb/openai-realtime-text-modality
...
fix: Add text support to OpenAIRealtimeBetaLLMService
2025-08-13 08:41:33 -07:00
Mark Backman
3ad61a8a04
Remove stray - in changelog
2025-08-13 11:39:59 -04:00
Mark Backman
4c4bae2db6
Remove unnessecary messages from 19 and 19b examples
2025-08-13 11:39:59 -04:00
Mark Backman
901b6b5913
Add foundational 19b
2025-08-13 11:37:38 -04:00
Mark Backman
71cd0f1c87
fix: Add text support to OpenAIRealtimeBetaLLMService
2025-08-13 11:37:36 -04:00
Filipi da Silva Fuchter
a2a419e6db
Merge pull request #2435 from pipecat-ai/filipi/small_webrtc_end_pipeline
...
Fixed an issue where `SmallWebRTCTransport` ended before TTS finished.
2025-08-13 11:58:33 -03:00
Filipi Fuchter
bbbbdc459a
Fixed an issue where SmallWebRTCTransport ended before TTS finished.
2025-08-13 11:46:51 -03:00
Mark Backman
d203528dad
Merge pull request #2333 from yohan-altrium/fix/2277-azure-tts-ssml-reserved-characters
...
Fixes 2277 - SSML reserved characters causes Azure TTS to fail
2025-08-13 06:27:30 -07:00
Yohan Liyanage
4bcca7956e
Refactors the code based on PR comments and adds the relevant changelog entry.
2025-08-13 16:34:33 +05:30
Aleix Conchillo Flaqué
68a4cf4c68
Merge pull request #2427 from pipecat-ai/aleix/base-watchdog-priority-queue
...
WatchdogPriorityQueue: this is now a base class
2025-08-12 18:25:59 -07:00
Aleix Conchillo Flaqué
0508ddddfb
WatchdogPriorityQueue: fix watchdog sentinel insertion
...
We now force each inserted item in the priority queue to be a tuple and the
actual value to be last in the tuple. All the previous values in the tuple also
need to be numeric.
2025-08-12 17:40:58 -07:00
Mark Backman
8714c9137f
Code review fixes
2025-08-12 17:49:13 -04:00
Mark Backman
4c029fcfa7
Update OpenAILLMService subclasses to use the new build_chat_completion_params function
2025-08-12 17:48:51 -04:00
Mark Backman
5c86f8e687
Add timeout/retry logic and refactor parameter building in BaseOpenAILLMService
...
- Add timeout (default 5.0s) and retry_on_timeout parameters to constructor
- Implement timeout/retry logic in get_chat_completions using asyncio.wait_for
- Extract build_chat_completion_params() as public method for subclass customization
2025-08-12 17:48:51 -04:00
Mark Backman
54a4d8a9f8
Merge pull request #2422 from thsunkid/thu/fix-set-lang-in-base-whisper
...
Fix: assigns string code instead of Language enum to BaseWhisperSTTService._language
2025-08-12 11:57:46 -07:00
Mark Backman
38af514d95
Merge pull request #2407 from pipecat-ai/mb/add-gemini-tts
...
Add GeminiTTSService
2025-08-12 11:56:45 -07:00
Aleix Conchillo Flaqué
6aa80c0b8e
Merge pull request #2424 from pipecat-ai/aleix/system-frame-queues-fix
...
FrameProcessor: fix race condition on FrameProcessorQueue
2025-08-12 11:56:00 -07:00
Mark Backman
e720573e60
Added 07n-interruptible-gemini
2025-08-12 14:54:49 -04:00
Mark Backman
541a43905b
Add GeminiTTSService
2025-08-12 14:52:20 -04:00
Aleix Conchillo Flaqué
707df913cd
FrameProcessor: fix race condition on FrameProcessorQueue
...
We need to increment the counters before the await otherwise we could go to a
different task that could add an item with the same counter.
Also, we need to handle non-frame items as well.
2025-08-12 11:48:22 -07:00
Aleix Conchillo Flaqué
3f3d757581
tests: added WatchdogQueue and WatchdogPriorityQueue unit tests
2025-08-12 11:48:22 -07:00
Aleix Conchillo Flaqué
7c781ce816
WatchdogPriorityQueue: make WatchdogPriorityCancelSentinel public
2025-08-12 11:34:31 -07:00
Aleix Conchillo Flaqué
f3efc9da00
WatchdogQueue: make WatchdogQueueCancelSentinel public
2025-08-12 11:34:31 -07:00
Mark Backman
827a70104d
Merge pull request #2425 from pipecat-ai/mb/runner-add-exotel
...
Add Exotel support to the development runner
2025-08-12 10:36:54 -07:00
Mark Backman
a40327305c
Add Exotel support to the development runner
2025-08-12 13:21:18 -04:00
Thu Nguyen
168af44429
Fix: assigns string code instead of Language enum to _language attr of BaseWhisperSTTService
2025-08-12 20:27:26 +07:00
Mark Backman
5f8433476c
Merge pull request #2397 from gladiaio/PLA-37-GladiaSTTService-minor-tweaks
...
feat: add minor tweaks to GladiaSTTService
2025-08-12 04:59:40 -07:00
Fabrice Lamant
6a6fea74f5
fix: set default region to none
2025-08-12 13:31:51 +02:00
Mark Backman
91b557ecbf
Merge pull request #2419 from pipecat-ai/mb/fix-lockfile-workflow
2025-08-12 03:39:54 -07:00
Mark Backman
be85291414
Merge pull request #2420 from pipecat-ai/mb/runner-handle-sigint-default
2025-08-12 03:39:29 -07:00
Fabrice Lamant
09f171b69d
fix: only pass region if set
2025-08-12 12:05:38 +02:00
Aleix Conchillo Flaqué
929fd98958
Merge pull request #2416 from pipecat-ai/aleix/release-evals-vision
...
scripts(evals): add vision support
2025-08-11 20:08:08 -07:00
Aleix Conchillo Flaqué
1cfbfcaf11
scripts(evals): add vision support
2025-08-11 20:06:24 -07:00
Mark Backman
cd5a3c13bd
Development runner: handle_sigint defaults to False
2025-08-11 22:06:56 -04:00
Mark Backman
9b871b0cc5
Update uv.lock, remove lockfile workflow, update CONTRIBUTING with dependency guidance
2025-08-11 21:39:25 -04:00
Mark Backman
0d499a8aa3
Merge pull request #2409 from pipecat-ai/mb/refactor-playht-http
...
Refactor PlayHTHttpTTSService to use aiohttp
2025-08-11 18:20:58 -07:00
Mark Backman
45292ab13d
Merge pull request #2411 from pipecat-ai/mb/fix-websocket-service-retry
...
fix: WebsocketService retry logic incorrectly handling ConnectionClos…
2025-08-11 18:17:50 -07:00
Mark Backman
be6ea0dbf6
Code review feedback
2025-08-11 21:17:04 -04:00
Aleix Conchillo Flaqué
fb18ae174e
Merge pull request #2417 from pipecat-ai/aleix/release-evals-15-series
...
scripts(evals): add multilinguag support and 15 series
2025-08-11 17:14:47 -07:00
Mark Backman
c4506523ab
Refactor PlayHTHttpTTSService to use aiohttp
2025-08-11 19:58:25 -04:00
Aleix Conchillo Flaqué
b360cb31dc
scripts(evals): add multilinguag support and 15 series
2025-08-11 15:21:14 -07:00
Aleix Conchillo Flaqué
07f104199c
Merge pull request #2415 from pipecat-ai/aleix/moondream-2025-01-09
...
MoondreamService: update to revision 2025-01-09
2025-08-11 15:10:35 -07:00
Aleix Conchillo Flaqué
bc1949b4bf
MoondreamService: update to revision 2025-01-09
2025-08-11 14:54:04 -07:00
Aleix Conchillo Flaqué
2035dd8b39
Merge pull request #2403 from pipecat-ai/aleix/system-frame-queue-priority-fix
...
FrameProcessor: fix system frame higher priorty and use a PriortyQueue
2025-08-11 13:57:57 -07:00
Aleix Conchillo Flaqué
24c8189327
Merge pull request #2405 from pipecat-ai/aleix/frame-processor-direct-mode
...
FrameProcessor: introduce direct mode
2025-08-11 13:57:34 -07:00
Mark Backman
998ac32627
Merge pull request #2413 from captaincaius/fix-stt-mute-filter-vad-frames-20250810
...
Add VADUserStartSpeakingFrame VADUserStopSpeakingFrame to STTMuteFilter (fix #2412 )
2025-08-11 13:54:34 -07:00
Aleix Conchillo Flaqué
50645c1c4f
README: recommend python 3.11-3.12
...
Python 3.11 has significant performance improvements compared to 3.10 which
makes Pipecat's asyncio heavy use specially better.
2025-08-11 13:53:08 -07:00
Aleix Conchillo Flaqué
8ce29ee8f2
FrameProcessor: fix system frame higher priorty and use a PriortyQueue
2025-08-11 13:53:08 -07:00
Captain Caius
7b8aeef4cc
update changelog
2025-08-11 12:45:54 -07:00
Aleix Conchillo Flaqué
6a24457f0e
FrameProcessor: introduce direct mode
...
Direct mode avoids creating internal queues and tasks and processes frames right
away. This might be useful for some very simple processors.
2025-08-11 09:26:31 -07:00
Aleix Conchillo Flaqué
2c01c2b5b3
Merge pull request #2404 from pipecat-ai/aleix/examples-22-simplify-main-pipeline
...
examples(foundational): update 22 series with simple main pipelines
2025-08-11 09:14:39 -07:00
Aleix Conchillo Flaqué
1c2e114fa2
examples(foundational): update 22 series with simple main pipelines
2025-08-11 09:13:09 -07:00
Filipi da Silva Fuchter
0f137e36c2
Merge pull request #2399 from pipecat-ai/filipi/heygen_latency
...
Improving the latency of the `HeyGenVideoService`.
2025-08-11 09:13:10 -03:00
Filipi Fuchter
b7f12a96f1
Improving the latency of the HeyGenVideoService.
2025-08-11 09:11:17 -03:00
Filipi da Silva Fuchter
3331f71e17
Merge pull request #2398 from pipecat-ai/filipi/ttfb_metrics_video_services
...
Added TTFB metrics for `HeyGenVideoService` and `TavusVideoService`.
2025-08-11 09:09:27 -03:00
Filipi Fuchter
55d200e2d1
Added TTFB metrics for HeyGenVideoService and TavusVideoService.
2025-08-11 09:07:21 -03:00
Captain Caius
3fae00e067
Add VADUserStartSpeakingFrame VADUserStopSpeakingFrame to STTMuteFilter
2025-08-10 19:35:04 -07:00
Mark Backman
78cdefd191
Merge pull request #2410 from smokyabdulrahman/issue-2373
...
Support endpoint_id for AzureSTTService
2025-08-10 16:43:29 -07:00
Mark Backman
42502a4f3b
fix: WebsocketService retry logic incorrectly handling ConnectionClosedOK exception
2025-08-10 19:35:05 -04:00
Abdulrahman Alrahma
fc67cc3302
Support endpoint_id for AzureSTTService
2025-08-10 22:24:47 +01:00
Aleix Conchillo Flaqué
241ab19228
update uv.lock with numba dependency
2025-08-08 15:12:55 -07:00
Mark Backman
c08e8ec8fb
Merge pull request #2391 from pipecat-ai/mb/readme-local-dev
...
Update README with local dev setup for contributors
2025-08-08 11:15:58 -07:00
Mark Backman
eb9bc9644e
Merge pull request #2400 from pipecat-ai/mb/pin-numba-0.61.2
...
fix: pin numba to >=0.61.2
2025-08-08 11:15:22 -07:00
Mark Backman
3a306dae90
fix: pin numba to >=0.61.2
2025-08-08 10:52:47 -04:00
Fabrice Lamant
e503ea7466
feat: add minor tweaks to GladiaSTTService
2025-08-08 10:21:52 +02:00
Mark Backman
c42cc8254f
Update README with local dev setup for contributors
2025-08-07 22:07:35 -04:00
Aleix Conchillo Flaqué
a8e21f7d5d
Merge pull request #2395 from pipecat-ai/aleix/examples-15-inherit-parallel-pipeline
...
examples(foundational): move 15/15a logic into its own processor
2025-08-07 17:59:28 -07:00
Aleix Conchillo Flaqué
c6ef8de578
scripts(evals): fix 14v-function-calling-openai.py
2025-08-07 17:57:47 -07:00
Aleix Conchillo Flaqué
fc571fba42
examples(foundational): move 15/15a logic into its own processor
2025-08-07 17:57:47 -07:00
Mark Backman
0502ee2b5a
Merge pull request #2394 from pipecat-ai/mb/uv-lock
...
Update uv.lock
2025-08-07 15:25:38 -07:00
Mark Backman
9ec047094b
Update uv.lock
2025-08-07 18:24:47 -04:00
Mark Backman
d991c106c8
Merge pull request #2393 from pipecat-ai/mb/openai-dep
...
fix: pin openai package upper bound to <=1.99.1
2025-08-07 15:19:05 -07:00
Mark Backman
312fb23c89
fix: pin openai package upper bound to <=1.99.1
2025-08-07 18:00:25 -04:00
Aleix Conchillo Flaqué
4d7f21d44e
Merge pull request #2392 from pipecat-ai/aleix/avoid-using-tts-say
...
deprecate TTSService.say() method
2025-08-07 13:55:49 -07:00
Aleix Conchillo Flaqué
ec25d0a7c9
examples(foundational): fix 20a-persistent-context-openai
2025-08-07 13:48:32 -07:00
Aleix Conchillo Flaqué
2b8218deaa
examples(foundational): use TTSSpeakFrame instead of TTSService.say()
2025-08-07 13:48:32 -07:00
Aleix Conchillo Flaqué
11119430cd
TTSService: deprecate say() method
2025-08-07 13:48:32 -07:00
kompfner
9ca79232c1
Merge pull request #2380 from pipecat-ai/pk/deprecate-llm-messages-frame
...
Deprecate `LLMMessagesFrame`, `LLMUserResponseAggregator`, and `LLMAssistantResponseAggregator`
2025-08-07 15:13:01 -04:00
Paul Kompfner
9ea06c33f7
Bump deprecation version of LLMMessagesFrame, LLMUserResponseAggregator, and LLMAssistantResponseAggregator (the deprecation slipped past the 0.0.78 release)
2025-08-07 14:56:50 -04:00
Paul Kompfner
30a1dd202e
Move deprecation of LLMMessagesFrame, LLMUserResponseAggregator, and LLMAssistantResponseAggregator into the next release in the changelog
2025-08-07 14:55:11 -04:00
Paul Kompfner
809ab0b7b6
Improve printed deprecation warning
2025-08-07 14:45:35 -04:00
Paul Kompfner
2b5db9c562
Remove redundant deprecation warning in docstring
2025-08-07 14:45:35 -04:00
Paul Kompfner
b4a886b59f
Remove redundant deprecation warning in docstring
2025-08-07 14:45:35 -04:00
Paul Kompfner
07eb00722b
Fix langchain unit test
2025-08-07 14:45:35 -04:00
Paul Kompfner
96652b8fba
Add new deprecations to changelog
2025-08-07 14:45:30 -04:00
Paul Kompfner
df1fcf0c68
Remove unused import
2025-08-07 14:43:37 -04:00
Paul Kompfner
711f740d9e
Update UserResponseAggregator to avoid using the now-deprecated LLMUserResponseAggregator
2025-08-07 14:43:37 -04:00
Paul Kompfner
a0bda98c20
Update langchain to avoid using the now-deprecated LLMMessagesFrame, LLMUserResponseAggregator, and LLMAssistantResponseAggregator
2025-08-07 14:43:37 -04:00
Paul Kompfner
1c1bae35ab
Mention deprecation in docstring for LLMMessagesFrame
2025-08-07 14:43:37 -04:00
Paul Kompfner
56c52c2cf2
Deprecate LLMUserResponseAggregator and LLMAssistantResponseAggregator, which depend on the now-deprecated LLMMessagesFrame.
2025-08-07 14:43:37 -04:00
Paul Kompfner
740aee1a1a
Fix an issue in AnthropicLLMContext where we would never initialize turns_above_cache_threshold if we were upgrading from an OpenAILLMContext.
...
I noticed this when working on 22c-natural-conversation-mixed-llms.py
2025-08-07 14:43:37 -04:00
Paul Kompfner
f0391c3280
Progress on updating foundational examples to avoid using the newly-deprecated LLMMessagesFrame.
...
Skipping over 07b-interruptible-langchain.py for now, as it requires deeper changes involving `LLMUserResponseAggregator` and `LLMAssistantResponseAggregator`.
2025-08-07 14:43:37 -04:00
Paul Kompfner
64e48e4660
Deprecate LLMMessagesFrame.
...
The same functionality can be achieved using either:
- `LLMMessagesUpdateFrame` with the desired messages, with `run_llm` set to `True`
- `OpenAILLMContextFrame` with a new context initialized with the desired messages
2025-08-07 14:43:37 -04:00
Paul Kompfner
b8147bdbbd
Add missing Deepgram key to env.example
2025-08-07 14:43:37 -04:00
Aleix Conchillo Flaqué
315e45d41b
Merge pull request #2389 from pipecat-ai/aleix/pipecat-0.0.78
...
update CHANGELOG for 0.0.78
2025-08-07 11:34:27 -07:00
Aleix Conchillo Flaqué
c057139c48
update CHANGELOG for 0.0.78
2025-08-07 11:14:54 -07:00
Mark Backman
c61e07132d
Merge pull request #2390 from pipecat-ai/mb/optionally-ignore-emulated-speech
...
feat: Add option to ignore emulated user speech while the bot is spea…
2025-08-07 11:14:46 -07:00
Mark Backman
a5f5e418a8
feat: Add option to ignore emulated user speech while the bot is speaking
2025-08-07 14:08:11 -04:00
Mark Backman
31acfaa091
Merge pull request #2388 from pipecat-ai/14v-adding-openai-stt-tts-llm-functioncalling
...
14v adding OpenAI stt tts llm functioncalling
2025-08-07 10:22:35 -07:00
Mark Backman
69541c8835
Linting fix, plus update eval suite with 14v and others, tiny fix for 14m, too
2025-08-07 13:20:45 -04:00
Varun Singh
af94620839
Add OpenAI function calling example with Pipecat
...
Introduces a new example script demonstrating how to use OpenAI's function calling capabilities within a Pipecat pipeline. The example integrates OpenAI STT, TTS, and LLM services, registers a weather function, and sets up a pipeline for real-time audio interaction over WebRTC.
2025-08-07 13:20:45 -04:00
Filipi da Silva Fuchter
cec8a74293
Merge pull request #2386 from pipecat-ai/filipi/parallel_pipeline
...
Only push the StartFrame when all parallel pipelines have processed it
2025-08-07 14:20:30 -03:00
Filipi Fuchter
228a55ac1e
Only push the StartFrame when all parallel pipelines have processed it.
2025-08-07 14:18:21 -03:00
Vanessa Pyne
ab9831daf0
Merge pull request #2382 from pipecat-ai/vp-trace-ignore-message
...
log: warning -> trace for elevenlabs tts unavailable context
2025-08-07 09:35:57 -05:00
Vanessa Pyne
e8c3f5dea6
Update src/pipecat/services/elevenlabs/tts.py
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-08-07 09:23:33 -05:00
Mark Backman
4288b5e780
Merge pull request #2381 from pipecat-ai/aleix/runner-args-pipeline-idle-timeout
...
allow specifying PipelineTask idle timeout to runner arguments
2025-08-07 04:47:08 -07:00
Mark Backman
23343dd7e7
Remove idle_timeout_secs from quickstart
2025-08-07 07:44:21 -04:00
Mark Backman
88de5dd415
Merge pull request #2383 from pipecat-ai/aleix/riva-stt-iterator-exception
...
properly handle concurrent.futures.CancelledError
2025-08-07 04:39:56 -07:00
Mark Backman
33f87589d1
Merge pull request #2384 from pipecat-ai/aleix/release-evals-soniox-inworld-asyncai
...
scripts(evals): added soniox, inworld and asyncai
2025-08-07 04:35:18 -07:00
Aleix Conchillo Flaqué
7ed14ad91f
scripts(evals): added soniox, inworld and asyncai
2025-08-06 23:14:50 -07:00
Aleix Conchillo Flaqué
86c6141580
DailyTransport: handle future cancellation
2025-08-06 23:03:20 -07:00
Aleix Conchillo Flaqué
c97643c797
RivaSTTService: always use WatchdogQueue
2025-08-06 23:00:03 -07:00
Aleix Conchillo Flaqué
434d346079
RivaSTTService: handle future cancellation
2025-08-06 22:59:52 -07:00
vipyne
64ae8d2394
log: warning -> trace for elevenlabs tts unavailable context
2025-08-06 22:40:47 -05:00
Aleix Conchillo Flaqué
786f24c9db
examples(foundational): use RunnerArgs.pipeline_idle_timeout_secs
2025-08-06 19:38:06 -07:00
Aleix Conchillo Flaqué
38951aab56
scripts(evals): use RunnerArguments.pipeline_idle_timeout_secs
2025-08-06 19:37:29 -07:00
Aleix Conchillo Flaqué
ed8b0655a8
scripts(evals): fix runner eval cancellation
...
We need to call asyncio.gather() just once, not for every cancelled task.
2025-08-06 19:36:42 -07:00
Aleix Conchillo Flaqué
0b2b9f5f1b
RunnerArguments: add pipeline_idle_timeout_secs
2025-08-06 19:35:40 -07:00
Filipi da Silva Fuchter
ad1841b739
Merge pull request #2377 from pipecat-ai/filipi/fast_api_freeze_issue
...
Fixed an issue in BaseOutputTransport where the loop could consume all CPU.
2025-08-06 14:58:36 -03:00
Mark Backman
b0c002c128
Merge pull request #2378 from pipecat-ai/mb/pyproject-compat-updates
...
Add new python-compatiblity workflow to check for dependency compatib…
2025-08-06 10:40:29 -07:00
Mark Backman
820176084c
Add support for 3.13 by bumping min version for vllm to 0.9.0, adding support for torch and torchaudio up to the next major version
2025-08-06 13:36:01 -04:00
Mark Backman
5b7e31beff
README updates for python versions
2025-08-06 13:36:01 -04:00
Mark Backman
41a22d3bf4
Add new python-compatiblity workflow to check for dependency compatibility across supported python versions
2025-08-06 13:36:01 -04:00
Filipi Fuchter
84fecabac5
Removing audio sleep from FastAPI and WebSocket server when they are not connected.
2025-08-06 14:02:51 -03:00
Filipi Fuchter
bbe01d10ef
Fixed an issue in BaseOutputTransport where the loop could consume all CPU.
2025-08-06 12:42:58 -03:00
Mark Backman
4364990fd0
Merge pull request #2375 from fabrice404/gladia-region-selection
...
Gladia region selection
2025-08-06 07:01:24 -07:00
Fabrice Lamant
e576fa481f
Add new region feature for GladiaSTTService in CHANGELOG
2025-08-06 15:31:10 +02:00
Mark Backman
ac6b59cae2
Merge pull request #2372 from pipecat-ai/mb/dotenv-dev
...
Wider package support for python-dotenv dev dep
2025-08-06 06:06:01 -07:00
Mark Backman
12e168e740
Wider package support for python-dotenv dev dep
2025-08-06 09:04:01 -04:00
Mark Backman
ac354f66ed
Merge pull request #2371 from pipecat-ai/mb/docs-gen-with-uv
...
Update docs auto-generation to use uv
2025-08-06 06:02:52 -07:00
Mark Backman
eead793927
Merge pull request #2370 from pipecat-ai/mb/update-workflows-for-uv
...
Update workflows for uv
2025-08-06 05:54:55 -07:00
Fabrice Lamant
0594a203fc
Add new region parameter to Gladia
2025-08-06 14:28:06 +02:00
Mark Backman
2337a2d92d
Remove dev-requirements.txt and mentions of it
2025-08-05 21:46:50 -04:00
Mark Backman
b3e2603553
Update workflows for uv
2025-08-05 21:45:48 -04:00
Mark Backman
29229df719
Speed up builds, mocking large packages
2025-08-05 21:34:40 -04:00
Aleix Conchillo Flaqué
61f4dd2ff2
scripts(evals): fix 14e-function-calling-google
2025-08-05 17:44:45 -07:00
Mark Backman
42094fb206
Update docs auto-generation to use uv
2025-08-05 20:37:27 -04:00
Aleix Conchillo Flaqué
58c41f112a
DailyRunnerArguments: make body optional (fix)
2025-08-05 16:59:36 -07:00
Aleix Conchillo Flaqué
fa55e2ca9b
Merge pull request #2369 from pipecat-ai/aleix/pipeline-task-cancellation-fix
...
PipelineTask: always try to cancel things
2025-08-05 16:56:23 -07:00
Aleix Conchillo Flaqué
313fdc92a1
DailyRunnerArguments: make body optional
2025-08-05 16:39:18 -07:00
Aleix Conchillo Flaqué
d22d2da03d
PipelineTask: always try to cancel things
...
In a previous commit we only cleanup things if the user run
`task.cancel()`. However, if the task finishes cleanly we were not cancelling
anything.
2025-08-05 16:24:59 -07:00
Aleix Conchillo Flaqué
de2ae9a2ec
Merge pull request #2368 from pipecat-ai/aleix/release-evals-runner-args-fix
...
pass runner arguments to release evals
2025-08-05 16:23:32 -07:00
Aleix Conchillo Flaqué
52a6d8013c
scripts(evals): pass runner arguments to run_bot()
2025-08-05 16:13:32 -07:00
Aleix Conchillo Flaqué
f14cbae9b5
DailyRunnerArguments: make token optional
...
DailyTransport can get a None token value.
2025-08-05 15:46:12 -07:00
Aleix Conchillo Flaqué
8fe906438a
Merge pull request #2358 from pipecat-ai/aleix/system-frames-queued
...
system frames are now queued
2025-08-05 15:09:52 -07:00
Mark Backman
d8f4db8827
Merge pull request #2367 from richtermb/richtermb/fix-errorframe-docstring
...
Rename 'source' parameter to 'processor' in ErrorFrame class document…
2025-08-05 15:09:18 -07:00
Aleix Conchillo Flaqué
a5ea6e1642
FrameProcessor: system frames are now queued
...
System frames are now queued. Before, system frames could be generated from any
task and would not guarantee any order which was causing undesired
behavior. Also, it was possible to get into some rare recursion issues because
of the way system frames were executed (they were executed in-place, meaning
calling `push_frame()` would finish after the system frame traversed all the
pipeline). This makes system frames more deterministic.
2025-08-05 15:05:50 -07:00
richtermb
e777e78510
Rename 'source' parameter to 'processor' in ErrorFrame class documentation for clarity.
2025-08-05 15:02:00 -07:00
Aleix Conchillo Flaqué
49a5a1e375
PipelineTask: improve task cancellation
2025-08-05 14:49:23 -07:00
Aleix Conchillo Flaqué
61cb45d61b
PipelineTask: also wait on CancelFrame
...
Before CancelFrames didn't need to be waited for because system frames were
processed in-place and therefore calling push_frame() would finalize after it
traversed all the pipeline. Now, system frames are queued so we need to wait
until CancelFrame reaches the end of the pipeline.
2025-08-05 14:49:23 -07:00
Aleix Conchillo Flaqué
6c6deb4e85
Merge pull request #2366 from pipecat-ai/aleix/run-bot-runner-arguments
...
add sigint/sigterm to RunnerArguments
2025-08-05 14:46:19 -07:00
Aleix Conchillo Flaqué
66ad29b2b1
example: pass RunnerArguments to run_bot()
...
This lets us get handle_sigint from RunnerArguments which knows where the
application is running and if SIGINT/SIGTERM should be handled or not.
2025-08-05 14:38:55 -07:00
Aleix Conchillo Flaqué
21e4f0d56d
PipelineRunner: argument ordering
2025-08-05 14:38:55 -07:00
Aleix Conchillo Flaqué
627b44bac2
runner: use new RunnerArguments handle_sigint/handle_sigterm
...
This allow us to control applications behavior from the runner arguments, which
depen on the environment they run.
2025-08-05 14:38:55 -07:00
Aleix Conchillo Flaqué
e2a576beca
RunnerArguments: add handle_sigint/handle_sigterm
2025-08-05 14:32:28 -07:00
Mark Backman
2981afb117
Merge pull request #2361 from pipecat-ai/mb/fix-changelog-simli
...
Fix Simli changelog entry placement
2025-08-05 14:12:38 -07:00
Mark Backman
d422c57b52
Merge pull request #2304 from pipecat-ai/mb/cartesia-cjk-lang-support
...
CartesiaTTSService: Add CJK lang support for word timestamps
2025-08-05 14:08:53 -07:00
Mark Backman
06d8bbd154
Fix Simli changelog entry placement
2025-08-05 17:07:58 -04:00
Mark Backman
35108afeb8
Merge pull request #2360 from pipecat-ai/mb/add-heygen-readme
...
Add HeyGen to the README page
2025-08-05 14:05:33 -07:00
Mark Backman
a0e2a2754a
Merge pull request #2327 from richtermb/richtermb/push-more-error-frames
...
Add source parameter to ErrorFrame and set it in FrameProcessor. Upda…
2025-08-05 14:04:52 -07:00
Mark Backman
b8d620c8bb
Merge pull request #2362 from pipecat-ai/mb/aws-stt-languages
...
AWSTranscribeSTTService add support for new languages
2025-08-05 14:00:50 -07:00
Mark Backman
f26bbe4092
Merge pull request #2363 from pipecat-ai/mb/update-14p
...
Update 14p, add 14p to evals, add Google creds to env.example
2025-08-05 14:00:13 -07:00
Mark Backman
52cb23f8d5
Merge pull request #2364 from pipecat-ai/mb/11labs-default-model
...
ElevenLabs TTS services: revert to Turbo v2.5 as default model
2025-08-05 13:59:59 -07:00
Filipi da Silva Fuchter
17e7f8a2cd
Merge pull request #2352 from pipecat-ai/filipi/webrtc_audio_frame
...
Implementing if the bot it is speaking or not based on the SpeechOutputAudioRawFrame
2025-08-05 17:26:44 -03:00
richtermb
efddc4732c
Refactor ErrorFrame: rename source field to processor for clarity and update related references in FrameProcessor.
2025-08-05 13:25:08 -07:00
richtermb
4476a76ad7
Merge branch 'main' into richtermb/push-more-error-frames
2025-08-05 13:23:24 -07:00
Filipi Fuchter
64592b274b
Fixed an issue where BotStartedSpeakingFrame and BotStoppedSpeakingFrame
...
were not emitted when using `TavusVideoService` or `HeyGenVideoService`.
2025-08-05 17:11:34 -03:00
Aleix Conchillo Flaqué
95c661bdaa
Merge pull request #2365 from pipecat-ai/aleix/update-release-evals-for-new-runner
...
scripts(evals): update to use new runner function
2025-08-05 13:07:57 -07:00
Aleix Conchillo Flaqué
5546c8e01c
scripts(evals): update to use new runner function
2025-08-05 11:46:28 -07:00
Mark Backman
14e02c1b08
ElevenLabs TTS services: revert to Turbo v2.5 as default model
2025-08-05 13:44:37 -04:00
Mark Backman
ba5a5c7187
Update 14p, add 14p to evals, add Google creds to env.example
2025-08-05 13:30:36 -04:00
Mark Backman
2378cba155
AWSTranscribeSTTService add support for new languages
2025-08-05 13:01:06 -04:00
Mark Backman
1138c92a00
Merge pull request #2217 from simliai/main
...
feat: Add Simli Trinity models support to pipecat
2025-08-05 09:01:20 -07:00
Antonyesk601
fb82dc8308
Update CHANGELOG.md
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-08-05 17:46:01 +02:00
Mark Backman
c8a15f30fa
Add HeyGen to the README page
2025-08-05 10:54:49 -04:00
antonyesk601
72168070f1
update changelog
2025-08-05 14:18:41 +00:00
Mark Backman
50083d1144
Merge pull request #2342 from pipecat-ai/mb/runner-connect-request-body
...
Development runner handles body information in the RTVI connect request
2025-08-05 05:15:55 -07:00
Mark Backman
64732518c6
Development runner handles body information in the RTVI connect request
2025-08-05 07:26:34 -04:00
Mark Backman
c3d8ea210f
CartesiaTTSService: Add CJK lang support for word timestamps
2025-08-05 07:17:40 -04:00
Filipi da Silva Fuchter
98ed614f63
Merge pull request #2357 from pipecat-ai/filipi/latency_observer
...
Added detailed latency logging to UserBotLatencyLogObserver.
2025-08-05 08:11:48 -03:00
Filipi Fuchter
e43bdff31e
Added detailed latency logging to UserBotLatencyLogObserver.
2025-08-04 19:36:30 -03:00
Mark Backman
42e48381fe
Merge pull request #2355 from pipecat-ai/mb/update-readme-for-uv
...
Update the README with uv-centric steps
2025-08-04 15:28:07 -07:00
Mark Backman
df7ba64b4a
Merge pull request #2354 from pipecat-ai/mb/revert-43-inline-script
...
Remove inline script from foundational 43a
2025-08-04 15:27:28 -07:00
Mark Backman
ac9b2e67a7
Merge pull request #2349 from pipecat-ai/mb/runner-support-daily-url-arg
...
daily runner util: remove arg parsing, add auto room, token generation
2025-08-04 13:44:25 -07:00
Mark Backman
c9918607cf
Merge pull request #2335 from pipecat-ai/mb/quickstart-runner-improvements
...
Improve quickstart logging, runner startup message
2025-08-04 13:43:42 -07:00
Mark Backman
cfda410a43
Remove foundational requirements.txt file
2025-08-04 16:38:37 -04:00
Mark Backman
c773ddf83d
Update foundational examples README
2025-08-04 16:26:11 -04:00
Mark Backman
54d5ebbc20
Update the README with uv-centric steps
2025-08-04 16:11:38 -04:00
Mark Backman
35002cd727
Remove inline script from foundational 43a
2025-08-04 15:46:18 -04:00
Mark Backman
53d75faa47
Merge pull request #2330 from pipecat-ai/mb/runner-clean-proxy-name
...
Runner: strip protocol from proxy address
2025-08-04 10:42:16 -07:00
Mark Backman
2901dddc2b
Merge pull request #2338 from pipecat-ai/mb/update-release-evals-tavus
...
Add Tavus, HeyGen, Simli to release-evals
2025-08-04 10:38:27 -07:00
Mark Backman
3a8d809837
Runner: strip protocol from proxy address
2025-08-04 13:38:02 -04:00
Mark Backman
1b3c2bee30
Merge pull request #2331 from pipecat-ai/mb/more-foundational
...
Updating more foundational examples
2025-08-04 10:37:15 -07:00
Mark Backman
69f049cb63
Merge pull request #2328 from pipecat-ai/mb/04b-example-cleanup
...
Align 04b livekit example with other foundational examples
2025-08-04 10:36:57 -07:00
Vanessa Pyne
96b1000e52
Merge pull request #2341 from getchannel/realtime-text
...
Hotfix: Correct Gemini Live API class to fix 1007 payload error.
2025-08-04 11:03:57 -05:00
Filipi da Silva Fuchter
0184a8c231
Merge pull request #2351 from pipecat-ai/filipi/tavus_transport_ready
...
Changed `TavusVideoService` to send audio or video frames only after the transport is ready, preventing warning messages at startup.
2025-08-04 11:48:27 -03:00
Filipi Fuchter
c22866ed58
Mentioning the TavusVideoService fix in the changelog.
2025-08-04 11:46:24 -03:00
Filipi Fuchter
0e533d21be
Only send audio and video from the tavus video service if the transport is ready.
2025-08-04 10:52:30 -03:00
Mark Backman
6f6f4c3dea
Merge pull request #2348 from sam-s10s/speechmatics-stt
...
Fix for Speechmatics STT
2025-08-04 06:15:39 -07:00
Mark Backman
f609971637
daily runner util: remove arg parsing, add auto room, token generation
2025-08-03 21:50:44 -04:00
Mark Backman
54ff10ae86
Merge pull request #2332 from hankehly/fix-piper-tts-json-payload
...
Fix PiperTTSService to send TTS input as JSON object
2025-08-03 17:39:04 -07:00
hankehly
77057eb829
Fix ruff formatting
2025-08-04 08:13:16 +09:00
Mark Backman
2b1a7b840d
Merge pull request #2346 from adenta/heygen-testing
...
me trying to get heygen working
2025-08-03 14:11:14 -07:00
Sam Sykes
e07db88bc0
Updated changelog.
2025-08-03 22:11:10 +01:00
Sam Sykes
c2282b0e73
Set user_id to "" (not None) for RTVIProcessor.
2025-08-03 22:08:22 +01:00
Andrew Denta
593bf09d8d
update script
2025-08-03 17:01:27 -04:00
Sam Sykes
534ed77ebf
Merge branch 'main' into speechmatics-stt
2025-08-03 21:51:35 +01:00
Andrew Denta
193299988d
me trying to get heygen working
2025-08-03 13:42:07 -04:00
Aleix Conchillo Flaqué
d589bcb345
Merge pull request #2344 from pipecat-ai/aleix/daily-python-0.19.6
...
pyproject: update daily-python to 0.19.6
2025-08-03 10:15:15 -07:00
Aleix Conchillo Flaqué
011ebc2801
Merge pull request #2345 from pipecat-ai/aleix/task-observer-signature-performance
...
TaskObserver: don't inspect on_push_frame signature for every frame
2025-08-03 10:15:00 -07:00
Aleix Conchillo Flaqué
3a72e94d0c
LLMService: only do handle function inspection once
2025-08-03 10:09:19 -07:00
Aleix Conchillo Flaqué
d6d39fc873
TaskObserver: don't inspect on_push_frame signature for every frame
2025-08-03 10:09:17 -07:00
Pete
258e83c904
Fix: Correct Gemini Live API text input to prevent 1007 WebSocket errors
...
- Restore TextInputMessage.realtimeInput structure for correct API format
- Remove invalid turnComplete message from _send_user_text method
- turnComplete is only valid for clientContent, not realtimeInput messages
- realtimeInput text completion is automatically inferred by the API
This fixes WebSocket 1007 errors caused by mixing realtimeInput and
clientContent message types in violation of the Gemini Live API contract.
2025-08-03 10:58:59 -04:00
Mark Backman
061f2086b2
Merge pull request #2343 from pipecat-ai/mb/update-pre-commit-ruff-version
...
Update pre-commit-config ruff version
2025-08-03 03:38:54 -07:00
Aleix Conchillo Flaqué
a1f3f51168
pyproject: update daily-python to 0.19.6
2025-08-02 20:02:22 -07:00
hankehly
2177a2b805
Remove trailing space
2025-08-03 10:34:27 +09:00
hankehly
68164415ce
Format changelog entry
2025-08-03 10:26:37 +09:00
hankehly
7646599b66
Add changelog entry
2025-08-03 10:23:58 +09:00
Mark Backman
e467eaf130
Merge pull request #2334 from Designedforusers/fix/tavus-transport-daily-callbacks
...
fix: Add missing transcription callbacks to TavusTransport for 0.0.77 compatibility
2025-08-02 16:09:57 -07:00
Designedforusers
9d6d53629e
style: Apply ruff formatting to fix line length
...
Fixed a line length issue in tavus.py where the on_transcription_stopped callback was exceeding the maximum line length. Split the partial() call across multiple lines for better readability and compliance with project style guidelines.
2025-08-02 18:27:09 -04:00
Mark Backman
89596cfec4
Update pre-commit-config ruff version
2025-08-02 18:06:06 -04:00
Designedforusers
5e338ecaf1
refactor: Remove redundant transcription callback methods
...
As suggested in PR review, removed the _on_transcription_stopped and
_on_transcription_error method definitions. Now using the consistent
partial(self._on_handle_callback, ...) pattern for these callbacks,
matching how all other callbacks are handled.
This simplifies the code while maintaining the same functionality.
2025-08-02 15:02:54 -04:00
Designedforusers
62319021f8
docs: Add changelog entry for TavusVideoService fix
...
Added changelog entry as requested by maintainers for the fix addressing
missing transcription callbacks in TavusVideoService.
2025-08-02 14:53:44 -04:00
Pete
cccd82a617
Refactor TextInputMessage class to replace realtimeInput with a text attribute.
...
This was sending a 1007 because it was wrapping RealtimeInput in the json.
- Updated the `TextInputMessage` class to directly store text input as a string.
- Modified the `from_text` class method to create an instance using the new `text` attribute.
2025-08-02 14:34:00 -04:00
Mark Backman
f552ba1f5e
Merge pull request #2336 from pipecat-ai/mb/suppress-pydub-warning
...
Suppress pydub (cartesia dependency) SyntaxWarning
2025-08-02 10:01:05 -07:00
Mark Backman
b9a2a9b729
Add Tavus, HeyGen, Simli to release-evals
2025-08-02 09:35:06 -04:00
Mark Backman
e43b3869c3
Suppress pydub SyntaxWarning from the cartesia module
2025-08-02 08:49:59 -04:00
Mark Backman
55731df999
Improve quickstart logging, runner startup message
2025-08-02 08:40:05 -04:00
Designedforusers
3a7ea25077
fix: Add missing transcription callbacks to TavusTransport for 0.0.77 compatibility
...
TavusTransport was broken in Pipecat 0.0.77 due to PR #2292 adding required
callbacks (on_transcription_stopped, on_transcription_error) to DailyCallbacks.
This fix adds placeholder implementations of these callbacks to TavusTransportClient,
allowing TavusTransport to initialize properly. These callbacks are not used by
Tavus (which handles avatar video, not transcription) but are required by the
DailyCallbacks validation.
Fixes initialization error:
- 2 validation errors for DailyCallbacks
- on_transcription_stopped: Field required
- on_transcription_error: Field required
2025-08-02 05:56:46 -04:00
Yohan Liyanage
248206e234
Fixes 2277 - SSML reserved characters in LLM generated text causes Azure TTS to fail.
2025-08-02 12:49:29 +05:30
hankehly
694922f627
Fix PiperTTSService to send TTS input as JSON object
2025-08-02 15:29:16 +09:00
Mark Backman
cc9950e72d
Updating more foundational examples
2025-08-01 19:58:40 -04:00
richtermb
6814c390ba
Update CHANGELOG to reflect the addition of the source field in ErrorFrame for improved error tracking.
2025-08-01 14:47:57 -07:00
Richter Brzeski
c2d05ad23b
Merge branch 'pipecat-ai:main' into richtermb/push-more-error-frames
2025-08-01 14:47:08 -07:00
Mark Backman
ee56d8572d
Merge pull request #2329 from pipecat-ai/mb/fix-livekit-empty-audio-frames
...
fix: LiveKitTransport, don't push empty AudioRawFrames
2025-08-01 12:53:05 -07:00
richtermb
91568eeddc
Update type hint for source in ErrorFrame to use forward declaration for improved clarity.
2025-08-01 12:52:56 -07:00
richtermb
165d6b4c1d
Update CHANGELOG to include new source field in ErrorFrame for error tracking.
2025-08-01 12:25:29 -07:00
Mark Backman
1d8abe3c1c
fix: LiveKitTransport, don't push empty AudioRawFrames
2025-08-01 14:57:53 -04:00
Mark Backman
a6e69d6aad
Merge pull request #2325 from pipecat-ai/mb/dependency-groups
...
Move dev to [dependency-groups], update uv.lock
2025-08-01 11:54:21 -07:00
Mark Backman
519da9cc61
Align 04b livekit example with other foundational examples
2025-08-01 14:28:15 -04:00
richtermb
ead4e97ab5
Add source parameter to ErrorFrame and set it in FrameProcessor. Updated error handling in AnthropicLLMService and DeepgramSTTService to include ErrorFrame with source information.
2025-08-01 11:14:50 -07:00
Mark Backman
0c021378b0
Merge pull request #2326 from pipecat-ai/readme-quickstart-link
...
Update README.md
2025-08-01 10:45:30 -07:00
Mark Backman
e22c7e8ad5
Update README.md
2025-08-01 13:40:03 -04:00
Mark Backman
b71057bf7c
Move dev to [dependency-groups], update uv.lock
2025-08-01 09:43:56 -04:00
Mark Backman
0865f6cd7d
Merge pull request #2318 from pipecat-ai/mb/add-asyncio-readme
...
Add AsyncAI TTS to README vendor list
2025-08-01 06:11:13 -07:00
Mark Backman
610b1ab065
Merge pull request #2319 from pipecat-ai/mb/use-new-runner
...
Update foundational examples to use new runner
2025-08-01 06:11:03 -07:00
Mark Backman
3a2a226668
Merge pull request #2320 from pipecat-ai/mb/uv-lock-init
...
Add initial uv.lock file
2025-08-01 06:07:53 -07:00
Mark Backman
8e4b7352fd
Merge pull request #2321 from pipecat-ai/mb/dev-requirements
...
Add dev to optional-dependencies
2025-08-01 06:02:58 -07:00
Mark Backman
637d372fe4
Add dev to optional-dependencies
2025-07-31 23:39:23 -04:00
Mark Backman
ac15fe8ae4
Add workflow to update lockfile with pyproject.toml changes
2025-07-31 23:08:21 -04:00
Mark Backman
07239c0b8b
Add initial uv.lock file
2025-07-31 22:46:44 -04:00
Mark Backman
367b2fbe3c
Update requirements.txt
2025-07-31 22:12:57 -04:00
Mark Backman
f1b1d5b130
Update foundational examples to use the development runner
2025-07-31 22:11:32 -04:00
Mark Backman
ff45b77fdf
Remove examples runner
2025-07-31 21:22:04 -04:00
Mark Backman
e522b7ae96
Add AsyncAI TTS to README vendor list
2025-07-31 19:33:37 -04:00
Mark Backman
b8eef4f93b
Merge pull request #2314 from pipecat-ai/mb/sync-quickstart-example
...
Add workflow to sync quickstart to pipecat-quickstart repo
2025-07-31 15:34:26 -07:00
Mark Backman
dcc205996a
Merge pull request #2317 from pipecat-ai/mb/release-prep-0.0.77
...
Changelog update for 0.0.77
2025-07-31 15:34:02 -07:00
Mark Backman
9f61af4d1b
Changelog update for 0.0.77
2025-07-31 18:19:05 -04:00
Sam Sykes
e8faf28e6a
Doc fix for incorrect argument name.
2025-07-31 22:30:54 +01:00
Filipi da Silva Fuchter
40d53b3d84
Merge pull request #2316 from sam-s10s/speechmatics-stt
...
Updated to SpeechmaticsSTTService
2025-07-31 18:28:16 -03:00
Sam Sykes
7c223a86c2
Fix to missing deprecated attribute enable_speaker_diarization.
2025-07-31 22:25:46 +01:00
Sam Sykes
2d3f61aa07
Updated Speechmatics Plugin ( #2225 )
...
Changes
Split out module attributes to make engine settings clearer
Removed internal audio buffer to use latest Speechmatics python SDK (0.4.0)
Use diarization for improved VAD in multi-speaker situations
Support custom dictionary / vocabulary with attributes
Deprecated attributes superseded by re-organised attributes
Diarization Enhancements
Focus on specific speakers (using speaker labels)
Ignore specific speakers (using speaker labels)
Separate transcription formats for active and inactive speakers
Support for known speakers
2025-07-31 17:51:38 -03:00
Mark Backman
e05a47744d
Merge pull request #2311 from pipecat-ai/mb/quickstart-fixups
...
Set quickstart min pipecat-ai version to 0.0.77, remove non-quickstart examples
2025-07-31 13:42:10 -07:00
Aleix Conchillo Flaqué
6ffaab2b93
CHANGELOG cosmetics
2025-07-31 13:39:37 -07:00
Aleix Conchillo Flaqué
c2d8844903
Merge pull request #2312 from pipecat-ai/aleix/srhinos/main
...
Enable Interruption Support for LLMUserResponseAggregator
2025-07-31 13:30:57 -07:00
Mark Backman
e8caba7723
Add workflow to sync quickstart to pipecat-quickstart repo
2025-07-31 15:56:18 -04:00
Mark Backman
df96ef7d37
Remove non-quickstart demos
2025-07-31 15:38:54 -04:00
Aleix Conchillo Flaqué
7553f670af
fix formatting and update CHANGELOG
2025-07-31 10:41:11 -07:00
Mark Backman
6960f5861b
Set example min pipecat-ai version to 0.0.77 due to runner requirement
2025-07-31 12:21:58 -04:00
Mark Backman
b5edbbc0ca
Merge pull request #2309 from pipecat-ai/mb/remove-runner-examples
...
Remove examples/runner-examples
2025-07-31 09:18:22 -07:00
Aleix Conchillo Flaqué
e78d9c2c95
Merge pull request #2293 from azain47/azain47/fix-piper-tts-service
...
Fix Piper TTS Service
2025-07-31 08:32:17 -07:00
Vanessa Pyne
b25547a98b
Merge pull request #2305 from pipecat-ai/vp-changelog-text-input
...
update changelog
2025-07-31 10:16:47 -05:00
Mark Backman
e80281c3c4
Remove examples/runner-examples
2025-07-31 10:59:06 -04:00
Mark Backman
d692843e5b
Merge pull request #2308 from pipecat-ai/mb/change-neuphonic-url
...
NeuphonicTTSService: change the default url value to the global endpoint
2025-07-31 07:38:57 -07:00
Mark Backman
eaad3c5d55
NeuphonicTTSService: change the default url value to the global endpoint
2025-07-31 10:24:54 -04:00
vipyne
f2a1c66379
update changelog
2025-07-31 08:55:25 -05:00
Vanessa Pyne
af8de227bb
Merge pull request #2223 from getchannel/realtime-text
...
Add text input handling to unify context for realtimeInput stream of GeminiMultimodalLiveService
2025-07-31 08:53:39 -05:00
Mark Backman
7cd78dd286
Merge pull request #2303 from pipecat-ai/mb/add-new-quickstart-demos
...
Add quickstart demos
2025-07-31 05:56:00 -07:00
Mark Backman
226b516948
Add quickstart demos
2025-07-30 22:14:10 -04:00
Mark Backman
aa85fffa57
New runner module ( #2269 )
...
* Adds pipecat.runner.run - FastAPI-based development server with automatic bot discovery
* Adds new RunnerArguments types for different transports
* Adds new runner utils for creating transports and parsing data
* Adds new Daily and LiveKit utils for setup
2025-07-30 22:02:28 -04:00
srhinos
8b97ab70ff
Enable Interruption Support for LLMUserResponseAggregator
2025-07-30 20:48:31 -04:00
Filipi da Silva Fuchter
9013b2929a
Merge pull request #2300 from pipecat-ai/filipi/fast_api_race_condition
...
Fixed a race condition in FastAPIWebsocketClient
2025-07-30 18:10:09 -03:00
Filipi Fuchter
0c6e12a9b0
Fixed a race condition in FastAPIWebsocketClient that occurred when attempting to send a message while the client was disconnecting.
2025-07-30 18:07:40 -03:00
Aleix Conchillo Flaqué
efb24071d5
Merge pull request #2301 from pipecat-ai/aleix/daily-python-0.19.5
...
pyproject: update daily-python to 0.19.5
2025-07-30 14:01:27 -07:00
Filipi da Silva Fuchter
318ebec67e
Merge pull request #2298 from pipecat-ai/filipi/google_interruptions
...
Fixed an issue in GoogleLLMService where interruptions did not work when an interruption strategy was used.
2025-07-30 17:49:07 -03:00
Aleix Conchillo Flaqué
c679227aa8
pyproject: update daily-python to 0.19.5
2025-07-30 13:19:48 -07:00
Filipi Fuchter
392853f5fa
Fixed an issue in GoogleLLMService where interruptions did not work when an interruption strategy was used.
2025-07-30 12:10:32 -03:00
Mark Backman
98d27caab3
Merge pull request #2296 from pipecat-ai/mb/switch-rime-voices
...
Added the ability to switch voices to RimeTTSService
2025-07-30 07:55:52 -07:00
Mark Backman
0fa51968bf
Added the ability to switch voices to RimeTTSService
2025-07-30 10:53:14 -04:00
Mark Backman
92aee2634b
Merge pull request #2291 from pipecat-ai/mb/remove-on-client-closed
2025-07-30 06:36:32 -07:00
Filipi da Silva Fuchter
bff6a93f31
Merge pull request #2150 from pipecat-ai/filipi/hey_gen
...
HeyGen implementation for Pipecat - HeyGenVideoService
2025-07-30 09:10:07 -03:00
Filipi Fuchter
6e921cdf45
HeyGen implementation for Pipecat - HeyGenVideoService
2025-07-30 09:07:15 -03:00
Azain.
1e2b066cf3
Fix tts.py
...
Update Piper TTS Service to work with the newer Piper GPL Version, that uses JSON as its payload.
2025-07-30 13:41:27 +05:30
Pete
2af3b6329d
Ruff format debug
2025-07-29 17:48:11 -04:00
Pete
8ca06e5887
Add InputTextRawFrame class for handling raw text input in frames
...
- Introduced `InputTextRawFrame` to represent raw text input from users or programs.
- Updated `GeminiMultimodalLiveLLMService` to process `InputTextRawFrame` and send user text via the Gemini Live API's realtime input stream.
- Enhanced `_send_user_text` method documentation for clarity on its functionality and usage.
2025-07-29 17:43:14 -04:00
Mark Backman
c145a9ef13
Merge pull request #2288 from pipecat-ai/mb/stt-mute-examples
...
Update placement of STTMuteFilter in examples to reflect the new reco…
2025-07-29 12:10:36 -07:00
Mark Backman
b523f9a4c6
Merge pull request #2248 from ashotbagh/feat/async-tts
...
feat(tts): integrate Async TTS engine into pipecat
2025-07-29 12:10:11 -07:00
Mark Backman
7f184422d0
Merge branch 'main' into feat/async-tts
2025-07-29 12:06:56 -07:00
Aleix Conchillo Flaqué
fa4c3ec6bf
Merge pull request #2287 from pipecat-ai/aleix/asyncio-trace-logging
...
utils(asyncio): use trace logging for some cancelling messages
2025-07-29 11:56:25 -07:00
Aleix Conchillo Flaqué
9fafc10844
Merge pull request #2292 from richtermb/transcription-error-callback
...
Add on_transcription_error callback to DailyCallbacks and handle tran…
2025-07-29 11:56:02 -07:00
richtermb
67107d02ed
Refactor callback invocation for on_transcription_stopped in DailyTransportClient for improved readability
2025-07-29 11:53:41 -07:00
richtermb
c1df19982c
Add on_transcription_stopped callback to DailyTransport for handling transcription stop events
2025-07-29 11:50:16 -07:00
richtermb
444b1b5b02
Add on_transcription_stopped callback to DailyCallbacks and implement handling in DailyTransport for transcription stop events
2025-07-29 11:49:28 -07:00
Mark Backman
ebfa4f2d5e
Push the STTMuteFrame upstream and downstream
2025-07-29 14:37:36 -04:00
Mark Backman
e961c438e7
Update placement of STTMuteFilter in examples to reflect the new recommendation
2025-07-29 14:36:39 -04:00
richtermb
d3d36a89e2
Add _on_transcription_error method to DailyTransport for handling transcription error events
2025-07-29 10:48:50 -07:00
richtermb
fa6e5ce4a7
Add on_transcription_error callback to DailyCallbacks and handle transcription errors in DailyTransportClient
2025-07-29 10:43:18 -07:00
Mark Backman
3ffb261864
Remove use of on_client_closed event in foundational examples
2025-07-29 13:28:33 -04:00
Mark Backman
f69a02b7a7
Merge pull request #2290 from pipecat-ai/mb/remove-examples
...
Removed most pipecat examples, relocating to pipecat-examples repo
2025-07-29 10:02:24 -07:00
Mark Backman
f1f4aed398
Remove random Dockerfile, update README links
2025-07-29 11:41:27 -04:00
Mark Backman
414c245c92
Remove android.yaml github workflow
2025-07-29 11:34:48 -04:00
Mark Backman
3f57d94c0b
Update examples README
2025-07-29 11:28:40 -04:00
Mark Backman
15e3c69ddc
Removed most pipecat examples, relocating to pipecat-examples repo
2025-07-29 11:17:01 -04:00
Ashot
39b00f5269
chore: address review comments
2025-07-29 18:20:50 +04:00
Mark Backman
4c368c78c6
Merge pull request #2289 from tomoima525/tomoima525/transcription-bucket-params
...
Add transcription_bucket param for rest helper
2025-07-29 05:05:08 -07:00
Tomoaki Imai
6eb00a99cb
update Changelog for transcription_bucket params addition
2025-07-29 20:38:12 +09:00
Tomoaki Imai
3ae8cf1916
Add transcription_bucket param for rest helper
2025-07-29 18:58:38 +09:00
Aleix Conchillo Flaqué
03e87469df
utils(asyncio): use trace logging for some cancelling messages
2025-07-28 17:43:41 -07:00
Mark Backman
70255d3c81
Merge pull request #2274 from pipecat-ai/mb/remove-message-name
...
Remove message["name"] addition when pushing
2025-07-28 17:29:23 -07:00
Mark Backman
96a72d0647
Remove message[name] addition when pushing
2025-07-28 20:13:50 -04:00
Mark Backman
27d4910694
Merge pull request #2286 from pipecat-ai/mb/fix-transcript-processor-newline
...
fix: Improve TranscriptProcessor detection for transcript type
2025-07-28 17:07:43 -07:00
Mark Backman
50242f4ad8
fix: Improve TranscriptProcessor detection for transcript type
2025-07-28 19:56:36 -04:00
Mark Backman
c9dda5251c
Merge pull request #2284 from pipecat-ai/mb/yank-74-75
...
Add yanked notices to 0.0.74 and 0.0.75 changelogs
2025-07-28 12:55:47 -07:00
Mark Backman
419cc9ac68
Add yanked notices to 0.0.74 and 0.0.75 changelogs
2025-07-28 13:36:02 -04:00
Ashot
83b4747196
chore: address review comments
2025-07-28 17:52:17 +04:00
Ashot
a13b954415
formatting/cleanup: address Copilot PR review comments
2025-07-28 17:43:17 +04:00
Ashot
f2e9562f1b
feat(tts): integrate Async TTS engine into pipecat
2025-07-28 17:42:57 +04:00
Mark Backman
afed9a61f2
Merge pull request #2268 from pipecat-ai/mb/inworld-changelog
...
Add changelog entry for InworldTTSService
2025-07-28 05:59:57 -07:00
Mark Backman
f0de27b35e
Merge pull request #2273 from pipecat-ai/mb/gitignore-plivo-stream
...
.gitignore: add plivo-chatbot streams.xml, .python-version
2025-07-28 05:59:41 -07:00
Filipi da Silva Fuchter
9d5510ee47
Merge pull request #2265 from pipecat-ai/filipi/small_webrtc_buffer_processor
...
Fixed an issue in AudioBufferProcessor when using SmallWebRTCTransport
2025-07-28 09:23:58 -03:00
Mark Backman
434c3fc527
Merge pull request #2279 from Allenmylath/patch-26
...
Update README.md
2025-07-28 04:51:58 -07:00
allenmylath
aba79a9478
Update README.md
...
Explanatory comment.Eventhought code allows for transport params.It is not clearly given in readme, what all are the options are there.
2025-07-28 11:24:27 +05:30
Mark Backman
fc96e091a9
Update NVIDIA in README
2025-07-26 15:01:52 -04:00
Mark Backman
851a27c082
Add Groq TTS to README
2025-07-26 14:58:07 -04:00
Mark Backman
a72d93dc6d
Add Inworld to README
2025-07-26 14:55:19 -04:00
Mark Backman
c971232f20
.gitignore: add plivo-chatbot streams.xml, .python-version
2025-07-26 10:19:50 -04:00
Mark Backman
4b2ba2d69f
Merge pull request #2270 from Allenmylath/patch-25
...
Update README.md
2025-07-26 04:55:59 -07:00
allenmylath
240a698fab
Update README.md
...
recreating examples without activating bedrock models will create errors . Warning and link added
2025-07-26 14:51:19 +05:30
Mark Backman
9aaae01063
Add changelog entry for InworldTTSService
2025-07-25 21:46:02 -04:00
Mark Backman
41c8d22cf3
Merge pull request #2208 from padillamt/mtp/add-inworld-tts
...
Inworld HTTP TTS Service
2025-07-25 17:13:37 -07:00
padillamt
b68f044ef7
mtpadilla: updated example to reflect parameter placement changes in base Inworld TTS class
2025-07-25 15:13:43 -07:00
padillamt
e140bd6960
mtpadilla: moved model and voice id setting into the class constructor
2025-07-25 14:04:49 -07:00
Filipi Fuchter
e86b55e2b3
Fixed an issue in AudioBufferProcessor when using SmallWebRTCTransport where, if the microphone was muted, track timing was not respected.
2025-07-25 17:01:41 -03:00
padillamt
4a9bec5b35
mtpadilla: stop metrics at result chunk
2025-07-25 11:14:20 -07:00
padillamt
37361391d9
mtpadilla: removed ability to set base_url via constructor, set internally based on streaming variable
2025-07-25 09:16:56 -07:00
Filipi da Silva Fuchter
4b3726eba4
Merge pull request #2260 from pipecat-ai/filipi/audio_resampler
...
Fixed an issue in `AudioBufferProcessor` that caused garbled audio
2025-07-25 09:27:42 -03:00
padillamt
8e66794759
mtpadilla: switch to Deepgram ASR for lower latency
2025-07-24 22:22:36 -07:00
padillamt
acc5b9f210
inworld: change to function that stops all processing metrics
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 22:07:15 -07:00
padillamt
f982ace4c5
inworld: removal of unnecessary setting of ssampling rate since matches default
2025-07-24 21:56:01 -07:00
padillamt
5fb1899aeb
inworld: removal of unnecessary default assignment as already handled
2025-07-24 21:42:42 -07:00
padillamt
7483422bd9
inworld: change set_voice uto use self._settings
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 21:23:03 -07:00
padillamt
16c20f3a99
inworld: removal of unnecessary default assignment since already done
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 21:15:34 -07:00
padillamt
d248c102c8
inworld: removal of unnecessary default assignment since already done
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-24 21:15:20 -07:00
padillamt
662550cc5e
mtpadilla: remove unused imports
2025-07-24 21:05:22 -07:00
padillamt
067f64389b
mtpadilla: no longer needed so making empty
2025-07-24 20:44:27 -07:00
padillamt
81048ce43a
mtpadilla: rename 07aa-interruptible-inworld-http.py to 07ab-interruptible-inworld-http.py
2025-07-24 20:42:29 -07:00
padillamt
f6440ee6e1
mtpadilla: correct Examples header in comments
2025-07-24 13:36:40 -07:00
padillamt
da8c67114a
mtpadilla: make streaming the default for example
2025-07-24 13:35:29 -07:00
Mark Backman
d8ea1311ff
Merge pull request #2254 from pipecat-ai/mb/11labs-create-context-id
...
ElevenLabsTTSService: Only reset the context_id when interruptions ar…
2025-07-24 13:32:37 -07:00
Mark Backman
2be615066c
Merge pull request #2261 from pipecat-ai/mb/foundational-requirements
...
Foundational requirements.txt: add silero, websocket optional dep, re…
2025-07-24 11:06:16 -07:00
Mark Backman
75c2ffc0b5
Check if audio context is already available, create one if not
2025-07-24 13:57:46 -04:00
Mark Backman
2297eb217e
ElevenLabsTTSService: Only reset the context_id when interruptions are enabled
2025-07-24 13:53:44 -04:00
Mark Backman
1bb821a07d
Foundational requirements.txt: add silero, websocket optional dep, remove fastapi
2025-07-24 13:49:44 -04:00
Filipi Fuchter
970b8044a0
Fixed an issue in AudioBufferProcessor that caused garbled audio when enable_turn_audio was enabled and audio resampling was required.
2025-07-24 13:25:48 -03:00
Filipi da Silva Fuchter
d8bcb81f35
Merge pull request #2259 from pipecat-ai/filipi/eleven_labs_delayed_messages
...
Play delayed messages from `ElevenLabsTTSService` if they still belong to the current context.
2025-07-24 12:07:06 -03:00
Filipi da Silva Fuchter
3ce0ab8c6d
Removing extra space.
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-07-24 12:05:17 -03:00
Filipi Fuchter
097d786431
Fixing ruff format.
2025-07-24 12:03:17 -03:00
Filipi Fuchter
662f04879c
Play delayed messages from ElevenLabsTTSService if they still belong to the current context.
2025-07-24 12:00:14 -03:00
Mark Backman
7a69f57e11
Merge pull request #2255 from pipecat-ai/mb/pyproject-versions-for-uv
...
pyproject.toml dependency updates to support better cross compatibility
2025-07-24 06:43:35 -07:00
Mark Backman
5b7b4efdc9
Add broader version support for stable core dependencies, up to the next major version
2025-07-24 09:40:52 -04:00
Mark Backman
cfa26524ca
Add support for fastapi>=0.115.6,<0.117.0
2025-07-24 09:37:42 -04:00
Mark Backman
3d4ab7158d
pyproject.toml dependency updates to support better cross compatibility
2025-07-24 09:37:42 -04:00
Mark Backman
26d1ca3c98
Merge pull request #2256 from pipecat-ai/mb/refactor-neuphonic-http
...
NeuphonicHttpTTSService: Refactor to use POST API
2025-07-24 06:36:23 -07:00
Mark Backman
083b32887e
NeuphonicHttpTTSService: Refactor to use POST API
2025-07-24 01:05:37 -04:00
padillamt
b6367965cb
mtpadilla: consolidate streaming and non-streaming options into a single class with common API, with boolean switch variable added (streaming)
2025-07-23 16:50:32 -07:00
padillamt
147bf9cfe8
mtpadilla: addition of non-streaming option with own dedicated class, and related additional non-streaming test option
2025-07-23 15:28:43 -07:00
Mark Backman
3391929127
Merge pull request #2252 from pipecat-ai/mb/example-axios-version-bump
...
Update axios in daily-pstn-server example due to transitive vulnerabi…
2025-07-23 13:30:58 -07:00
padillamt
a5d353030e
mtpadilla: small formatting fix to comments
2025-07-23 12:02:58 -07:00
padillamt
f29024bcc0
mtpadilla: update coments regarding temperature parameter
2025-07-23 11:47:26 -07:00
Mark Backman
ebf9bc2741
Merge pull request #2246 from ydlamba/ydlamba/missing-livekit-event
...
fix(livekit): emit on_audio_track_subscribed event
2025-07-23 11:27:10 -07:00
Mark Backman
f5edde42f6
Update axios in daily-pstn-server example due to transitive vulnerability with form-data
2025-07-23 14:22:13 -04:00
Filipi da Silva Fuchter
37bb7ef926
Merge pull request #2239 from pipecat-ai/filipi/daily_log
...
Added `set_log_level` to `DailyTransport`
2025-07-23 14:48:34 -03:00
Filipi Fuchter
a63d1530a4
Added set_log_level to DailyTransport.
2025-07-23 14:43:53 -03:00
Yash Dev Lamba
960bc9df5b
chore(changelog): add entry for LiveKitTransport audio subscribed event fix
2025-07-23 22:41:20 +05:30
Mark Backman
e2a153ee01
Merge pull request #2242 from pipecat-ai/mb/websockets-14
...
Upgrade websockets to support asyncio implementation
2025-07-23 08:58:08 -07:00
Mark Backman
300f19ad23
Port to the websockets asyncio implementation, support for websockets 13 and 14
2025-07-23 11:54:25 -04:00
Mark Backman
7955080da2
Change extra_headers to additional_headers, update websocket version support
2025-07-23 11:53:43 -04:00
Mark Backman
994e82c1ef
Merge pull request #2243 from pipecat-ai/mb/word-wrangler-twilio-readme
...
Update Word Wrangler phone bot README to include deployment info
2025-07-23 07:04:19 -07:00
Mark Backman
b07b947352
Merge pull request #2244 from pipecat-ai/mb/upgrade-deepgram-4.7.0
...
Deepgram: Update optional dependency to 4.7.0
2025-07-23 07:04:02 -07:00
Filipi da Silva Fuchter
a6527c3856
Merge pull request #2240 from pipecat-ai/filipi/sig_term
...
Adding support for handle_sigterm
2025-07-23 08:15:50 -03:00
antonyesk601
1cbf7ae480
fix: remove unused variable; fix: remove redundant logic
2025-07-23 08:26:44 +00:00
Yash Dev Lamba
0e6874b605
fix(livekit): emit on_audio_track_subscribed event
2025-07-23 08:23:45 +05:30
Mark Backman
9ba172c49f
Merge pull request #2236 from dbtreasure/fix/python-311-compatibility
...
Fix Python 3.11+ compatibility by pinning numba/llvmlite versions
2025-07-22 18:20:38 -07:00
dbtreasure
f710c94b6e
Address code review feedback: remove explicit llvmlite pin
...
- Remove explicit llvmlite>=0.44.0 pin as numba>=0.61.0 automatically pulls compatible version
- Add changelog entry for Python 3.11+ dependency fix
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-07-22 18:45:32 -06:00
dbtreasure
6e3a0a2d5d
Add explicit numba/llvmlite pins for Python 3.11+ compatibility
...
Fixes dependency resolution issues where transitive dependencies
through resampy would install incompatible versions:
- numba>=0.61.0 (supports Python 3.10-3.13)
- llvmlite>=0.44.0 (supports Python 3.10-3.13)
Previously, older versions (numba 0.53.1, llvmlite 0.36.0) only
supported Python 3.6-3.9, causing deployment failures on Python 3.11+.
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-Authored-By: Claude <noreply@anthropic.com >
2025-07-22 18:45:02 -06:00
Mark Backman
9530b8b842
Merge pull request #2235 from pipecat-ai/mb/nltk-tokenizer
...
Update match_endofsentence to use NLTK sentence tokenizer
2025-07-22 17:22:23 -07:00
Mark Backman
26c937af87
Update match_endofsentence to use NLTK sentence tokenizer
2025-07-22 20:19:29 -04:00
Mark Backman
976f6168f0
Deepgram: Update optional dependency to 4.7.0
2025-07-22 20:15:30 -04:00
Mark Backman
0be64e0fd9
Update Word Wrangler phone bot README to include deployment info
2025-07-22 20:10:20 -04:00
Filipi Fuchter
7d527c3a6b
Mentioning the new field in the changelog.
2025-07-22 19:32:52 -03:00
Filipi Fuchter
c6f6930c27
Adding support for handle_sigterm
2025-07-22 17:24:07 -03:00
Mark Backman
c33dfe8309
Merge pull request #2233 from pipecat-ai/mb/enable-tracing-flag
...
fix: enable_tracing PipelineParam controls the service class decorators
2025-07-22 08:14:32 -07:00
Mark Backman
769cd1ef06
fix: enable_tracing PipelineParam controls the service class decorators
2025-07-22 11:10:53 -04:00
Mark Backman
6d72f60571
Merge pull request #2234 from pipecat-ai/mb/fix-minimax-pitch
...
fix: MiniMaxHttpTTSService pitch, add base_url arg
2025-07-22 08:10:01 -07:00
Mark Backman
e8d0712ac1
Merge pull request #2238 from pipecat-ai/mb/patch-form-data
...
Fix form-data vulnerability in pipecat-cloud-daily-pstn-server
2025-07-22 08:09:49 -07:00
Mark Backman
88b2c817ac
Fix form-data vulnerability in pipecat-cloud-daily-pstn-server
2025-07-22 10:08:25 -04:00
Mark Backman
f8f6c9918d
Merge pull request #2237 from pipecat-ai/mb/pipecat-cloud-example-pipeline-runner-args
...
Update Pipecat Cloud example to use handle_sigint=False in PipelineRu…
2025-07-22 06:55:56 -07:00
Mark Backman
8ee608bbfe
Update Pipecat Cloud example to use handle_sigint=False in PipelineRunner args
2025-07-22 09:52:57 -04:00
Mark Backman
fad2ba4570
Merge pull request #2204 from yousifa/mcp-FunctionCallParams
2025-07-22 05:01:32 -07:00
Mark Backman
f609f7eb53
fix: MiniMaxHttpTTSService pitch, add base_url arg
2025-07-21 21:16:35 -04:00
Mark Backman
ea09813a2b
Merge pull request #2227 from pipecat-ai/mb/fix-11labs-wordtimestamps
...
fix: Improve ElevenLabsTTSService word/timestamp calcuation accuracy
2025-07-21 16:07:07 -07:00
Mark Backman
53abfc27a7
fix: Improve ElevenLabsTTSService word/timestamp calcuation accuracy
2025-07-21 18:48:38 -04:00
padillamt
1915407ff7
inworld: removed unreferenced is_first_chunk variable
2025-07-21 15:30:48 -07:00
Mark Backman
9c72e96a2c
Merge pull request #2230 from pipecat-ai/mb/livekit-tenacity
...
Livekit: change tenacity supported versions
2025-07-21 15:28:38 -07:00
Mark Backman
f66c67c4ab
Merge pull request #2232 from pipecat-ai/mb/fix-ollama-args
...
Fix: Ollama kwargs error
2025-07-21 15:26:13 -07:00
Mark Backman
b623face03
Add Ollama function calling example 14u
2025-07-21 17:52:16 -04:00
Mark Backman
698d60f3ae
fix: OLLamaLLMService pass base_url as kwarg
2025-07-21 17:51:11 -04:00
Mark Backman
c9717a23a5
Livekit: change tenacity supported versions
2025-07-21 17:30:18 -04:00
padillamt
076a675a75
inworld: Fix...Set sample_rate=None in InworldHttpTTSService to match Cartesia pattern
2025-07-21 13:50:36 -07:00
padillamt
0d5292c4ef
inworld: typo fix in voice name
2025-07-21 13:48:13 -07:00
padillamt
4853d5d55c
inworld: updated InworldHttpTTSService initialization
2025-07-21 13:27:25 -07:00
padillamt
8eda2435a2
inworld: removed explicit references to language since our models currently infer that from the text.
2025-07-21 13:24:10 -07:00
Mark Backman
d981ce6e56
Merge pull request #2226 from pipecat-ai/mb/11labs-speed-docstring
...
Fix 11Labs speed docstring
2025-07-21 13:21:45 -07:00
padillamt
54ff946976
inworld: largely adjustments for docstring compatibility
2025-07-21 12:07:58 -07:00
Mark Backman
1bbd3bd8ab
Fix 11Labs speed docstring
2025-07-21 14:58:12 -04:00
padillamt
aadd088b50
inworld: commented out contents as per Pipecat guidance that this pattern is being retired
2025-07-21 10:52:55 -07:00
padillamt
4250aa6616
inworld: removal of backup copy, no longer needed
2025-07-21 10:11:50 -07:00
Kwindla Hultman Kramer
a20915caa7
Merge pull request #2224 from pipecat-ai/khk/mps
...
Add MPS backend auto-detection to local smart-turn v2
2025-07-21 09:24:51 -07:00
Vanessa Pyne
28cab5a606
Merge pull request #1932 from getchannel/groundingMetadata
...
Add groundingMetadata to Gemini Multimodal Live Service
2025-07-21 10:09:26 -05:00
Vanessa Pyne
cfea56064d
small merge-main nit fixes - gemini_multimodal_live events.py
2025-07-21 09:54:15 -05:00
Vanessa Pyne
8467d87cfc
small main-merge fixes - gemini.py
2025-07-21 09:52:32 -05:00
Kwindla Hultman Kramer
b20d020bea
Add MPS backend auto-detection to local smart-turn v2
2025-07-20 20:18:45 -04:00
padillamt
e3711f96a3
inworld: added detailed comments
2025-07-20 17:06:35 -07:00
Pete
948257c66e
Merge branch 'main' into groundingMetadata
2025-07-20 19:54:30 -04:00
Pete
b54d1fb7fd
Resolve merge conflict and remove duplicate File API initialization
...
- Remove duplicate file_api initialization lines
- Keep grounding metadata tracking functionality
- Maintain clean code structure
2025-07-20 19:15:40 -04:00
Pete
ec361df0d1
Fix final ruff linting issues
...
- Remove duplicate import in __init__.py
- Clean up extra blank lines in gemini.py
- Remove extra blank line in _create_single_response method
2025-07-20 18:58:54 -04:00
Pete
b1a5cddde4
Refactor whitespace and formatting in multiple files
...
- Clean up unnecessary whitespace in `gemini.py`, `events.py`, and `file_api.py`
- Ensure consistent formatting in `26g-gemini-multimodal-live-groundingMetadata.py`
- Improve readability by aligning code and removing trailing spaces
2025-07-20 18:40:12 -04:00
Pete
e165d38277
remove truncated logging from debug
2025-07-20 18:27:21 -04:00
Pete
8ba340a8a5
remove debug logging
2025-07-20 18:21:42 -04:00
Pete
8f74b97591
Refactor _send_user_text method in Gemini multimodal service to streamline event creation for turn completion
2025-07-20 18:08:45 -04:00
Pete
1d69cd1a5e
Remove debug logging from _send_user_text method in Gemini multimodal service
2025-07-20 18:04:57 -04:00
Pete
bd7a0f27cc
Add text input handling to Gemini multimodal service
...
- Updated `RealtimeInput` to include an optional `text` parameter.
- Introduced `TextInputMessage` class for encapsulating text input data.
- Implemented `_send_user_text` method to send text input to the Gemini Live API.
- Enhanced message processing to support text input alongside media chunks.
2025-07-20 17:39:31 -04:00
padillamt
5d8c184d99
inworld: commit of original text file and changes that copy openai's with Inworld TTS as only change
2025-07-18 16:30:03 -07:00
padillamt
1bc442e329
inworld: docstring fix
2025-07-18 15:13:19 -07:00
kompfner
d4e33663b2
Merge pull request #2214 from pipecat-ai/pk/fix-google-llm-context
...
Fixed an issue in `GoogleLLMContext` where it would inject the `syste…
2025-07-18 09:28:28 -04:00
marcus-daily
d7d1b16dad
Removing old import
2025-07-18 12:48:06 +01:00
marcus-daily
0bc2ea13f2
Updating changelog
2025-07-18 12:48:06 +01:00
marcus-daily
b5d1301221
Fix linter warnings
2025-07-18 12:48:06 +01:00
marcus-daily
ed8f30ec71
Add support for running smart-turn-v2 locally
2025-07-18 12:48:06 +01:00
antonyesk601
688031efd6
fix: use undeclared variable _preinitialized. fix: double send of start frame
2025-07-18 08:23:04 +00:00
kompfner
a74a935ca0
Merge pull request #1910 from matejmarinko-soniox/main
...
Add Soniox STT service integration
2025-07-17 09:29:07 -04:00
antonyesk601
0f9e69d3c7
feat: Add Simli Trinity models support to pipecat
2025-07-17 11:55:40 +00:00
padillamt
f3984aec33
inworld: added (empty) requirements for Inworld to be explicit reg dependencies
2025-07-16 13:21:32 -07:00
Paul Kompfner
7cfd56699b
Fixed an issue in GoogleLLMContext where it would inject the system_message as a "user" message into cases where it was not meant to; it was only meant to do that when there were no "regular" (non-function-call) messages in the context, to ensure that inference would run properly.
2025-07-16 16:07:53 -04:00
Matej Marinko
cb984237a7
Fix lint error
2025-07-16 16:54:28 +02:00
Matej Marinko
c969fdddb9
Rename and simplify VAD finalization parameter usage
2025-07-16 09:47:34 +02:00
padillamt
2b76823b01
inworld: added comments to track a few things to confirm
2025-07-15 18:17:30 -07:00
padillamt
ca936bd569
inworld: added Inworld to list of needed credentials
2025-07-15 18:11:50 -07:00
padillamt
c67b779b91
inworld: first commit of Inworld example file for TTS
2025-07-15 17:21:16 -07:00
padillamt
913dba3b74
inworld: class name change
2025-07-15 17:15:57 -07:00
padillamt
384838147a
inworld: removed unnecessary code from stop() and cancel()
2025-07-15 16:56:18 -07:00
padillamt
7861b911c0
inworld: first commit of __init__ and tts.py files
2025-07-15 16:50:50 -07:00
Mark Backman
9931ad2ce1
Merge pull request #2199 from Dev-Khant/add-host-support-in-Mem0
...
Add `host` support in Mem0 Memory
2025-07-15 11:41:15 -07:00
Filipi da Silva Fuchter
fd73feb645
Merge pull request #2201 from pipecat-ai/filipi/stt_issue
...
Only create the EmulateUserStartedSpeakingFrame if we have received a transcription
2025-07-15 13:56:11 -03:00
Yousif Astarabadi
ee78428a2a
formatted
2025-07-14 20:38:28 -07:00
Yousif Astarabadi
ae02249255
mcp_tool_wrapper using FunctionCallParams
2025-07-14 20:31:22 -07:00
Filipi Fuchter
727af2e6fb
Only create the EmulateUserStartedSpeakingFrame if we have received a transcription.
2025-07-14 17:38:03 -03:00
Mark Backman
8fd5576879
Merge pull request #2198 from Allenmylath/patch-24
...
Update app.py
2025-07-14 06:37:42 -07:00
kompfner
1f85dcee7c
Merge pull request #2171 from pipecat-ai/pk/aws-strands-demo
...
Minimal AWS Strands demo
2025-07-14 09:32:16 -04:00
Dev Khant
138890bc5c
Add support in Mem0 Memory
2025-07-14 18:08:25 +05:30
Filipi da Silva Fuchter
a094efc9e6
Merge pull request #2196 from pipecat-ai/mb/lmnt-model
...
LmntTTSService: update the default model to blizzard
2025-07-14 09:15:17 -03:00
allenmylath
1f9e2fdecc
Update app.py
...
misleading comment. no endpoints.py
2025-07-14 14:02:35 +05:30
Mark Backman
4a2b4660bc
LmntTTSService: update the default model to blizzard
2025-07-13 10:54:43 -07:00
Mark Backman
b3ac90015a
Merge pull request #2195 from Trinary-Projects/transformers_ver_patch
...
Update transformers dep. to >=4.48.0 for Ultravox
2025-07-11 23:31:47 -07:00
Jaideep
2fe06f0a4e
Update pyproject.toml
2025-07-12 11:34:45 +05:30
Mark Backman
1836a7484e
Merge pull request #2193 from pipecat-ai/mb/changelog-0.0.76
...
Prepare changelog for 0.0.76 release
2025-07-11 16:15:34 -07:00
Mark Backman
25a5c5aaab
Prepare changelog for 0.0.76 release
2025-07-11 16:08:08 -07:00
mattie ruth backman
24694e2558
Changelog entry
2025-07-11 14:30:12 -07:00
mattie ruth backman
2325edd9ba
Add a text entry box to the simple-chatbot example
2025-07-11 14:30:12 -07:00
mattie ruth backman
fad5713ade
Fix append-to-context function call
2025-07-11 14:30:12 -07:00
Paul Kompfner
fe8573322f
AWS Strands demos
2025-07-11 16:42:27 -04:00
Mark Backman
06c1255abe
fix: use a different aggregation timeout for emulated user speech ( #2185 )
...
* fix: use a different aggregation timeout for emulated user speech
* Add SpeechControlParamsFrame
* Update test_context_aggregator tests
2025-07-11 16:33:44 -04:00
Mark Backman
f108a67635
Merge pull request #2189 from pipecat-ai/mb/numpy-version-bump
...
Update numpy, transformers to support newer versions
2025-07-11 12:02:02 -07:00
Mark Backman
bf580d061d
Update numpy, transformers to support newer versions
2025-07-11 11:58:31 -07:00
Filipi da Silva Fuchter
b005bd7b98
Merge pull request #2184 from pipecat-ai/filipi/twilio_issue
...
Fixing an issue where Pipecat was not receiving the user's audio
2025-07-11 15:32:28 -03:00
Filipi Fuchter
75f8baab33
Mentioning the fixes in the changelog.
2025-07-11 11:56:16 -03:00
Matej Marinko
5c3fb73cef
Rename example
2025-07-11 16:07:24 +02:00
Filipi Fuchter
5c3f4180b9
Refactored VAD analyzer to process multiple audio frames in a single iteration if needed.
2025-07-11 10:59:32 -03:00
Mark Backman
6cd6e7ceed
Merge pull request #2186 from pipecat-ai/mb/fix-pre-commit-config
...
Update .pre-commit-config.yaml to use pyproject.toml linting rules
2025-07-11 06:34:01 -07:00
Filipi Fuchter
1a146c2a64
Not serializing a JSON in case we have no audio.
2025-07-11 10:15:09 -03:00
Filipi Fuchter
eaeb9e6efa
Not creating InputAudioRawFrame in case we don't have bytes. Fixed for Pilvo, Exotel and Telnyx.
2025-07-11 09:51:38 -03:00
Matej Marinko
2e84c91748
Remove outdated parameter
2025-07-11 08:52:39 +02:00
Matej Marinko
650d45c1f4
Use single sample rate parameter
2025-07-11 08:27:06 +02:00
Filipi Fuchter
f4f65024ef
Refactoring the test client to use the new version of the Pipecat Client SDK.
2025-07-10 21:57:25 -03:00
Filipi Fuchter
1200aa4fb8
Not creating InputAudioRawFrame in case we don't have bytes.
2025-07-10 21:56:34 -03:00
Filipi da Silva Fuchter
6762363685
Merge pull request #2183 from pipecat-ai/filipi/parallel_pipeline_issue
...
Fixed an issue in ParallelPipeline that caused errors when attempting to drain the queues.
2025-07-10 21:51:04 -03:00
Filipi Fuchter
b2ead325c4
Fixed an issue in ParallelPipeline that caused errors when attempting to drain the queues.
2025-07-10 21:50:35 -03:00
Mark Backman
4e24b915cc
Update .pre-commit-config.yaml to use pyproject.toml linting rules
2025-07-10 16:10:27 -07:00
kompfner
b610ee26ba
Merge pull request #2181 from pipecat-ai/pk/fix-aws-nova-sonic-pipeline-freeze
...
Fix a pipeline freeze when using AWS Nova Sonic. The freeze occurs if…
2025-07-10 16:30:55 -04:00
Paul Kompfner
2b867f1613
Fix a pipeline freeze when using AWS Nova Sonic. The freeze occurs if the user starts speaking before we've finished sending the "trigger " audio (AWS Nova Sonic can only start speaking in response to a user utterance, so we have a simulated user utterance to "trigger" the bot speaking without the user having actually spoken first).
2025-07-10 15:57:05 -04:00
Mark Backman
7b8fe565c7
Merge pull request #2182 from pipecat-ai/mb/run-example-usage
...
run.py: Add example usage to the module docstring
2025-07-10 12:48:29 -07:00
Mark Backman
a246862910
run.py: Add example usage to the module docstring
2025-07-10 11:41:49 -07:00
Filipi da Silva Fuchter
106809f3fd
Merge pull request #2166 from carolin-tavus/remove-persona-microphone-check
...
feat: Remove persona microphone check
2025-07-10 15:28:35 -03:00
carolin-tavus
f0d8499f7e
feat: avoid checking microphone enabled
2025-07-10 09:40:27 +00:00
Mark Backman
332ca3d55e
Merge pull request #2177 from pipecat-ai/mb/fix-ruff-improvements
...
Make fix-ruff.sh more flexible, use pyproject rules
2025-07-09 12:33:05 -07:00
Mark Backman
a48f5d5796
Make fix-ruff.sh more flexible, use pyproject rules
2025-07-09 11:48:17 -07:00
Mark Backman
f04f047428
Merge pull request #2176 from pipecat-ai/mb/pre-commit-config
...
Add docstring checking to .pre-commit-config.yaml
2025-07-09 11:47:25 -07:00
Mark Backman
4e61fd33ea
Add docstring checking to .pre-commit-config.yaml
2025-07-09 11:18:40 -07:00
Matej Marinko
61ac77be72
Update docs
2025-07-09 11:59:45 +02:00
Matej Marinko
c093eb5b63
Move config to main file
2025-07-09 10:20:37 +02:00
Matej Marinko
98e24131bd
Send raw result
2025-07-09 09:59:04 +02:00
Matej Marinko
7becce9e8c
Add transcript tracing
2025-07-09 09:37:58 +02:00
Matej Marinko
3cdaeb719a
Update examples to new format
2025-07-09 09:28:43 +02:00
Matej Marinko
8daaea5969
Minor code cleanup
2025-07-09 09:03:02 +02:00
matejmarinko-soniox
dc47516e14
Update src/pipecat/services/soniox/config.py
...
Co-authored-by: Mark Backman <m.backman@gmail.com >
2025-07-09 08:04:59 +02:00
Mark Backman
0fcc4f822f
Merge pull request #2173 from captaincaius/fix-nextjs-webhook-example-null-check
...
fix nextjs webhook example num_endpoints null check
2025-07-08 14:10:16 -07:00
Captain Caius
c0ed061ff5
fix nextjs webhook example num_endpoints null check
2025-07-08 13:40:26 -07:00
Mark Backman
d98b6b418d
Release prep for 0.0.75 ( #2169 )
...
* Update CHANGELOG for 0.0.75 release
* Add RTVI changes to CHANGELOG
* Update CHANGELOG, add deprecation directives to rtvi.py
---------
Co-authored-by: mattie ruth backman <mattieruth@gmail.com >
2025-07-08 15:39:44 -04:00
Mark Backman
deea29b5e8
Merge pull request #2170 from pipecat-ai/mb/update-packages-0.0.75
...
Package updates to run the release evals
2025-07-08 12:02:22 -07:00
Mark Backman
0bdbc83ed9
Package updates to run the release evals
2025-07-08 11:39:49 -07:00
Mark Backman
6c591f0990
Merge pull request #2167 from pipecat-ai/mb/fix-riva-watchdog
...
RivaSTTService: reset the watchdog in an async function
2025-07-08 11:29:44 -07:00
Mark Backman
b55b9c257b
RivaSTTService: remove reset_watchdog, which is handled in the WatchdogQueue already
2025-07-08 11:19:47 -07:00
Mark Backman
5156c21d14
Merge pull request #2168 from pipecat-ai/mb/fix-neuophonic-tts
...
Fix: NeuphonicTTSService to use latest websocket API
2025-07-08 11:17:58 -07:00
Mark Backman
a9d824753b
Fix: NeuphonicTTSService to use latest websocket API
2025-07-08 11:08:08 -07:00
Filipi da Silva Fuchter
3c6a208101
Merge pull request #2148 from pipecat-ai/filipi/aws_bedrock
...
Refactoring AWSBedrockLLMService to work async
2025-07-08 12:14:28 -03:00
Mark Backman
b1032a1ca4
Merge pull request #2151 from pipecat-ai/mb/ollama-kwargs
...
OLLamaLLMService: Pass kwargs
2025-07-08 07:21:09 -07:00
Mark Backman
931f34fccd
OLLamaLLMService: Pass kwargs
2025-07-08 07:17:18 -07:00
Mark Backman
f2509adec1
Merge pull request #2162 from pipecat-ai/mb/tts-service-aggregate-sentences
...
TTS services: Add aggregate_sentences arg
2025-07-08 07:14:58 -07:00
Filipi Fuchter
285b82eb65
Mentioning the AWSBedrockLLMService and AWSPollyTTSService refactors in the changelog.
2025-07-08 07:30:30 -03:00
Filipi Fuchter
74da197304
Refactored AWSBedrockLLMService and AWSPollyTTSService to work asynchronously using aioboto3 instead of the boto3 library.
2025-07-08 07:28:23 -03:00
Matej Marinko
0f727248d2
Merge branch 'main' of github.com:pipecat-ai/pipecat
2025-07-08 08:20:10 +02:00
mattie ruth backman
a6de16f92f
Bump all client dependencies to use client-js/react/transports 1.0.0
2025-07-07 15:56:08 -07:00
mattie ruth backman
fc09854d7f
fix cam light always on
2025-07-07 15:56:08 -07:00
mattie ruth backman
2959029151
PR Review fixes
2025-07-07 15:56:08 -07:00
mattie ruth backman
e590441b7b
Add support for about info in ready messages and add deprecation comments to deprecated types
2025-07-07 15:56:08 -07:00
mattie ruth backman
dc41ec7cb1
Updated all examples with clients to use the new PipecatClient
2025-07-07 15:56:08 -07:00
mattie ruth backman
43049c865c
Add support for new RTVI client message protocol: handling and responding
2025-07-07 15:56:08 -07:00
mattie ruth backman
c4a9fc7f88
video-transport typescript formatting
2025-07-07 15:56:08 -07:00
mattie ruth backman
faf4026cf4
Add device controls to the simple chatbot example
2025-07-07 15:56:08 -07:00
Mark Backman
f53f45a6cd
TTS services: Add aggregate_sentences arg
2025-07-07 15:38:31 -07:00
Mark Backman
e04e876f44
Merge pull request #2156 from shahrukhx01/add-additional-whisper-models
...
WhisperSTTService: Add additional whisper model variants
2025-07-07 12:53:06 -07:00
shahrukhx01
a84e7e30da
WhisperSTTService: Add additional whisper model variants
2025-07-07 21:43:48 +02:00
Mark Backman
6eed6ff779
Merge pull request #2147 from pipecat-ai/mb/user-idle-long-function-call
...
UserIdleProcessor: Account for function calls in progress
2025-07-04 14:11:16 -07:00
Mark Backman
1375211610
UserIdleProcessor: Account for function calls in progress
2025-07-04 14:05:05 -07:00
Mark Backman
4e9369a702
Merge pull request #2149 from pipecat-ai/mb/twilio-hang-up-handling
2025-07-04 12:44:17 -07:00
Mark Backman
f9e8748a96
TwilioFrameSerializer: Handle user hanging up before the serializer
2025-07-04 09:42:16 -07:00
Filipi da Silva Fuchter
20d6bf267a
Merge pull request #2146 from pipecat-ai/remove_gemini_duplicated_code
...
Removing duplicated code inside Gemini.
2025-07-04 11:59:10 -03:00
Filipi Fuchter
b573f9dab2
Removing duplicated code inside Gemini.
2025-07-04 10:57:53 -03:00
Pete
7ed4fe50d4
Update gemini.py
...
-FunctionCallFromLLM
-Delete duplicate Gemini imports
2025-07-03 19:39:44 -04:00
Pete
6f66ec1727
Update gemini.py
...
tab indentation fix
2025-07-03 18:55:21 -04:00
Pete
c7e758fc36
Merge branch 'main' into groundingMetadata
2025-07-03 18:47:47 -04:00
Pete
14c22234bb
Fix parameter name consistency in parse_server_event function
...
- Change function body to use 'str' parameter consistently
- Matches pattern used in OpenAI Realtime Beta service
- Fixes bug where parameter was named 'str' but body used 'message_str'
- Maintains consistency with existing codebase patterns
2025-07-03 18:02:24 -04:00
Pete
d565e9ae53
Update grounding metadata example with final refinements
...
- Reorganize imports and transport_params structure
- Remove copyright header for consistency
- Enhance grounding metadata logging with better formatting
- Remove unnecessary PipelineParams configuration
- Update message content formatting
Completes incorporation of draft PR #2121 changes
2025-07-03 17:53:55 -04:00
Pete
4951c97eab
Clean up verbose logging in grounding metadata implementation
...
- Remove debug logging from grounding metadata event handlers
- Simplify logging in _process_grounding_metadata method
- Clean up example file logging for better readability
- Remove verbose event parsing comments
Based on suggestions from draft PR #2121
2025-07-03 17:49:27 -04:00
Pete
9b38f3e2fa
Delete examples/foundational/26f-gemini-multimodal-live-files-api.py
2025-07-03 17:15:18 -04:00
Mark Backman
dbc76389d8
Merge pull request #2140 from pipecat-ai/mb/fix-26-imports
...
Fix: missing import in 26f foundational example
2025-07-03 14:12:54 -07:00
Aleix Conchillo Flaqué
c27f838444
Merge pull request #2124 from pipecat-ai/aleix/frame-processor-no-push-queue
...
FrameProcessor: remove unnecessary push task
2025-07-03 14:03:05 -07:00
Aleix Conchillo Flaqué
ce84485e26
Merge pull request #2142 from pipecat-ai/aleix/publish-workflow-message
...
github: update publish message to make it clear
2025-07-03 14:02:51 -07:00
Mark Backman
6cf254e2f9
Fix: missing import in 26f foundational example, update twilio transport_params to FastAPIWebsocketParams
2025-07-03 13:58:18 -07:00
Aleix Conchillo Flaqué
02b63c28a5
FrameProcessor: remove unnecessary push task
...
When we call `FrameProcessor.push_frame()` we end up calling
`FrameProcessor.queue_frame()` on the next or previous processor which already
uses the input queue and guarantees frame ordering. So, there's no need to have
a two queues next to each other.
2025-07-03 13:57:32 -07:00
Aleix Conchillo Flaqué
57c6ce7ffa
github: update publish message to make it clear
2025-07-03 13:55:02 -07:00
Aleix Conchillo Flaqué
2f3272ea2f
Merge pull request #2135 from pipecat-ai/aleix/pipecat-0.0.74
...
update CHANGELOG for 0.0.74
2025-07-03 13:46:00 -07:00
Aleix Conchillo Flaqué
f5c2d57e4b
update CHANGELOG for 0.0.74
2025-07-03 13:44:21 -07:00
Aleix Conchillo Flaqué
baa878272d
scripts(evals): added 07a-interruptible-speechmatics.py
2025-07-03 13:44:21 -07:00
Aleix Conchillo Flaqué
093285868e
scripts(evals): update timeout back to 90 seconds
2025-07-03 13:37:17 -07:00
Filipi da Silva Fuchter
6c9d058ec2
Merge pull request #2139 from pipecat-ai/filipi/changelog_improvements
...
Mentioning the SpeechmaticsSTTService in the changelog.
2025-07-03 17:36:55 -03:00
Filipi Fuchter
5df7be6892
Mentioning the SpeechmaticsSTTService in the changelog.
2025-07-03 17:35:30 -03:00
Mark Backman
2deca816ae
Merge pull request #2137 from pipecat-ai/mb/fish-audio-normalize
...
FishAudioTTSService: arg cleanup, add new InputParam and arg
2025-07-03 13:29:14 -07:00
Mark Backman
b8d2fceced
Merge pull request #2138 from pipecat-ai/mb/fix-google-llm-import-order
...
GoogleLLMService: Linting fixes
2025-07-03 13:26:32 -07:00
Sam Sykes
7596d71460
Speechmatics STT + multi-speaker conversations ( #2036 )
...
* initial config
* skeleton
* Added a README (to be added to).
* Payloads coming from the ASR.
* doc update
* handle the partials and finals
* enable diarization in the example
* support sending messages to pipecat pipeline
* requirements fix in README
* updated example (with amusement)
* updated example to match master
* updated docs
* support for diarization tags
* logic fix for wrapper
* Use an internal SpeechFrame for speaker_id (not user_id).
* only include speaker tags on finalised transcript (as this may skew end of utterance detection)
* updated docs
* correction to docs and updated example
* updated requirement
* Fix for using default EU server.
* Updates from PR comments.
* Refactor based on comments in the original PR.
Primary focus on documentation, naming conventions and how `user_id` is used.
* Check for SMX installed when importing.
* Variable name change
* Comment correction.
* Support for Esporanto and Uyghur
* Impoved language support
* function name change
* Locale fix
* intercept
* interim changes
* pass the pipeline task to the module for adding events to the top of the pipeline
* logging for the pipeline
* Reduce timeout for content aggregator.
* staged update
* testing with Azure
* Updated context (Azure was dropping punctuation) and using better ElevenLabs model.
* Updated to RT 0.3.0 and use OpenAI (not Azure).
* Missing OpenAI import; parameter name change for output locale validation.
* Revert to `0.2.0` of RT SDK.
* fix for assignment of `output_locale_code`.
* update Speechmatics library to 0.3.1
* new transcription example
* updated asyncio task handling
* Updated doc strings
* enable OpenTelemetry logging
* removed import from stt for __init__
* updated examples and default values
* updated examples
* prevent lock up when closing the STT connection
2025-07-03 17:25:13 -03:00
Mark Backman
096067b097
GoogleLLMService: Linting fixes
2025-07-03 13:23:13 -07:00
Mark Backman
ec09505f6b
FishAudioTTSService: Add normalize as InputParam, model_id as arg
2025-07-03 13:14:15 -07:00
Mark Backman
251ea756c8
FishTTSService: deprecate model, add reference_id
2025-07-03 12:56:24 -07:00
Aleix Conchillo Flaqué
8f6544efe2
Merge pull request #2133 from pipecat-ai/vp-changelog-fileapi
...
docs: add changelog line for gemini files api
2025-07-03 11:13:02 -07:00
otaqwawi
6045a8ad8c
Add option to change the base URL for Google Generative AI. ( #2113 )
...
* Add option to change the base URL for Google Generative AI.
This would be useful to support private instance or gateway of the API
* fix: add proper type hints for http_options in Google LLM service
2025-07-03 11:12:35 -07:00
Aleix Conchillo Flaqué
b184d62634
Merge pull request #2134 from pipecat-ai/aleix/evals-cancel-expired-tasks
...
cancel expire evals tasks
2025-07-03 10:07:27 -07:00
Aleix Conchillo Flaqué
1a8d512abb
scripts(evals): make sure we cancel pending tasks after timeout
2025-07-03 10:01:42 -07:00
vipyne
a62be8ea32
docs: add changelog line for gemini files api
2025-07-03 11:44:34 -05:00
Mark Backman
c230d94ff0
Merge pull request #2125 from pipecat-ai/mb/deprecate-handle-function-call-start
...
Add docs deprecation for handle_function_call_start
2025-07-03 12:27:17 -04:00
Aleix Conchillo Flaqué
e7b02773f5
Merge pull request #2131 from pipecat-ai/aleix/dtmf-aggregator-dangling-tasks
...
DtmfAggregator: cancel interruption task to avoid a dangling task
2025-07-03 08:34:50 -07:00
Aleix Conchillo Flaqué
ed83248a6b
Merge pull request #2130 from pipecat-ai/aleix/pipeline-task-cancel-queue
...
PipelineTask: cancel idle queue before cancelling task
2025-07-03 08:32:31 -07:00
Aleix Conchillo Flaqué
af8b4901d4
DtmfAggregator: cancel interruption task to avoid a dangling task
2025-07-03 08:18:48 -07:00
Aleix Conchillo Flaqué
64c8230960
PipelineTask: cancel idle queue before cancelling task
2025-07-03 08:18:21 -07:00
Aleix Conchillo Flaqué
bf664534cc
PipelineTask: cancel idle queue before cancelling task
2025-07-03 08:15:31 -07:00
Filipi da Silva Fuchter
274a04e535
Merge pull request #2129 from carolin-tavus/carolin-tavus/add-persona-validation
...
Add persona validation (check that microphone is enabled)
2025-07-03 11:49:42 -03:00
carolin-tavus
cb81f3d50e
format
2025-07-03 14:38:20 +00:00
carolin-tavus
30a3b24287
Add persona validation (check that microphone is enabled)
2025-07-03 14:04:04 +00:00
Filipi da Silva Fuchter
8aacf71956
Merge pull request #1623 from phamtrung0633/victor/azure-tts-interruption-fix
...
Azure TTS fixed by clearing the audio queue before synthesizing the next text
2025-07-03 10:51:54 -03:00
Victor
72d503d3a3
Azure TTS fixed by clearing the audio queue before synthesizing the next text
2025-07-03 10:48:26 -03:00
Aleix Conchillo Flaqué
453a904290
Merge pull request #2123 from pipecat-ai/aleix/dev-requirements-25-07-02
...
update dev-requirements (dependabot)
2025-07-02 23:00:40 -07:00
Mark Backman
368bff4fb4
Merge pull request #2101 from pipecat-ai/mb/fix-websocket-example-dir
...
fix: remove javascript directory from the websocket README
2025-07-02 22:55:47 -04:00
Mark Backman
4ae045d704
Add docs deprecation for handle_function_call_start
2025-07-02 19:53:48 -07:00
Mark Backman
8c71939425
Merge pull request #2122 from pipecat-ai/mb/deprecation-docstrings
...
Add deprecation directives, add indexing, only autodoc members
2025-07-02 21:31:02 -04:00
Aleix Conchillo Flaqué
a437c2d365
update examples (dependabot)
2025-07-02 16:33:24 -07:00
Aleix Conchillo Flaqué
a1784e3237
update dev-requirements (dependabot)
2025-07-02 16:09:13 -07:00
Mark Backman
abee0f853c
Add deprecation directives, add indexing, only autodoc members
2025-07-02 15:44:02 -07:00
Aleix Conchillo Flaqué
e9d358ed17
Merge pull request #2119 from pipecat-ai/aleix/llm-messages-append-update-run-llm
...
add run_llm to LLMMessagesAppendFrame and LLMMessagesUpdateFrame
2025-07-02 13:53:36 -07:00
Aleix Conchillo Flaqué
c5d54d06bb
add run_llm to LLMMessagesAppendFrame and LLMMessagesUpdateFrame
2025-07-02 13:53:13 -07:00
Filipi da Silva Fuchter
c16eed7ca2
Merge pull request #2091 from pipecat-ai/filipi/sample_rate
...
Creating a new stream resampler which avoids clicks.
2025-07-02 16:22:46 -03:00
Filipi Fuchter
76388a10b5
Deprecating the create_default_resampler and adding the changelog.
2025-07-02 16:20:58 -03:00
Filipi Fuchter
38bcc033a2
Improving the docs about when to use: SOXRAudioResampler x SOXRStreamAudioResampler
2025-07-02 16:20:48 -03:00
Filipi Fuchter
5af563cd91
Configured the services to use create_stream_resampler instead of create_default_resampler
2025-07-02 16:20:34 -03:00
Filipi Fuchter
3de271161c
Fixing the ruff script to also try to fix docstrings.
2025-07-02 16:19:57 -03:00
Filipi Fuchter
c19f9bc43a
Creating a new stream resampler which avoids clicks.
2025-07-02 16:19:47 -03:00
Mark Backman
ef85d245ed
Merge pull request #2120 from haayhappen/patch-1
...
Update README.md
2025-07-02 15:18:28 -04:00
Fynn Merlevede
25749bd4c0
Update README.md
...
fix: use correct protocol in READme
2025-07-02 20:57:38 +02:00
Mark Backman
e19c5464fe
Merge pull request #2114 from pipecat-ai/mb/bump-google-genai-version
...
Upgrade google-genai version to 1.24.0
2025-07-02 14:25:29 -04:00
Mark Backman
5c2ea3b804
Upgrade google-genai version to 1.24.0
2025-07-02 11:18:37 -07:00
Aleix Conchillo Flaqué
c27348d470
Merge pull request #2118 from pipecat-ai/aleix/daily-python-0.19.4
...
pyproject: update daily-python to 0.19.4
2025-07-02 10:38:54 -07:00
Aleix Conchillo Flaqué
de5f9c9217
pyproject: update daily-python to 0.19.4
2025-07-02 09:51:36 -07:00
Aleix Conchillo Flaqué
f9086ee3a2
Merge pull request #2110 from pipecat-ai/aleix/daily-add-virtual-speaker-support
...
DailyTransport: allow receiving audio in a single track
2025-07-02 09:50:02 -07:00
Vanessa Pyne
43298a9026
Merge pull request #2077 from yousifa/mcp-http-gemini-support
...
Mcp http gemini support
2025-07-02 11:47:25 -05:00
Vanessa Pyne
d80e228c6f
Merge branch 'main' into mcp-http-gemini-support
2025-07-02 11:47:18 -05:00
Mark Backman
2902362886
Merge pull request #2115 from pipecat-ai/mb/docstring-cleanup
...
Docstring cleanup, fix missing examples imports
2025-07-02 11:35:11 -04:00
Mark Backman
1cd303ad7f
Merge pull request #2090 from pipecat-ai/mb/silero-np-error
...
Remove redundant import and global in SileroOnnxModel
2025-07-02 11:28:11 -04:00
Mark Backman
f590a476e7
Gemini Live fixes, plus additional docstrings
2025-07-02 08:27:23 -07:00
Mark Backman
e71cb3ba68
Docstring cleanup, fix missing examples imports
2025-07-02 08:27:23 -07:00
Filipi da Silva Fuchter
510a9af2e5
Merge pull request #2116 from pipecat-ai/filipi/fix_ios_chatbot_demo
...
Fixed an issue to disconnect the iOS chatbot demo.
2025-07-02 12:13:51 -03:00
Filipi Fuchter
5328f84df4
Fixed an issue to disconnect the iOS chatbot demo.
2025-07-02 12:06:15 -03:00
Yousif Astarabadi
18817fd81b
added docstring in public GeminiFileAPI module
2025-07-02 00:09:48 -07:00
Yousif Astarabadi
4bcc536fd2
added arg description in docstring for gemini live init
2025-07-02 00:03:27 -07:00
Yousif Astarabadi
1ab2ddd317
fix lint error
2025-07-01 23:55:34 -07:00
Yousif
09aa168840
Merge branch 'pipecat-ai:main' into mcp-http-gemini-support
2025-07-01 23:54:42 -07:00
Vanessa Pyne
05753fb207
Merge pull request #1786 from getchannel/main
...
Add File API to GeminiMultimodalLive
2025-07-01 20:29:12 -05:00
Pete
715e3f8543
Merge branch 'pipecat-ai:main' into main
2025-07-01 20:42:28 -04:00
Pete
9c9d4b35a4
remove audio_transcriber from gemini.py
...
unecessary import removed.
2025-07-01 20:36:54 -04:00
getchannel
2ee935f784
Update gemini.py
2025-07-01 20:31:58 -04:00
Aleix Conchillo Flaqué
58aedc88a4
DailyTransport: allow receiving audio in a single track
2025-07-01 17:29:10 -07:00
getchannel
0e60385871
add FileAPI to gemini.py
2025-07-01 20:14:31 -04:00
Mark Backman
a4188f7986
Merge pull request #2103 from pipecat-ai/mb/add-user-id-to-transcript
...
Add user_id to transcription frames
2025-07-01 18:28:12 -04:00
vipyne
c7cbfe7a4f
remove grounding metadata commits
2025-07-01 17:21:38 -05:00
vipyne
f1c9f5040b
Update examples/foundational/26f-gemini-multimodal-live-files-api.py
2025-07-01 16:27:25 -05:00
vipyne
79e51051c7
New lint rules and remove unused example file
2025-07-01 16:27:25 -05:00
Pete
a63d0da528
Update gemini.py
2025-07-01 16:27:25 -05:00
getchannel
4fd8df208f
Add groundingMetadata events.py
2025-07-01 16:27:25 -05:00
getchannel
44d3bd30fa
Add groundingMetadata and logging gemini.py
2025-07-01 16:27:25 -05:00
getchannel
6e6e932370
Create 26g-gemini-multimodal-live-groundingMetadata.py
2025-07-01 16:27:25 -05:00
getchannel
baccf50417
update correct upload endpoint file_api.py
2025-07-01 16:27:25 -05:00
getchannel
7b1071b30d
Create 26f-gemini-multimodal-live-files-api.py
...
This is an example to test usage of the Files API integration. Specifically with the Gemini Multimodal Live Service.
2025-07-01 16:27:25 -05:00
getchannel
bd7ca94196
Update gemini.py
2025-07-01 16:27:25 -05:00
getchannel
1ec1aa76e9
Rename file_api to file_api.py
...
added proper .py to file name.
2025-07-01 16:27:25 -05:00
getchannel
77c369c3c7
add file_api __init__.py
2025-07-01 16:27:25 -05:00
getchannel
9171d4b040
add FileData class events.py
2025-07-01 16:27:25 -05:00
getchannel
e02b95fca5
Create file_api
2025-07-01 16:27:25 -05:00
getchannel
d45a07b5e5
add FileAPI to gemini.py
2025-07-01 16:27:25 -05:00
Mark Backman
0cdcfcee8d
Remove redundant import and global in SileroOnnxModel
2025-07-01 13:29:47 -07:00
Mark Backman
324546b4e7
Merge pull request #2098 from StrongMind/aws-session-token
...
Add support for session token in AWS Nova Sonic service
2025-07-01 16:25:38 -04:00
Filipi da Silva Fuchter
c8ee67a636
Merge pull request #2085 from pipecat-ai/filipi/freeze-test-python-3.10
...
Fixing pipeline freeze when using Python 3.10
2025-07-01 17:17:38 -03:00
Filipi Fuchter
b87c57c951
Adding missing docstring to the watchdog event
2025-07-01 17:12:18 -03:00
Filipi Fuchter
721f662bbe
Making cancel sentinel classes private
2025-07-01 17:09:05 -03:00
Filipi Fuchter
fccd48bfff
Fixing pipeline freeze when using Python 3.10
2025-07-01 17:05:18 -03:00
Filipi Fuchter
5310d903ec
Adding the requirements and needed variables for the freeze-test example.
2025-07-01 17:04:27 -03:00
Mark Backman
8cbce555e4
Add user_id to stt_traced decorator
2025-07-01 13:01:48 -07:00
Mark Backman
f6112713e8
Add user_id to TranscriptionFrame and InterimTranscriptionFrame pushed by STTServices
2025-07-01 12:59:20 -07:00
Mark Backman
cc637f4dea
Clean up docstrings after DirectFunction merge ( #2105 )
...
* Add missing import for FunctionCallParams
* Update docstrings in direct_function
* Docstring fixes for run.py
* Remove unused imports in llm_service
* Add missing docstrings to llm_service
* Remove FunctionCallParams import
* Wording improvements
* Type checking for FunctionCallParams
2025-07-01 15:22:30 -04:00
kompfner
7f76a14c54
Merge pull request #2104 from pipecat-ai/pk/changelog-fix
...
Whoops—fix mistake in CHANGELOG (`FlowsFunctionSchema` -> `FunctionSc…
2025-07-01 15:06:14 -04:00
Yousif Astarabadi
58675f4d5a
renamed clean schema to alternate schema
2025-07-01 11:50:12 -07:00
Paul Kompfner
d50e6db312
Whoops—fix mistake in CHANGELOG (FlowsFunctionSchema -> FunctionSchema)
2025-07-01 14:24:27 -04:00
kompfner
de74284a8e
Merge pull request #2051 from pipecat-ai/pk/direct-functions
...
Implement "direct functions", which allow you to bypass specifying a …
2025-07-01 14:19:33 -04:00
Aleix Conchillo Flaqué
4c9a295b28
Merge pull request #2095 from pipecat-ai/aleix/examples-smallwebrtc-sdp-munging
...
examples: add --esp32 for SDP munging if host name specified
2025-07-01 09:07:42 -07:00
Mark Backman
0968f36d3e
fix: remove javascript directory from the websocket README
2025-07-01 09:51:02 -04:00
Mark Backman
fd570b0377
Update the remaining docstrings, update pre-commit hook, add docstring formatting CI, update CONTRIBUTING with formatting guidance ( #2089 )
2025-07-01 00:37:04 -04:00
Paul Shippy
68ea5ee570
Add to change log
2025-06-30 17:39:42 -07:00
Paul Shippy
f891140a74
Update sample to take in session token
2025-06-30 17:35:50 -07:00
Paul Shippy
5ed2d7ac2b
Add session token option for AWS
2025-06-30 17:31:31 -07:00
Pete
a297e4208e
Merge branch 'main' into groundingMetadata
2025-06-30 19:48:55 -04:00
Aleix Conchillo Flaqué
b713527da0
examples: add --esp32 for SDP munging if host name specified
2025-06-30 13:27:52 -07:00
Kwindla Hultman Kramer
224d2cedc8
Merge pull request #2088 from pipecat-ai/khk/gemini-thinking-default
...
Turn off thinking for Gemini models by default
2025-06-30 10:32:54 -07:00
Kwindla Hultman Kramer
55cfea776f
Merge branch 'main' into khk/gemini-thinking-default
2025-06-30 10:32:42 -07:00
Paul Kompfner
d7a2078e0b
Added CHANGELOG entry describing "direct" functions
2025-06-30 10:59:36 -04:00
Paul Kompfner
a3e540eb32
Rename examples/foundational/14s-function-calling-direct.py to examples/foundational/14t-function-calling-direct.py, since a new "14s" example was added
2025-06-30 10:44:55 -04:00
Paul Kompfner
e01c20be84
Remove unused import and tweak a comment
2025-06-30 10:36:47 -04:00
Paul Kompfner
ce3ca418c2
Unit tests for "direct" functions
2025-06-30 10:36:47 -04:00
Paul Kompfner
15b9a5faf6
Implement "direct functions", which allow you to bypass specifying a function configuration (as a FunctionSchema or in a provider-specific format) and use the Python function directly. Metadata is gathered automatically from the function signature and docstring.
2025-06-30 10:36:42 -04:00
Kwindla Hultman Kramer
3afa30894f
Turn off thinking for Gemini models by default
2025-06-28 12:23:35 -07:00
Mark Backman
0ecfa827e6
Improve docstrings for services and processors ( #2087 )
2025-06-28 13:39:45 -04:00
Aleix Conchillo Flaqué
e1b0db75eb
Merge pull request #2086 from pipecat-ai/aleix/watchdog-coroutine-helper
...
add watchdog coroutine helper
2025-06-27 11:10:10 -07:00
Aleix Conchillo Flaqué
b0c773189f
AWSNovaSonicLLMService: fix error with watchdog_coroutine()
2025-06-27 11:09:40 -07:00
Aleix Conchillo Flaqué
3064326834
utils.asyncio: added watchdog_coroutine()
2025-06-27 11:09:40 -07:00
Mark Backman
c67e50fe34
Merge pull request #2084 from pipecat-ai/mb/update-evals-nova-sonic
...
Add 40-aws-nova-sonic to release evals list
2025-06-27 09:47:59 -04:00
Mark Backman
9d45e3eca1
Merge pull request #2079 from pipecat-ai/mb/fix-42-incorrect-import
...
fix: example 42 incorrect import
2025-06-27 09:47:47 -04:00
Mark Backman
43a24d15f6
Add 40-aws-nova-sonic to release evals list
2025-06-27 08:34:39 -04:00
Yousif Astarabadi
cafbda1668
remove openai from mcp run http example
2025-06-26 20:21:07 -07:00
Yousif Astarabadi
86c26fd64c
moved needs_mcp_clean_schema to LLMService
2025-06-26 20:09:12 -07:00
Yousif Astarabadi
0c20668008
fixed linter errors
2025-06-26 20:08:26 -07:00
Yousif Astarabadi
92df8dc43c
fix formatting
2025-06-26 20:08:23 -07:00
Yousif Astarabadi
9d5f5844b8
clean mcp schema for gemini models, update http mcp example to use gemini
2025-06-26 20:07:54 -07:00
Mark Backman
2cf31884d0
fix: example 42 incorrect import
2025-06-26 21:52:14 -04:00
Aleix Conchillo Flaqué
19354c6f2d
Merge pull request #2078 from pipecat-ai/aleix/hotfix-0.0.73
...
just a quick hotfix for 0.0.73
2025-06-26 17:31:40 -07:00
Aleix Conchillo Flaqué
0b2079ad41
update CHANGELOG for 0.0.73
2025-06-26 17:02:12 -07:00
Aleix Conchillo Flaqué
5f18c3af70
OpenAIRealtimeLLMContext: fix circular dependency
2025-06-26 17:01:45 -07:00
Aleix Conchillo Flaqué
0a40285d43
update FrameProcessor.watchdog_timers_enabled references
2025-06-26 16:26:12 -07:00
Vanessa Pyne
5b1c328541
Merge pull request #2075 from pipecat-ai/vp-mcp-lint
...
mcp_service: lint
2025-06-26 15:25:39 -05:00
vipyne
37929533af
mcp_service: lint
2025-06-26 15:00:20 -05:00
Vanessa Pyne
3b92113680
Merge pull request #2030 from yousifa/mcp-streaming-http
...
MCPClient streamable_http transport support
2025-06-26 14:57:31 -05:00
Yousif
46b52cb9bb
Merge branch 'main' into mcp-streaming-http
2025-06-26 12:30:43 -07:00
Mark Backman
f0bcc9d9ba
Add MCPClient docstrings. Removed google specific cleanup, changed example to openai
2025-06-26 12:29:45 -07:00
Yousif Astarabadi
1cac028bfe
example using http transport for mcp client
2025-06-26 12:16:35 -07:00
Yousif Astarabadi
4956886819
updated error message with StreamableHttpParameters
2025-06-26 12:16:28 -07:00
Yousif Astarabadi
c720cfc7c7
updated streamablehttp to use StreamableHttpParameters type
2025-06-26 12:16:26 -07:00
Yousif Astarabadi
8fcef5628f
added streamablehttp support, bumped mcp version, added additional headers and streamable_http params to MCPClient
2025-06-26 12:16:19 -07:00
Aleix Conchillo Flaqué
c4a72802f0
Merge pull request #2074 from pipecat-ai/aleix/pipecat-0.0.72
...
update CHANGELOG for 0.0.72
2025-06-26 12:10:14 -07:00
Aleix Conchillo Flaqué
917394803c
update CHANGELOG for 0.0.72
2025-06-26 11:42:52 -07:00
Mark Backman
01040ddcdd
Merge pull request #2071 from pipecat-ai/mb/services-docstrings-update
...
Add/update docstrings to LLM services
2025-06-26 14:42:32 -04:00
Aleix Conchillo Flaqué
7947497f7e
Merge pull request #2073 from a6kme/patch-1
...
Start HeartBeat when all processors have processed StartFrame
2025-06-26 11:34:46 -07:00
Aleix Conchillo Flaqué
539ca5856f
Merge pull request #2072 from pipecat-ai/aleix/utils-watchdog-cleanup
...
utils(asyncio): simplify watchdog helpers
2025-06-26 11:29:21 -07:00
Abhishek
89c801f82c
Start HeartBeat when all processors have processed StartFrame
...
Some of the processors like STTService and TTSService don't push StartFrame ahead in the pipeline, unless they have connected with their service providers. This delays StartFrame in downstream processors.
If we receive HeartBeat frame before StartFrame, we will get AttributeError `'Processor' object has no attribute '_FrameProcessor__input_queue'`.
Idea is to start HeartBeats after StartFrame has been processed by all the Processors in the pipeline.
2025-06-26 23:28:37 +05:30
Aleix Conchillo Flaqué
3de4f22d34
utils(asyncio): simplify watchdog helpers
2025-06-26 09:40:42 -07:00
Mark Backman
0e4d2be98c
Update AzureRealtimeBetaLLMService docstrings
2025-06-26 12:12:00 -04:00
Mark Backman
d8ce108ccd
Update OpenAIRealtimeBetaLLMService docstrings
2025-06-26 12:06:47 -04:00
Mark Backman
d123cd4b2b
Update GeminiMultimodalLiveLLMService docstrings
2025-06-26 11:47:30 -04:00
Aleix Conchillo Flaqué
4d34aa7cd6
Merge pull request #2069 from pipecat-ai/aleix/utils-asyncio-package
...
move things to new utils.asyncio package
2025-06-26 08:26:47 -07:00
Aleix Conchillo Flaqué
b860e94582
move things to new utils.asyncio package
2025-06-26 08:24:25 -07:00
Aleix Conchillo Flaqué
9d653e3788
Merge pull request #2068 from pipecat-ai/aleix/task-manager-dont-warn-reset-watchdog
...
TaskManager: don't warn on reset_watchdog()
2025-06-26 08:23:51 -07:00
Mark Backman
9e518cf2ba
Update AWSNovaSonicLLMService docstrings
2025-06-26 11:21:18 -04:00
Mark Backman
2856372ad6
Update TogetherLLMService docstrings
2025-06-26 11:01:35 -04:00
Mark Backman
efbf574613
Update SambaNovaLLMService docstrings
2025-06-26 11:00:40 -04:00
Mark Backman
c018eb2f0e
Update QwenLLMService docstrings
2025-06-26 10:57:42 -04:00
Mark Backman
d7bfe54b7c
Update PerplexityLLMService docstrings
2025-06-26 10:56:48 -04:00
Mark Backman
137282b7a9
Update OpenRouterLLMService docstrings
2025-06-26 10:53:42 -04:00
Mark Backman
769f8c8f34
Update OpenPipeLLMService docstrings
2025-06-26 10:53:05 -04:00
Mark Backman
8b8a37ae7c
Update OLLamaLLMService docstrings
2025-06-26 10:48:19 -04:00
Mark Backman
56e2b006f5
Update NimLLMService docstrings
2025-06-26 10:47:26 -04:00
Mark Backman
79cca05e43
Update GroqLLMService docstrings
2025-06-26 10:46:07 -04:00
Mark Backman
166c8e8e82
Update GrokLLMService docstrings
2025-06-26 10:39:46 -04:00
Mark Backman
9b64d2c325
Update GoogleLLMService docstrings
2025-06-26 10:37:22 -04:00
Mark Backman
03e3e9fae9
Update FireworksLLMService docstrings
2025-06-26 10:28:35 -04:00
Mark Backman
65234ae41a
Update DeepSeekLLMService docstrings
2025-06-26 10:27:36 -04:00
Mark Backman
3828df8cf9
Update CerebrasLLMService docstrings
2025-06-26 10:26:42 -04:00
Mark Backman
9cbe85bf99
Update AzureLLMService docstrings
2025-06-26 10:25:17 -04:00
Mark Backman
7bf805b829
Update AWSBedrock docstrings
2025-06-26 10:23:40 -04:00
Mark Backman
990ee436e1
Add Anthropic docstrings
2025-06-26 07:42:22 -04:00
Mark Backman
1cd42066a6
Merge pull request #2067 from pipecat-ai/mb/update-docstrings-for-ref-docs
...
Update base service class docstrings for better docs auto-generation
2025-06-26 07:07:59 -04:00
Filipi da Silva Fuchter
ba43558049
Merge pull request #2066 from pipecat-ai/filipi/sentry_freeze_test
...
Enabling watchdog and sentry into the freeze-test
2025-06-26 08:01:51 -03:00
Mark Backman
951c8d34da
Add special case handling for STT, TTS, LLM
2025-06-26 00:15:09 -04:00
Mark Backman
ac61139243
Add OpenAI LLM docstrings
2025-06-26 00:06:57 -04:00
Mark Backman
5b8f1fe3e3
Add Cartesia TTS docstrings
2025-06-25 23:50:55 -04:00
Mark Backman
0aa197e4a4
Add docstrings to DeepgramSTTService
2025-06-25 23:36:04 -04:00
Mark Backman
f04e058c96
Programmatically set the copyright date in docs
2025-06-25 23:29:37 -04:00
Mark Backman
6ef2ae12b7
Mock mcp imports
2025-06-25 23:29:37 -04:00
Mark Backman
fe6bbdaefe
Skip dataclass attributes to remove duplicate entries
2025-06-25 23:29:37 -04:00
Mark Backman
cc66fddca9
Modify docs auto-gen rules to remove duplicate parameters listing
2025-06-25 23:29:37 -04:00
Mark Backman
04b70ddf13
Add MCPClient docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
bb3bb8d9c6
Improve WebsocketService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
f80f62c7d1
Add VisionService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
2007ae4317
Add ImageGenService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
a1e5a1eff4
Add AIService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
691999b402
Add AIServices docstring
2025-06-25 22:38:11 -04:00
Mark Backman
33f3a4cea1
Add TTSService docstrings
2025-06-25 22:38:11 -04:00
Mark Backman
ab1d2dbe6a
Add STTService docstrings
2025-06-25 22:27:07 -04:00
Mark Backman
f622b281d0
Make call_start_function a private function in llm_service
2025-06-25 22:23:13 -04:00
Mark Backman
fb12bf9b4c
Update LLMService docstrings
2025-06-25 22:23:13 -04:00
Aleix Conchillo Flaqué
27af50087e
TaskManager: don't warn on reset_watchdog()
2025-06-25 17:29:45 -07:00
Filipi Fuchter
03502bed52
Enabling watchdog and sentry into the freeze-test
2025-06-25 20:53:30 -03:00
Aleix Conchillo Flaqué
27c7e2d150
Merge pull request #2063 from pipecat-ai/aleix/watchdog-timers-remove-start-watchdog
...
no need to call start_watchdog() only reset_watchdog()
2025-06-25 16:47:44 -07:00
Aleix Conchillo Flaqué
e81d387971
TaskManager: rely on add_done_callback()
2025-06-25 16:44:20 -07:00
Aleix Conchillo Flaqué
ef1ade3a71
allow enabling watchdog timers per frame processor or task
2025-06-25 16:36:19 -07:00
Aleix Conchillo Flaqué
4f032f5b96
update keepalive times depending on watchdog timers
2025-06-25 15:55:16 -07:00
Aleix Conchillo Flaqué
72cb967780
update CHANGELOG with watchdog timers updates
2025-06-25 15:55:16 -07:00
Aleix Conchillo Flaqué
357934a644
watchdog timers are disabled by default use enable_watchdog_timers
2025-06-25 15:55:16 -07:00
Aleix Conchillo Flaqué
327973657f
TaskManager: remove wathcdog timer when main task is done
2025-06-25 11:26:21 -07:00
Aleix Conchillo Flaqué
d2730e6741
GooglSTTService: cleanup request queues
2025-06-25 11:12:32 -07:00
Aleix Conchillo Flaqué
eb5ecab104
no need to call start_watchdog() only reset_watchdog()
2025-06-25 11:12:32 -07:00
Mark Backman
202055a9b8
Merge pull request #2065 from pipecat-ai/mb/fix-configdict-openai-realtime
...
fix: add missing ConfigDict import in openai_realtime_beta/events
2025-06-25 11:40:35 -04:00
Mark Backman
7034a9e3fd
fix: add missing ConfigDict import in openai_realtime_beta/events
2025-06-25 11:32:29 -04:00
Pete
1cf0b35ac1
Merge branch 'main' into groundingMetadata
2025-06-24 22:00:16 -04:00
Filipi da Silva Fuchter
8f7ed12262
Merge pull request #2061 from pipecat-ai/not_force_bot_speaking
...
Not forcing the bot resume speaking in case we receive no transcription.
2025-06-24 20:57:46 -03:00
Aleix Conchillo Flaqué
96b5320ef9
Merge pull request #2055 from pipecat-ai/aleix/fix-sentry-async
...
SentryMetrics: send metrics to sentry asynchronously
2025-06-24 16:32:01 -07:00
Filipi Fuchter
d5cd742237
Not forcing the bot resume speaking in case we receive no transcription.
2025-06-24 20:12:49 -03:00
Aleix Conchillo Flaqué
1f1da8942d
SentryMetrics: send metrics to sentry asynchronously
2025-06-24 15:56:08 -07:00
Mark Backman
7953e1e9d9
Merge pull request #2054 from pipecat-ai/mb/telnyx-catch-hangup-error
...
fix: Telnyx, catch error when user has hung up the call first
2025-06-24 18:04:19 -04:00
Mark Backman
d6f7ecc0a3
fix: Telnyx, catch error when user has hung up the call first
2025-06-24 17:28:00 -04:00
Mark Backman
3eed316049
Merge pull request #2020 from snova-jorgep/snova-jorgep/sambanova-integration
...
Add Sambanova LLM and STT integration
2025-06-24 17:04:24 -04:00
Jorge Piedrahita Ortiz
851cf079c3
Merge branch 'main' into snova-jorgep/sambanova-integration
2025-06-24 16:00:28 -05:00
jhpiedrahitao
dfb0da32a9
fmt
2025-06-24 15:59:40 -05:00
Aleix Conchillo Flaqué
f450da57e5
Merge pull request #2056 from pipecat-ai/khk/fix-22d
...
Update google libraries used in google audio-in examples
2025-06-24 13:47:59 -07:00
Aleix Conchillo Flaqué
2ec6b6c995
Merge pull request #2060 from pipecat-ai/aleix/watchdog-timeout-secs
...
FrameProcessor: use watchdog_timeout_secs
2025-06-24 13:36:39 -07:00
Aleix Conchillo Flaqué
53b769a8ec
FrameProcessor: use watchdog_timeout_secs
2025-06-24 13:33:47 -07:00
Filipi da Silva Fuchter
4f9adc173a
Merge pull request #2004 from pipecat-ai/filipi/pipeline_freeze
...
Pipeline freeze improvements
2025-06-24 17:20:38 -03:00
Filipi Fuchter
dc4a58877e
Fixing merge conflict.
2025-06-24 17:12:40 -03:00
Filipi Fuchter
a6243a6fe7
Merge branch 'main' into filipi/pipeline_freeze
...
# Conflicts:
# CHANGELOG.md
# src/pipecat/pipeline/task.py
# src/pipecat/processors/frame_processor.py
# src/pipecat/transports/base_input.py
2025-06-24 17:11:21 -03:00
Aleix Conchillo Flaqué
cf5f1b541a
Merge pull request #2049 from pipecat-ai/aleix/introduce-watchdog-timers
...
introduce watchdog timers
2025-06-24 13:00:57 -07:00
Filipi Fuchter
70e6c48233
Mentioning the fixes in the changelog.
2025-06-24 16:56:46 -03:00
Filipi Fuchter
51f7d14d0a
Merge branch 'main' into filipi/pipeline_freeze
2025-06-24 16:44:07 -03:00
Filipi Fuchter
4853d5d1fc
Handling the case where user stopped speaking but no new aggregation received.
2025-06-24 16:42:10 -03:00
Aleix Conchillo Flaqué
076a8938f0
add start_watchdog/reset_watchdog to tasks
2025-06-24 11:56:20 -07:00
Aleix Conchillo Flaqué
5a3457ba33
introduce task watchdog timers
2025-06-24 11:56:20 -07:00
Aleix Conchillo Flaqué
2fc224384d
Merge pull request #2059 from pipecat-ai/aleix/heartbeatframe-control-frames
...
HeartbeatFrames are now control frames
2025-06-24 11:55:18 -07:00
Aleix Conchillo Flaqué
a4e6ea5a3f
HeartbeatFrames are now control frames
2025-06-24 11:27:39 -07:00
Vanessa Pyne
d3c211f293
Merge pull request #2058 from pipecat-ai/vp-mcp-sse-up
...
follow up to #1887 - proper MCP SSE support
2025-06-24 13:06:01 -05:00
vipyne
20047c369e
mcp: update examples to use SseServerParameter
2025-06-24 12:58:39 -05:00
vipyne
dd1ff237a8
lint mcp_service
2025-06-24 12:58:33 -05:00
Vanessa Pyne
39d80d0b0e
Merge pull request #1887 from ezun-kim/feat/mcp-sse-params
...
Fix SSE server connection handling for MCP client
2025-06-24 12:58:05 -05:00
Kwindla Hultman Kramer
7a48316534
update google libraries used in google audio-in examples
2025-06-24 09:52:04 -07:00
Filipi da Silva Fuchter
031a93ac46
Merge pull request #2053 from pipecat-ai/sentry_dsn_environment_variable
...
Creating an environment variable for sentry dsn.
2025-06-24 12:10:20 -03:00
Mark Backman
ea6cc1aa95
Merge pull request #2052 from pipecat-ai/mb/11labs-keepalive
...
Send context_id when available in ElevenLabsTTSService keepalive message
2025-06-24 11:07:07 -04:00
Filipi Fuchter
365260ec44
Creating an environment variable for sentry dsn.
2025-06-24 11:57:14 -03:00
Mark Backman
2eb244c80a
Send context_id when available in ElevenLabsTTSService keepalive message
2025-06-24 10:52:49 -04:00
Mark Backman
aee3011d61
Merge pull request #2037 from pipecat-ai/mb/11labs-close-context
...
Fix: Correctly close the context for ElevenLabsTTSService
2025-06-24 07:44:22 -04:00
Aleix Conchillo Flaqué
40496e7b0f
Merge pull request #2034 from pipecat-ai/khk/pause-frames
...
small fix for processor pause/resume frames
2025-06-23 17:08:41 -07:00
Kwindla Hultman Kramer
6b24f89fa7
small fix for processor pause/resume frames
2025-06-23 16:44:32 -07:00
Filipi Fuchter
2097800042
Allowing to clear the turn analyser
2025-06-23 18:50:37 -03:00
Filipi Fuchter
6739318e68
Forcing user stopped speaking due to timeout to receive audio frame!
2025-06-23 18:50:02 -03:00
Filipi Fuchter
d0bd563d42
Logging the BaseException inside the cancel_task.
2025-06-23 18:48:44 -03:00
Filipi Fuchter
74280829fc
Fixed an issue with the FastAPIWebsocketClient to disconnect in case the websocket is already closed.
2025-06-23 18:48:03 -03:00
Filipi Fuchter
3fde8880f2
Fixed a couple of places inside the FrameProcessor where we should not raise the exceptions.
2025-06-23 18:47:54 -03:00
Filipi Fuchter
98d39e0d38
Logging the last 10 frames received in case idle timeout is detected.
2025-06-23 18:47:17 -03:00
Filipi Fuchter
c9cebb5ffe
Created an example for testing the bot and try to create freezing conditions.
2025-06-23 18:46:58 -03:00
Mark Backman
f52ac6e99c
Merge pull request #1998 from pipecat-ai/mb/fix-38-smart-turn-fal
2025-06-23 17:15:29 -04:00
Mark Backman
787a6b1c6a
Merge pull request #2038 from pipecat-ai/mb/openai-realtime-model-update
...
Update OpenAIRealtimeBetaLLMService model to gpt-4o-realtime-preview-…
2025-06-23 16:30:31 -04:00
Mark Backman
d00a91074e
Update OpenAIRealtimeBetaLLMService model to gpt-4o-realtime-preview-2025-06-03
2025-06-23 16:26:42 -04:00
Mark Backman
4e11497a38
Merge pull request #2048 from thibaudbrg/patch-1
...
Fix missing video_in_enabled in vision bot.py for Moondream template
2025-06-23 16:11:50 -04:00
Tibo
0443d5202a
Fix missing video_in_enabled in vision bot.py for Moondream template
...
The parameter video_in_enabled=True was missing in DailyParams, which prevented image capture
from working. Without this parameter, UserImageRequestFrame would be sent but no actual image data would be captured from participants.
This fix enables the "Let me take a look" functionality to work as
intended by allowing the transport to capture video frames for vision processing with Moondream.
2025-06-23 21:17:41 +02:00
Mark Backman
633c25cb13
Merge pull request #2039 from pipecat-ai/mb/remove-lang-validation
...
OpenAIRealtimeBetaLLMService accepts language for all InputAudioTrans…
2025-06-23 14:41:09 -04:00
jhpiedrahitao
d07f45132f
update changelog
2025-06-23 12:54:00 -05:00
jhpiedrahitao
a51280afa6
add 13 and 14 type foundational examples for sambanova iontegration
2025-06-23 12:53:32 -05:00
Jorge Piedrahita Ortiz
be14eb2460
Merge branch 'pipecat-ai:main' into snova-jorgep/sambanova-integration
2025-06-23 12:23:00 -05:00
jhpiedrahitao
e26dbffcbe
update sambanova init imports
2025-06-23 12:22:08 -05:00
Mark Backman
59992fd24a
Merge pull request #2044 from pipecat-ai/mb/daily-rest-docstring
...
Add missing arg docstring in DailyRESTHelper
2025-06-23 11:24:44 -04:00
Mark Backman
455362ccaf
Merge pull request #2022 from pipecat-ai/mb/turn-tracking-end-cancel-frame
...
TurnTrackingObserver ends turn upon seeing EndFrame, CancelFrame
2025-06-23 11:24:27 -04:00
Mark Backman
16c0e2460b
TurnTrackingObserver ends turn upon seeing EndFrame, CancelFrame
2025-06-23 11:08:51 -04:00
Matej Marinko
c54084b7a4
Fix deadlock on STT service stop
2025-06-23 14:18:29 +02:00
Mark Backman
92246f7125
Add missing arg docstring in DailyRESTHelper
2025-06-22 13:44:59 -04:00
Pete
e3fe040017
Update gemini.py
2025-06-21 14:43:15 -04:00
Pete
ae5e3e2dc4
Merge branch 'main' into groundingMetadata
2025-06-21 12:16:32 -04:00
Pete
77378d2779
Merge branch 'pipecat-ai:main' into groundingMetadata
2025-06-21 12:08:49 -04:00
Pete
4106f0dabe
Merge branch 'pipecat-ai:main' into main
2025-06-21 10:54:25 -04:00
Mark Backman
7737335ec9
OpenAIRealtimeBetaLLMService accepts language for all InputAudioTranscription models
2025-06-21 10:08:46 -04:00
Mark Backman
5cc9b7e0d1
Fix: Correctly close the context for ElevenLabsTTSService
2025-06-20 15:47:03 -04:00
Mark Backman
8c6a441064
Merge pull request #2035 from smokyabdulrahman/feat/aws-polly-lexicon-names-support
...
Support AWS Polly Lexicon Names parameter
2025-06-20 10:03:27 -04:00
Alrahma
fddc058ce2
add CHANGELOG entry
2025-06-20 14:15:24 +01:00
Alrahma
89750086c5
Support AWS Polly Lexicon Names parameter
...
Documentation reference
[AWS Managing
Lexicons](https://docs.aws.amazon.com/polly/latest/dg/managing-lexicons.html )
2025-06-20 09:47:46 +01:00
Aleix Conchillo Flaqué
e69406c7e2
Merge pull request #2032 from pipecat-ai/aleix/aws-nova-sonic-function-calls
...
AWSNovaSonicLLMService: fix function calling
2025-06-19 14:42:47 -07:00
Aleix Conchillo Flaqué
878ae42d84
AWSNovaSonicLLMService: fix function calling
2025-06-19 14:26:34 -07:00
Aleix Conchillo Flaqué
d34ebfc126
Merge pull request #2027 from pipecat-ai/aleix/task-on-idle-timeout-repeated
...
PipelineTask: fix repeated on_idle_timeout
2025-06-19 14:13:10 -07:00
Aleix Conchillo Flaqué
028f7b2d65
PipelineTask: fix repeated on_idle_timeout
2025-06-19 09:14:10 -07:00
Mark Backman
0aa3ec50f2
Merge pull request #2023 from pipecat-ai/mb/allow-interruptions-true
...
allow_interruptions=True
2025-06-19 10:24:53 -04:00
Mark Backman
9146def21b
Update examples to use default allow_interruptions, fixes to align examples
2025-06-19 10:07:32 -04:00
Aleix Conchillo Flaqué
ebb23a5a8c
Merge pull request #2024 from pipecat-ai/aleix/audio-buffer-processor-sync-issues
...
AudioBufferProcessor: treat all streams as intermittent
2025-06-18 18:26:38 -07:00
Aleix Conchillo Flaqué
b118082984
AudioBufferProcessor: treat all streams as intermittent
...
This fixes an issue with STTMuteFilter that prevents user audio to be pushed
downstream.
2025-06-18 18:23:31 -07:00
Mark Backman
b5c0ac5f25
allow_interruptions=True
2025-06-18 20:33:40 -04:00
Filipi da Silva Fuchter
dc78e874af
Merge pull request #2021 from pipecat-ai/gladia_stt_improvements_changelog
...
Adding the GladiaSTTService improvements in the changelog.
2025-06-18 18:25:36 -03:00
Filipi Fuchter
c30bde0a2b
Adding the GladiaSTTService improvements in the changelog.
2025-06-18 16:19:58 -03:00
Filipi da Silva Fuchter
171597fbe9
Merge pull request #1952 from jqueguiner/feat/gladia-auto-reconnect
...
feat: Enhance GladiaSTTService with reconnection and audio buffer management features
2025-06-18 16:14:58 -03:00
jhpiedrahitao
fae2d272d5
fmt
2025-06-18 10:53:06 -05:00
jhpiedrahitao
03a067d3e6
add sambanova llm and stt
2025-06-18 10:50:42 -05:00
Mark Backman
f5d028f3b3
Merge pull request #2017 from pipecat-ai/mb/fix-11labs-voice-settings
...
fix: ElevenLabsTTSService voice settings not being sent
2025-06-18 09:56:46 -04:00
Mark Backman
e5b7dbba90
fix: ElevenLabsTTSService voice settings not being sent
2025-06-18 09:49:17 -04:00
Filipi da Silva Fuchter
7ffba1e0b3
Merge pull request #1950 from pipecat-ai/filipi/tavus_custom_tracks
...
Sending audio to Tavus using custom tracks
2025-06-18 07:57:19 -03:00
Filipi Fuchter
72cdbf0b78
Mentioning the Tavus improvements in the changelog.
2025-06-18 07:46:04 -03:00
Filipi Fuchter
8b4a86f629
Ignoring the audio level when creating the custom tracks.
2025-06-18 07:45:54 -03:00
Filipi Fuchter
fa15e64fc9
Test script that mimics the behavior expected to be supported by Tavus.
2025-06-18 07:45:38 -03:00
Filipi Fuchter
564f064c71
Refactoring TavusVideoService to send audio using WebRTC audio tracks instead of app-messages.
2025-06-18 07:44:51 -03:00
Filipi Fuchter
4062c7afa0
Refactoring TavusTransport to send audio using WebRTC audio tracks instead of app-messages.
2025-06-18 07:44:38 -03:00
Jean-Louis Queguiner
8071c4ba1c
Merge branch 'main' into feat/gladia-auto-reconnect
2025-06-18 08:57:21 +02:00
jqueguiner
3d0ffbc832
🐛 (stt.py): handle websocket connection closure gracefully and log warnings
...
♻️ (stt.py): refactor reconnection logic into a separate method for clarity
✨ (stt.py): implement exponential backoff for reconnection attempts to improve reliability
2025-06-18 08:52:43 +02:00
Filipi da Silva Fuchter
1cac94bf97
Merge pull request #1925 from pipecat-ai/filipi/websocket_transport_example_twilio
...
Websocket client web app to test Twilio.
2025-06-17 16:24:18 -03:00
Mark Backman
c94c51d44f
Fix: 38-smart-turn-fal
2025-06-17 15:10:52 -04:00
Mark Backman
96958933af
Merge pull request #2016 from pipecat-ai/aleix/example-params-allow-async-objects
...
examples: create transport params async
2025-06-17 15:08:37 -04:00
Filipi Fuchter
2300c2632e
Refactoring how we are organizing the twilio chatbot examples and improving the readmes
2025-06-17 16:08:35 -03:00
Filipi Fuchter
cbd0529674
Merge branch 'main' into filipi/websocket_transport_example_twilio
2025-06-17 15:54:31 -03:00
Filipi da Silva Fuchter
5614e35ac4
Merge pull request #2015 from pipecat-ai/bumping_pipecat_required_versions
...
Bumping pipecat-ai-krisp required version
2025-06-17 15:42:20 -03:00
Aleix Conchillo Flaqué
c11172caba
examples: create transport params async
2025-06-17 11:37:42 -07:00
Filipi Fuchter
11b6e409bb
Bumping pipecat-ai-krisp required version
2025-06-17 15:22:31 -03:00
Aleix Conchillo Flaqué
3dca95aa3c
Merge pull request #2014 from pipecat-ai/aleix/daily-python-0.19.3
...
update daily-python to 0.19.3
2025-06-17 10:10:23 -07:00
Aleix Conchillo Flaqué
7ddc706434
update daily-python to 0.19.3
2025-06-17 09:30:28 -07:00
Aleix Conchillo Flaqué
20eebb08e9
update CHANGELOG with AWSTranscribeSTTService Polish support
2025-06-16 10:34:56 -07:00
Aleix Conchillo Flaqué
4abf41b85a
Merge pull request #2011 from wuodar/wuodar/polish-lang-aws-transcribe
...
Support polish language in Amazon Transcribe
2025-06-16 10:33:55 -07:00
Aleix Conchillo Flaqué
e426f7ee7c
Merge pull request #2012 from pipecat-ai/aleix/frame-pause-resume-frames
...
FrameProcessor: handle new FrameProcessorPauseFrame/FrameProcessorResumeFrame
2025-06-16 10:32:38 -07:00
Aleix Conchillo Flaqué
14dc6a7984
FrameProcessor: handle new FrameProcessorPauseFrame/FrameProcessorResumeFrame
2025-06-16 10:31:33 -07:00
Mark Backman
e0a24a3f07
Merge pull request #2006 from pipecat-ai/mb/expose-function-calls-in-progress
...
Expose has_function_calls_in_progress property
2025-06-16 12:49:07 -04:00
Mark Backman
d1bee22d73
Expose has_function_calls_in_progress property
2025-06-16 12:45:16 -04:00
Jon Taylor
d73f7908f2
Merge pull request #2008 from pipecat-ai/khk/groq-audio
...
fix groq wav file header parsing
2025-06-16 14:09:09 +01:00
Aleix Conchillo Flaqué
a4ea0d2b82
dev-requirements: update pyright 1.1.400 and ruff 0.11.13
2025-06-15 21:05:03 -07:00
Kacper Włodarczyk
e2c15169b8
feat: support polish language in Amazon Transcribe
2025-06-15 21:44:06 +02:00
Kwindla Hultman Kramer
fe16ed3c73
added changelog entry
2025-06-15 10:49:40 -07:00
Filipi Fuchter
80ce097f90
Using relative URL for the websocket.
2025-06-15 10:49:25 -03:00
Filipi Fuchter
eceaf8a46b
Making the path to the web client relative
2025-06-14 21:07:15 -03:00
Kwindla Hultman Kramer
1e3fa4a9c7
fix groq wav file header parsing
2025-06-14 17:41:44 -04:00
Pete
2ed1ed6821
Merge branch 'pipecat-ai:main' into main
2025-06-14 16:23:27 -04:00
Filipi da Silva Fuchter
dc640a7591
Merge pull request #2001 from pipecat-ai/filipi/google_stt_reconnection_issue
...
Fixed an issue with `GoogleSTTService` where it was constantly reconnecting
2025-06-13 08:29:18 -03:00
Filipi Fuchter
1f072d182c
Merge branch 'main' into filipi/google_stt_reconnection_issue
...
# Conflicts:
# CHANGELOG.md
2025-06-13 08:26:00 -03:00
Mark Backman
1d64e04ed5
Merge pull request #2002 from pipecat-ai/mb/google-fix-ttfb
...
Fix: GoogleLLMService TTFB
2025-06-12 12:10:01 -04:00
Mark Backman
22f4f0b79e
Update 14e example name
2025-06-12 11:45:59 -04:00
Mark Backman
69c63293fb
fix: GoogleLLMService TTFB value
2025-06-12 11:43:27 -04:00
Filipi Fuchter
c1db13ceeb
Fixed an issue with GoogleSTTService where it was constantly reconnecting before starting to receive audio from the user.
2025-06-12 12:07:33 -03:00
Matej Marinko
6d3a38842d
Merge branch 'main' of github.com:pipecat-ai/pipecat
2025-06-12 11:32:38 +02:00
Filipi Fuchter
70eadee0aa
Bumping the @pipecat-ai/websocket-transport dependency.
2025-06-11 18:30:16 -03:00
Pete
7360f79413
Merge branch 'pipecat-ai:main' into main
2025-06-11 13:16:19 -04:00
Aleix Conchillo Flaqué
228afe01ed
Merge pull request #1993 from pipecat-ai/aleix/pipecat-0.0.71
...
update CHANGELOG for 0.0.71
2025-06-10 14:42:09 -07:00
Aleix Conchillo Flaqué
61a5154e49
update CHANGELOG for 0.0.71
2025-06-10 14:34:30 -07:00
Sunah Suh
d3df75aaa0
Add additional_span_attributes param to PipelineTask for extra otel… ( #1992 )
2025-06-10 17:32:24 -04:00
Aleix Conchillo Flaqué
c59180dd6e
udpate CHANGELOG
2025-06-10 14:23:02 -07:00
Mark Backman
e4c2310632
Merge pull request #1990 from pipecat-ai/mb/more-cartesia-stt
...
Add Cartesia STT docs link to README, fix set_model error
2025-06-10 17:19:11 -04:00
Aleix Conchillo Flaqué
e1735a2da1
Merge pull request #1991 from pipecat-ai/aleix/pipecat-0.0.70
...
update CHANGELOG for 0.0.70
2025-06-10 14:08:52 -07:00
Aleix Conchillo Flaqué
c101c9c8e1
update CHANGELOG for 0.0.70
2025-06-10 13:37:28 -07:00
Aleix Conchillo Flaqué
96dc162de5
Merge pull request #1988 from pipecat-ai/aleix/update-examples-22b
...
examples(22b): remove unnecessary parallel pipeline branch
2025-06-10 12:58:37 -07:00
Mark Backman
257dbe3104
Fix model param error
2025-06-10 15:14:47 -04:00
Mark Backman
cd98657e3c
Add Cartesia STT docs link to README
2025-06-10 15:09:13 -04:00
Aleix Conchillo Flaqué
03eb22fe0a
examples(22b): remove unnecessary parallel pipeline branch
2025-06-10 09:05:58 -07:00
Pete
8d55e13750
remove audio_transcriber from gemini.py
...
unecessary import removed.
2025-06-10 11:22:16 -04:00
Pete
737e8e79c9
Merge branch 'main' into groundingMetadata
2025-06-10 11:12:35 -04:00
Pete
4d977fede0
Merge branch 'main' into main
2025-06-10 11:07:59 -04:00
Filipi Fuchter
0073a868d4
Websocket client web app to test Twilio.
2025-06-10 11:34:02 -03:00
Mark Backman
0bb61d72ab
Merge pull request #1984 from pipecat-ai/mb/cartesia-stt-cleanup
...
CartesiaSTTService cleanup
2025-06-10 10:30:18 -04:00
Mark Backman
f758508a82
Merge pull request #1978 from pipecat-ai/mb/rime-languages
...
Add languages to RimeHttpTTSService, extend lang support to German an…
2025-06-10 10:27:15 -04:00
Mark Backman
69d0218d7e
Add languages to RimeHttpTTSService, extend lang support to German and French
2025-06-10 10:20:41 -04:00
Aleix Conchillo Flaqué
eb5e5ab1df
update CHANGELOG
2025-06-09 20:22:39 -07:00
Aleix Conchillo Flaqué
093697906c
Merge pull request #1954 from WebinarGeek/wg/gladia-informal-translations
...
Gladia informal translations
2025-06-09 20:21:40 -07:00
Aleix Conchillo Flaqué
efe96b7ed1
Merge pull request #1986 from pipecat-ai/aleix/daily-python0.19.2
...
pyproject: update daily-python to 0.19.2
2025-06-09 19:46:14 -07:00
Aleix Conchillo Flaqué
7ecdd41ab9
pyproject: update daily-python to 0.19.2
2025-06-09 17:29:07 -07:00
Mark Backman
aec70d61e9
CartesiaSTTService cleanup
2025-06-09 15:20:57 -04:00
Mark Backman
2efac13344
Merge pull request #1983 from pipecat-ai/mb/exotel-resampling
...
Resample audio in ExotelFrameSerializer
2025-06-09 14:41:08 -04:00
Mark Backman
15aeb11c36
Resample audio in ExotelFrameSerializer
2025-06-09 14:02:25 -04:00
Mark Backman
e705f4d984
Merge pull request #1972 from Vaibhav159/vl_add_exotel_serializer
...
adding exotel serializer
2025-06-09 13:54:26 -04:00
Shrey Gupta
96fa62fdfe
[Add] Support for Cartesia AI STT ( #1982 )
2025-06-09 14:51:01 -03:00
Mark Backman
845c70797a
Merge pull request #1975 from pipecat-ai/mb/11labs-flush-context-reset
...
fix: ElevenLabsTTSService reset context when flushing audio
2025-06-09 13:21:25 -04:00
kompfner
16048956c3
Merge pull request #1956 from pipecat-ai/pk/make-add-observer-sync
...
Make `PipelineTask.add_observer()` synchronous. This allows callers t…
2025-06-09 13:19:34 -04:00
Mark Backman
cf2f4b5902
fix: ElevenLabsTTSService reset context when flushing audio
2025-06-09 13:17:55 -04:00
marcus-daily
db46f33f34
Update to Android transports 0.3.7
2025-06-09 17:09:59 +01:00
Aleix Conchillo Flaqué
25d1515daf
Merge pull request #1979 from pipecat-ai/aleix/buffer-tts-before-playback
...
buffer audio from TTS service before pushing frames
2025-06-09 08:43:55 -07:00
Paul Kompfner
a3469cd59f
Add CHANGELOG entry describing PipelineTask.add_observer() being made synchronous
2025-06-09 11:37:30 -04:00
Paul Kompfner
513ce26200
Add unit test exercising synchronous usage of PipelineTask.add_observer() right after initializing the PipelineTask (before anything else is done with it)
2025-06-09 11:30:24 -04:00
Paul Kompfner
1cd96f94ff
Make PipelineTask.add_observer() synchronous. This allows callers to call it before run()ning the PipelineTask first. Without this change, if they tried to do that, they would get an error because the TaskManager's event loop hadn't been set yet.
2025-06-09 11:30:24 -04:00
Aleix Conchillo Flaqué
901dd041f0
buffer audio from TTS service before pushing frames
2025-06-09 07:29:09 -07:00
Vaibhav159
a2ee94651e
removing resampling
2025-06-07 12:53:55 +05:30
Aleix Conchillo Flaqué
abdce063f1
Merge pull request #1973 from pipecat-ai/aleix/assemblyai-yield-none
...
AssemblyAISTTService: yield None instead of Frame()
2025-06-06 15:12:16 -07:00
Aleix Conchillo Flaqué
a33ce5e4bf
AssemblyAISTTService: yield None instead of Frame()
2025-06-06 14:41:01 -07:00
Filipi da Silva Fuchter
c9575eaef9
Merge pull request #1911 from pipecat-ai/filipi/websocket_transport_example
...
Adding support to WebsocketTransport
2025-06-06 17:25:07 -03:00
Filipi Fuchter
1e74476a71
Refactoring to use the observer inside the pipelinetask, and moving to start the bot inside on_client_ready.
2025-06-06 17:22:50 -03:00
Filipi Fuchter
82935884c4
Mentioning the new websocket example in the changelog.
2025-06-06 17:17:11 -03:00
Filipi Fuchter
d774a23768
Improving the readme to mention that can choose which server websocket to use.
2025-06-06 17:12:05 -03:00
Filipi Fuchter
e9f041e170
Removing the old websocket-server example
2025-06-06 17:09:01 -03:00
Filipi Fuchter
1f51b6e4f1
A Pipecat example demonstrating how to use WebsocketTransport
2025-06-06 17:08:43 -03:00
Filipi Fuchter
028650249c
Adding support in ProtobufFrameSerializer to deserialize MessageFrame.
2025-06-06 17:07:39 -03:00
Vaibhav159
534197239f
updating changelog
2025-06-07 00:24:54 +05:30
Vaibhav159
d2f4bb574c
adding exotel serializer
2025-06-07 00:22:41 +05:30
jqueguiner
25ff8ef37b
✨ (config.py): add new configuration options for lip-sync optimization, context adaptation, and additional context to enhance translation accuracy
...
♻️ (stt.py): increase default max buffer size from 5MB to 20MB to accommodate larger audio data
♻️ (stt.py): simplify audio sending logic by removing chunking and sending the entire buffered audio at once for improved performance
2025-06-05 16:51:29 -07:00
Aleix Conchillo Flaqué
07fb1a2c39
Merge pull request #1967 from counterleft/unused-http-client-session
...
Remove instantiation of unused http client session from certain examples
2025-06-05 12:59:01 -07:00
Aleix Conchillo Flaqué
581b800c43
Merge pull request #1961 from ken-kuro/patch-1
...
fix(piper-tts): typo
2025-06-05 12:57:58 -07:00
Aleix Conchillo Flaqué
30ca39287f
Merge pull request #1962 from ken-kuro/patch-2
...
fix(fastapi_websocket): typo
2025-06-05 12:57:22 -07:00
Aleix Conchillo Flaqué
01fa9698de
Merge pull request #1960 from pipecat-ai/aleix/disable-uvloop
...
disable uvloop by default and just let the user set it
2025-06-05 12:12:47 -07:00
Brian Mathiyakom
10bd969636
Remove instantiation of unused http client session
...
These examples don't make any HTTP requests with `session` so there
doesn't seem be a need to create one in the first place. Probably a
copy-paste from a previous example.
2025-06-05 11:45:13 -07:00
Kendrick Ha
f7761f2b61
fix(fastapi_websocket): typo
2025-06-05 13:55:28 +07:00
Kendrick Ha
49ff38a21f
fix(piper-tts): typo
2025-06-05 13:50:56 +07:00
Aleix Conchillo Flaqué
8d161306c7
disable uvloop by default and just let the user set it
2025-06-04 21:25:06 -07:00
Vanessa Pyne
027a82dff1
Merge pull request #1958 from pipecat-ai/vp-livekit-fix
...
fix: transports/services/livekit.py typo
2025-06-04 12:27:47 -05:00
vipyne
cb409d58e0
fix: transports/services/livekit.py typo
2025-06-04 11:14:21 -05:00
Dan Berg
094e2f8151
Fix formatting
2025-06-03 17:21:51 +02:00
Dan Berg
71d121aeb9
Update CHANGELOG.md explaining informal on Gladia TranslationConfig
2025-06-03 17:15:29 +02:00
Dan Berg
b1a88af43c
Add informal to Gladia TranslationConfig
2025-06-03 17:10:52 +02:00
Filipi da Silva Fuchter
f73eb4ebd9
Merge pull request #1949 from pipecat-ai/filipi/transport_destination_issue
...
Fixed transport destination issue
2025-06-03 08:41:34 -03:00
Filipi Fuchter
31ca9be299
Fixing missing await to self.reset.
2025-06-03 08:37:47 -03:00
jqueguiner
02cc6f3d56
Enhance GladiaSTTService with reconnection and audio buffer management features
...
- Added parameters for maximum reconnection attempts, reconnection delay, and maximum audio buffer size.
- Implemented automatic reconnection logic with exponential backoff.
- Introduced audio buffer management to handle audio data efficiently, including trimming excess data.
- Updated connection handling to ensure proper cleanup and management of WebSocket connections.
- Enhanced audio sending logic to support buffered audio transmission after reconnections.
2025-06-03 03:16:57 -07:00
Filipi Fuchter
1642c082d1
Describing the fix in the changelog.
2025-06-02 22:28:31 -03:00
Filipi Fuchter
892d213442
Fixing issue to keep the transport_destination.
2025-06-02 22:16:10 -03:00
Filipi Fuchter
fc24267e09
Waiting for the LLM response to reset.
2025-06-02 22:15:53 -03:00
Aleix Conchillo Flaqué
9b71bdc608
Merge pull request #1947 from pipecat-ai/aleix/pipecat-0.0.69
...
update CHANGELOG for 0.0.69
2025-06-02 12:51:51 -07:00
Aleix Conchillo Flaqué
310be89895
update CHANGELOG for 0.0.69
2025-06-02 12:07:50 -07:00
Aleix Conchillo Flaqué
71fbd57e12
Merge pull request #1938 from pipecat-ai/aleix/custom-interruption-strategies
...
allow custom interruption strategies
2025-06-02 12:05:50 -07:00
Aleix Conchillo Flaqué
ab4b48c823
examples(04a): fix daily_runner import
2025-06-02 12:01:26 -07:00
Aleix Conchillo Flaqué
532767cfa1
LLMUserContextAggregator: reset strategies when reseting the aggregator
2025-06-02 12:01:26 -07:00
Aleix Conchillo Flaqué
5512de3221
allow custom interruption strategies
2025-06-02 12:01:26 -07:00
Mark Backman
13546d5e8f
Merge pull request #1946 from pipecat-ai/mb/fix-11labs-context
...
fix: Use AudioContextWordTTSService context methods in ElevenLabsTTSS…
2025-06-02 14:55:49 -04:00
Mark Backman
c6f1aa8086
fix: Use AudioContextWordTTSService context methods in ElevenLabsTTSService
2025-06-02 14:49:05 -04:00
Mark Backman
5606c47cb7
Merge pull request #1945 from pipecat-ai/mb/gemini-2.0
...
Reverting Gemini Live model back to gemini-2.0-flash-live-001
2025-06-02 14:25:30 -04:00
Filipi da Silva Fuchter
7f7cd96211
Merge pull request #1944 from pipecat-ai/fixing_tavus_transport
...
Adding the direction when pushing the frame.
2025-06-02 15:21:58 -03:00
Filipi Fuchter
b828bfd890
Adding the direction when pushing the BotStartedSpeaking and BotStoppedSpeaking frames.
2025-06-02 15:05:56 -03:00
Mark Backman
31d084eb78
Reverting Gemini Live model back to gemini-2.0-flash-live-001
2025-06-02 13:29:05 -04:00
Mark Backman
ab18b280e9
Merge pull request #1943 from pipecat-ai/mb/add-transcription-19-openai
...
Add a TranscriptProcessor to 19-openai-realtime-beta.py
2025-06-02 13:01:52 -04:00
Mark Backman
24e89c4081
Merge pull request #1936 from pipecat-ai/mb/fix-01-quickstart
...
Add daily to the foundational examples requirements.txt
2025-06-02 12:55:36 -04:00
Mark Backman
e129390f56
Add a TranscriptProcessor to 19-openai-realtime-beta.py
2025-06-02 11:38:49 -04:00
Mark Backman
4d7c87bb4c
Merge pull request #1941 from pipecat-ai/vp-observer-up
...
chore: move observers arg in p2p-webrtc example; add deprecated to in…
2025-06-02 11:17:48 -04:00
Mark Backman
dac3f82a75
Merge pull request #1934 from counterleft/use-disconnect-on-small-webrtc-connection-example
...
Fix type checker error with missing function call in the small WebRTC transport example
2025-06-02 11:17:30 -04:00
Mark Backman
fd860921f1
Add daily to the foundational examples requirements.txt
2025-06-02 11:10:49 -04:00
vipyne
0482ccd48b
chore: move observers arg in p2p-webrtc example; add deprecated to in line comments
2025-06-02 09:41:09 -05:00
Dominic Stewart
b8b1990617
Fix example env file ( #1939 )
...
* Fixed typo in the example env files
2025-06-02 15:12:43 +09:00
Dominic Stewart
70951b1198
Add simplified pstn examples ( #1822 )
...
* Add simplified pstn examples
* Add daily_twilio_sip_dial_out example
2025-06-02 14:50:21 +09:00
Mark Backman
6d24514ace
Merge pull request #1937 from pipecat-ai/mb/fix-message-for-logging
...
fix: correctly display non-roman characters
2025-06-01 12:49:48 -04:00
Aleix Conchillo Flaqué
49915ceb84
Merge pull request #1683 from pipecat-ai/aleix/run-function-calls-sequentially
...
run function calls sequentially or in parallel
2025-06-01 09:47:35 -07:00
Mark Backman
925b13e337
fix: correctly display non-roman characters
2025-06-01 12:29:26 -04:00
Aleix Conchillo Flaqué
ef3143d558
LLMService: don't run function calls if none are given
2025-05-31 14:01:56 -07:00
Mark Backman
ed84637b55
Add additional function call for testing to 14e, 14r, 19, 19a, 26b
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
897a944478
examples(14,14a): add restaurant recommendation function call
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
d86343c38d
examples: update to use on_function_calls_started event
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
297afdd126
LLMService: add new FunctionCallsStartedFrame
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
f0cbdc4e68
LLMService: add on_function_calls_started event
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
40b52cadde
LLMService: s/FunctionCallLLM/FunctionCallFromLLM/ s/FunctionCallRunner/FunctionCallRunnerItem/
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
04bf85ddfe
LLMService: allow executing tasks sequentially and in parallel
2025-05-31 13:57:52 -07:00
Aleix Conchillo Flaqué
4809684a13
LLMService: cancel function calls on interruptions by default
2025-05-31 13:57:50 -07:00
Aleix Conchillo Flaqué
1eb50ad88f
LLMService: pass LLM function calls all at once
2025-05-31 13:57:36 -07:00
Aleix Conchillo Flaqué
52569bcdb2
LLMService: don't allow running functions concurrently for now
2025-05-31 13:57:36 -07:00
Aleix Conchillo Flaqué
a50a407415
LLMService: run function calls sequentially
2025-05-31 13:57:35 -07:00
Aleix Conchillo Flaqué
9f223442c2
Merge pull request #1935 from pipecat-ai/aleix/script-evals
...
improve evals
2025-05-30 19:14:59 -07:00
Mark Backman
c647114bb9
Merge pull request #1927 from pipecat-ai/mb/gemini-tracing
2025-05-30 22:01:44 -04:00
Mark Backman
43719ec737
Update CHANGELOG
2025-05-30 21:36:39 -04:00
Mark Backman
8602557985
Refactor Gemini tracing to more closely match OpenAI Realtime, add TTFB metrics
2025-05-30 21:36:00 -04:00
Mark Backman
dd1f7d0875
Add tracking to OpenAI Realtime
2025-05-30 21:36:00 -04:00
Mark Backman
ec39e794d3
_handle_transcription
2025-05-30 21:36:00 -04:00
Mark Backman
7b1a937d4c
Add tracing for Gemini Live
2025-05-30 21:36:00 -04:00
Mark Backman
0fd38d8115
Merge pull request #1931 from pipecat-ai/mb/num-words
...
Add support for interruption strategies
2025-05-30 21:14:02 -04:00
Mark Backman
7a4efc6212
Code review feedback
2025-05-30 21:09:15 -04:00
Brian Mathiyakom
2eb2c5a413
Use disconnect() because close() doesn't exist
...
SmallWebRTCConnection doesn't have a `close()`. There's a `_close()` but I assume that's private due to its naming. The closest function that uses `_close()` is `disconnect()`. I assume then, that the intended resource freeing function call should be to `disconnect()`.
2025-05-30 17:14:53 -07:00
Aleix Conchillo Flaqué
2fcfb0aa9f
evals: don't use Deepgram's smart formatting
2025-05-30 16:55:55 -07:00
Aleix Conchillo Flaqué
f1df079512
evals: allow running a single eval
2025-05-30 16:55:55 -07:00
getchannel
8070e156d8
Add groundingMetadata events.py
2025-05-30 18:07:09 -04:00
Aleix Conchillo Flaqué
d77bedbafb
evals: move scripts/release to script/evals and add README
2025-05-30 15:04:05 -07:00
getchannel
43c6f1f5cd
Add groundingMetadata and logging gemini.py
2025-05-30 18:01:15 -04:00
getchannel
f53f5445ba
Create 26g-gemini-multimodal-live-groundingMetadata.py
2025-05-30 17:36:36 -04:00
Mark Backman
b34c593c54
Add changelog entry
2025-05-30 16:48:42 -04:00
Mark Backman
62efbc3342
Add foundational example 42
2025-05-30 16:48:42 -04:00
Mark Backman
2d609a0bde
Update LLmUserContextAggregator to conditionally push_aggregation
2025-05-30 16:48:42 -04:00
Mark Backman
6bc4b4a17f
Update BaseInputTransport to not push StartInterruptionFrame when InterruptionConfig is set and bot is speaking
2025-05-30 16:48:42 -04:00
Mark Backman
b489e52080
Add InterruptionConfig
2025-05-30 16:15:20 -04:00
getchannel
7263d11ee4
update correct upload endpoint file_api.py
2025-05-30 13:41:55 -04:00
getchannel
f2d5b9ad69
Create 26f-gemini-multimodal-live-files-api.py
...
This is an example to test usage of the Files API integration. Specifically with the Gemini Multimodal Live Service.
2025-05-30 13:04:52 -04:00
getchannel
40c7e3c52c
Update gemini.py
2025-05-30 12:19:40 -04:00
Aleix Conchillo Flaqué
a8aaeec52b
Merge pull request #1926 from pipecat-ai/aleix/pause-base-input-transport
...
handle StopFrame in base input transport and stop pushing frames
2025-05-30 08:27:20 -07:00
Mark Backman
ad7eec181e
Merge pull request #1923 from philipp-eisen/philipp/fix-ttfb_ms-implementation
...
Fix implementation of ttfb_ms metric
2025-05-30 11:03:42 -04:00
Aleix Conchillo Flaqué
b33897ffb9
SmallWebRTCTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
1c3d3f2f4b
WebsocketClientTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
9a5a1edb6b
WebsocketServerTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
f2eb869b02
FastAPIWebsocketTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
0c7e3cfcb2
LiveKitTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
24e19db29e
TavusTransport: don't initialize if a second StartFrame is received
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
bc6d7b7bbd
examples(phone-chatbot): don't show dangling tasks in first pipeline
2025-05-30 07:51:51 -07:00
Aleix Conchillo Flaqué
cad271068e
BaseInputTransport: handle StopFrame and pause pushing frames
2025-05-30 07:51:49 -07:00
Philipp Eisen
3425293115
Ensure correct formatting
2025-05-30 15:41:45 +02:00
Mark Backman
20dbfec3a9
Merge pull request #1876 from m-ods/m-ods/assemblyai-universal-streaming
...
Update AssemblyAI Streaming STT
2025-05-30 08:55:43 -04:00
marcus-daily
170057a75a
Updating dependency version
2025-05-30 12:38:32 +01:00
marcus-daily
b86b761e0b
Fixing Yaml syntax
2025-05-30 12:38:32 +01:00
marcus-daily
da0d2f0266
Small WebRTC transport demo app for Android
2025-05-30 12:38:32 +01:00
Martin Schweiger
321ea27c34
changelog entry
2025-05-30 17:15:58 +08:00
Philipp Eisen
b712e6b9aa
Switch ttfb metric to use seconds instead
2025-05-30 11:13:26 +02:00
Martin Schweiger
b3652e6527
set vad_force_turn_endpoint to True by default
2025-05-30 17:07:54 +08:00
Philipp Eisen
bc97f397ef
Switch to using float instead of int, but keep ms
2025-05-30 10:27:20 +02:00
Martin Schweiger
e5da3f6e68
add tracing
2025-05-30 10:55:19 +08:00
Martin Schweiger
8400539acf
set formatted_finals true by default
2025-05-30 10:40:01 +08:00
Martin Schweiger
b5eac8dfed
add message to TranscriptionFrame result
2025-05-30 10:39:07 +08:00
Martin Schweiger
ba312b5591
Merge branch 'main' into m-ods/assemblyai-universal-streaming
2025-05-30 10:29:49 +08:00
Martin Schweiger
f23572b318
Merge branch 'main' into m-ods/assemblyai-universal-streaming
2025-05-30 10:11:02 +08:00
Martin Schweiger
db838634e7
fix: double finals bug
2025-05-30 10:00:31 +08:00
Martin Schweiger
7f2e848a5c
use FrameProcessor class methods
2025-05-30 09:40:46 +08:00
Martin Schweiger
096e854d50
remove .dict()
2025-05-30 09:31:20 +08:00
Martin Schweiger
3ffe8b3155
remove parse_obj
2025-05-30 09:29:51 +08:00
Mark Backman
a471f49b61
Merge pull request #1889 from pipecat-ai/mb/add-dtmf-aggregator
...
Add DTMFAggregator
2025-05-29 17:13:28 -04:00
Mark Backman
4d2a02f318
Refactor to create task on StartFrame, also cleanup
2025-05-29 17:10:54 -04:00
Mark Backman
0bec7db03b
Emit a BotInterruptionFrame when the first keypress of a sequence is received
2025-05-29 17:07:18 -04:00
Mark Backman
74827f983f
Add tests, improve frame timing
2025-05-29 17:07:18 -04:00
Mark Backman
0ed46f457e
Add DTMFAggregator
2025-05-29 17:07:17 -04:00
Aleix Conchillo Flaqué
36b731be73
Merge pull request #1915 from pipecat-ai/aleix/uvloop-event-loop
...
use uvloop as the new event loop on Linux and macOS
2025-05-29 14:06:44 -07:00
Aleix Conchillo Flaqué
62fbdd4e81
Merge pull request #1922 from pipecat-ai/aleix/output-transport-cleanup
...
output transports cleanup
2025-05-29 14:06:17 -07:00
Aleix Conchillo Flaqué
ca7b0650c2
examples: capture camera or screen. allow setting framerate
2025-05-29 13:16:44 -07:00
Aleix Conchillo Flaqué
67dd146038
output transports cleanup
2025-05-29 13:16:44 -07:00
Aleix Conchillo Flaqué
fb66df2efd
use uvloop as the new event loop on Linux and macOS
2025-05-29 11:24:21 -07:00
Aleix Conchillo Flaqué
2395ca0057
Merge pull request #1921 from pipecat-ai/aleix/transcription-frame-result
...
add STT result field to TranscriptionFrame/InterimTranscriptionFrame
2025-05-29 11:22:38 -07:00
Aleix Conchillo Flaqué
d203789490
add STT result field to TranscriptionFrame/InterimTranscriptionFrame
2025-05-29 11:21:44 -07:00
Aleix Conchillo Flaqué
7ea0e31cd4
Merge pull request #1924 from pipecat-ai/aleix/new-examples-package
...
add new pipecat.examples package and make runner public
2025-05-29 11:18:22 -07:00
Mark Backman
d3bf13a503
Merge pull request #1917 from pipecat-ai/mb/fix-twilio-chatbot-client
...
fix: update websocket_client to use FrameProcessorSetup.task_manager
2025-05-29 14:05:27 -04:00
Mark Backman
ea91970499
Update the twilio-chatbot client to work with the updated server, which requires call_sid
2025-05-29 14:02:49 -04:00
Mark Backman
803b3f2cc4
fix: update websocket_client to use FrameProcessorSetup
2025-05-29 14:02:47 -04:00
Aleix Conchillo Flaqué
1788ba6c5c
add new pipecat.examples package and make runner public
2025-05-29 10:43:12 -07:00
Philipp Eisen
5209bd3d9f
Fix implemetation of ttfb_ms metric
2025-05-29 19:24:04 +02:00
Aleix Conchillo Flaqué
cb9178f1ec
Merge pull request #1914 from pipecat-ai/aleix/base-output-daily-handle-dtmf-frames
...
output transport can now handle DTMF keypress
2025-05-29 09:35:01 -07:00
Aleix Conchillo Flaqué
5676920a6a
BaseOutputTransport/DailyTransport: allow sending DTMF keypress
2025-05-29 09:33:29 -07:00
Aleix Conchillo Flaqué
513221d9fd
added OutputDTMFUrgentFrame
2025-05-29 09:32:57 -07:00
Mark Backman
a33d0b4b53
Merge pull request #1904 from pipecat-ai/mb/aws-bedrock-no-op-tool
...
Add no_op tool to AWSBedrockLLMService
2025-05-29 10:29:19 -04:00
Mark Backman
bee242b781
Safer check when using the no_operation tool
2025-05-29 10:25:20 -04:00
Mark Backman
fa1c98ff29
Add no_op tool to AWSBedrockLLMService
2025-05-29 10:25:19 -04:00
Mark Backman
ae3a7d9bed
Merge pull request #1920 from alexflorensa/alexflorensa/set-deepgram-model-name
...
fix(deepgram-stt): set model name to Deepgram STT
2025-05-29 09:41:56 -04:00
Matej Marinko
ee5fea4221
Fix auto finalization cycle
2025-05-29 14:58:35 +02:00
Matej Marinko
db7b60cfe9
Auto finalize fix
2025-05-29 13:24:53 +02:00
alexflorensa
0c2efb312c
fix(deepgram-stt) Set model name to Deepgram STT
2025-05-29 12:08:16 +02:00
Matej Marinko
51b79bd6a1
Minor code style changes
2025-05-29 10:11:11 +02:00
Matej Marinko
95fe762776
Fix typo
2025-05-29 09:23:37 +02:00
Aleix Conchillo Flaqué
cf8eeaab0b
Merge pull request #1909 from pipecat-ai/aleix/daily-expose-transcription-functions
...
DailyTransport: expose start_transcription/stop_transcription
2025-05-28 17:06:40 -07:00
Vanessa Pyne
2f8cb3ce76
Merge pull request #1804 from pipecat-ai/vp-text-webrtc-chatbot
...
add text chatbot example using small webrtc transport
2025-05-28 14:25:42 -05:00
vipyne
821da723c0
update SmallWebRTCTransport text examples with new run_example
2025-05-28 13:54:45 -05:00
Filipi Fuchter
575b97ba60
Some improvements and cleanups in the SmallWebRTCTransport text examples.
2025-05-28 13:54:45 -05:00
vipyne
cc0819b709
examples: add text and audio over webrtc transport
...
update filenames
add high level comments to 41* examples
2025-05-28 13:54:45 -05:00
vipyne
318d6f042b
examples: add text chatbot example using small webrtc transport
...
examples: send small webrtc UI updates in RTVIServerMessageFrame
add explanation about RTVI server messages being specific to
small-webrtc-prebuilt UI
2025-05-28 13:54:45 -05:00
Aleix Conchillo Flaqué
05ae3a1703
DailyTransport: expose start_transcription/stop_transcription
2025-05-28 11:21:26 -07:00
Aleix Conchillo Flaqué
8e54805e62
Merge pull request #1908 from pipecat-ai/aleix/add-manifest-file-to-reduce-sdist
...
add MANIFEST.in to reduce sdist tarball size
2025-05-28 10:15:38 -07:00
Aleix Conchillo Flaqué
64399a72f3
add MANIFEST.in to reduce sdist tarball size
2025-05-28 10:09:39 -07:00
Aleix Conchillo Flaqué
6c33f0b0bd
Merge pull request #1907 from pipecat-ai/aleix/pipecat-0.0.68
...
update CHANGELOG for pipecat 0.0.68
2025-05-28 09:41:34 -07:00
Aleix Conchillo Flaqué
aca304b395
update CHANGELOG for pipecat 0.0.68
2025-05-28 09:08:08 -07:00
Aleix Conchillo Flaqué
db5c9e67be
Merge pull request #1906 from pipecat-ai/aleix/daily-python-0.19.1
...
pyproject: update daily-python to 0.19.1
2025-05-28 09:05:13 -07:00
Aleix Conchillo Flaqué
2313cec792
pyproject: update daily-python to 0.19.1
2025-05-28 00:36:40 -07:00
Matej Marinko
2968c846ce
Add Soniox STT service
2025-05-28 09:35:21 +02:00
Aleix Conchillo Flaqué
83acaf692a
Merge pull request #1890 from pipecat-ai/aleix/examples-multi-transport
...
add support for multiple transports to foundational examples
2025-05-28 00:27:01 -07:00
Aleix Conchillo Flaqué
e9aeb2662b
scripts: allow specifying a name for the test run
2025-05-28 00:22:55 -07:00
Aleix Conchillo Flaqué
356f4039e4
scripts: allow storing logs for release evals
2025-05-27 21:10:22 -07:00
Aleix Conchillo Flaqué
736c7f1f30
scripts: allow storing audio for release evals
2025-05-27 18:09:25 -07:00
Aleix Conchillo Flaqué
2994448036
introduce release evals
...
This is an initial attempt to implement evals for all (or most) of our
foundational examples. Before we release, we want to make sure all of them work
and reply properly. Until now this has been done manually, hopefully this will
be useful to speed up our release process.
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
d476d9ea05
examples: remove "on_client_closed"
...
This has been replaced for "on_client_disconnected" in SmallWebRTCTransport to
match other transports and therefore it is not necessary anymore.
2025-05-27 17:42:52 -07:00
Filipi Fuchter
bf31bce440
Updated SmallWebRTCTransport to align with how other transports handle on_client_disconnected
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
6393e89022
examples(foundational): update handle_signint depending on transport
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
884268fce3
examples(foundational): allow running examples with twilio
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
071a9307c9
transport(websocket): do not require a frame serializer
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
2cdfaa0a82
examples(foundational): support multiple transports
2025-05-27 17:42:52 -07:00
Aleix Conchillo Flaqué
ecf878e14d
DailyTransport: allow requesting video frames with any framerate
2025-05-27 17:42:50 -07:00
Aleix Conchillo Flaqué
4eed335bc7
PipelineTask: check if pipeline has already been cancelled
2025-05-27 17:40:39 -07:00
Aleix Conchillo Flaqué
2e57bb74d2
BaseObject: do not raise exception if event handler not registered
2025-05-27 17:40:35 -07:00
Aleix Conchillo Flaqué
0a39769cd0
Merge pull request #1901 from pipecat-ai/aleix/deepgram-sdk-4.1.0
...
pyproject: update deepgram-sdk to 4.1.0
2025-05-27 17:20:54 -07:00
Aleix Conchillo Flaqué
bdb6a9e5d1
Merge pull request #1903 from pipecat-ai/aleix/openpipe-4.50.0
...
pyproject: update openpipe to 4.50.0
2025-05-27 17:20:30 -07:00
Aleix Conchillo Flaqué
f88e0eb96d
pyproject: update openpipe to 4.50.0
2025-05-27 15:22:55 -07:00
Aleix Conchillo Flaqué
0099f60d29
deepgram: fix an issue with user provided LiveOptions
2025-05-27 15:19:17 -07:00
Filipi da Silva Fuchter
eaf9f20c56
Merge pull request #1898 from pipecat-ai/tavus_transport_fixes
...
Fixing TavusTransport with some TTS services.
2025-05-27 16:33:19 -03:00
Aleix Conchillo Flaqué
e987c4741a
pyproject: update deepgram-sdk to 4.1.0
2025-05-27 10:32:48 -07:00
Aleix Conchillo Flaqué
6242278abd
Merge pull request #1895 from pipecat-ai/aleix/more-avoid-mutable-default-values
...
more avoiding mutable default constructor values
2025-05-27 10:08:42 -07:00
Mark Backman
30850a431a
Merge pull request #1886 from pipecat-ai/mb/add-otel-llm-output
...
Add LLM response tracing to OTel tracing
2025-05-27 11:58:57 -04:00
Mark Backman
1e7407c042
Merge pull request #1899 from pipecat-ai/mb/genai-to-standard-messages
...
fix: Update GoogleLLMContext to_standard_messages to be compatible with google-genai
2025-05-27 11:57:44 -04:00
Mark Backman
6d94f31ff2
Update foundational example 33 to work with google-genai
2025-05-27 11:20:21 -04:00
Mark Backman
ebb3d1cfd3
fix: Update GoogleLLMContext to_standard_messages to be compatible with google-genai
2025-05-27 11:20:21 -04:00
Filipi Fuchter
acce9489d7
Creating the silence based on the chunk size.
2025-05-27 11:26:34 -03:00
Filipi Fuchter
3d442620f9
Removing not used imports.
2025-05-27 10:42:06 -03:00
Martin Schweiger
f1d7eb8565
final touches
2025-05-27 21:29:50 +08:00
Filipi Fuchter
798b935ff6
The remaining audio should not be sent as done.
2025-05-27 10:28:40 -03:00
Filipi Fuchter
3039a1444e
Refactoring the TavusVideoService to match the same the behavior of the bot started speaking and bot stopped speaking.
2025-05-27 10:26:41 -03:00
Mark Backman
aa7d15beb3
fix: move LLM call outside tracing try block to prevent double execution
2025-05-26 22:06:31 -04:00
Filipi Fuchter
2b3d2cb342
Fixing the issue when using the TavusVideoService with some TTS services.
2025-05-26 22:55:20 -03:00
Filipi Fuchter
5a58357429
Fixing the issue when using the TavusTransport with some TTS services.
2025-05-26 18:34:52 -03:00
Mark Backman
366add2536
Merge pull request #1878 from pipecat-ai/mb/add-plivo-serializer
...
Add PlivoFrameSerializer
2025-05-26 11:07:13 -04:00
Mark Backman
e13c9fd42e
Add PlivoFrameSerializer
2025-05-26 11:00:01 -04:00
Mark Backman
2a6c01f634
Merge pull request #1885 from pipecat-ai/mb/update-langfuse-example
2025-05-26 10:14:02 -04:00
Mark Backman
bf29722e78
Merge pull request #1884 from pipecat-ai/mb/readme-otel-twilio-telnyx
2025-05-26 10:13:23 -04:00
Mark Backman
db227ad15f
Merge pull request #1897 from pipecat-ai/mb/fix-websocket-client-example
...
Fix mismatched html tag in websocket client example
2025-05-26 09:26:53 -04:00
Mark Backman
514716042b
Fix mismatched html tag in websocket client example
2025-05-26 08:25:03 -04:00
Aleix Conchillo Flaqué
7a767e680c
more avoiding mutable default constructor values
2025-05-25 21:00:35 -07:00
Martin Schweiger
320b52eb1e
Merge branch 'm-ods/assemblyai-universal-streaming' of https://github.com/m-ods/pipecat into m-ods/assemblyai-universal-streaming
2025-05-26 09:13:08 +08:00
Martin Schweiger
428cee75c5
Add User-Agent header to AssemblyAI websocket connection
2025-05-26 09:10:55 +08:00
Martin Schweiger
5479a55b2c
Add websockets dependency to assemblyai extra
2025-05-26 09:08:56 +08:00
Mark Backman
d1f2a5d04f
Merge pull request #1868 from aristid/google-streaming-tts
...
Add Google streaming TTS as a base TTS service
2025-05-24 12:42:47 -04:00
aristid
09ba319f3e
Merge branch 'main' into google-streaming-tts
2025-05-24 17:16:22 +02:00
ezun-kim
3da711ba8b
Fix SSE server connection handling for MCP client
...
### Summary
This PR improves the MCP (Model Context Protocol) client's SSE (Server-Sent Events) server connection handling by replacing the generic string parameter with a proper `SseServerParameters` class.
### Changes
- **Breaking Change**: Changed `server_params` type from `Union[StdioServerParameters, str]` to `Union[StdioServerParameters, SseServerParameters]`
- Added import for `SseServerParameters` from `mcp.client.session_group`
- Updated SSE client connection to use structured parameters instead of a simple URL string
- Fixed error message to correctly reflect the expected parameter types
- Improved logging by changing info-level log to debug-level for consistency
### Details
#### Before
The SSE client connection only accepted a URL string:
```python
async with self._client(self._server_params) as (read, write):
```
#### After
Now properly unpacks SSE server parameters:
```python
async with self._client(
url=self._server_params.url,
headers=self._server_params.headers,
timeout=self._server_params.timeout,
sse_read_timeout=self._server_params.sse_read_timeout
) as (read, write):
```
### Benefits
- **Type Safety**: Stronger type checking with dedicated `SseServerParameters` class
- **Extended Configuration**: Support for custom headers (authentication), timeouts, and SSE-specific settings
- **Better Error Messages**: Clear type error messages when incorrect parameters are provided
- **Improved Debugging**: Debug logging of SSE server parameters for troubleshooting
### Migration Guide
Users need to update their SSE server initialization:
```python
# Before
client = MCPClient("https://example.com/sse ")
# After
from mcp.client.session_group import SseServerParameters
client = MCPClient(SseServerParameters(
url="https://example.com/sse ",
headers={"Authorization": "Bearer token"},
timeout=30,
sse_read_timeout=60
))
```
### Testing
- [ ] Tested with StdioServerParameters (unchanged behavior)
- [ ] Tested with SseServerParameters with various configurations
- [ ] Verified error handling for invalid parameter types
---
This is a necessary change to support production-ready SSE connections with proper authentication and timeout handling.
2025-05-24 22:35:57 +09:00
Mark Backman
6f524fb816
Add LLM response to OTel tracing
2025-05-24 09:15:39 -04:00
unknown
d3e2a9e5c0
Change default voice and fix formatting
2025-05-24 15:14:39 +02:00
Mark Backman
b4cd7d7941
Langfuse OTel env.example improvements
2025-05-24 08:17:10 -04:00
Mark Backman
cd03b91115
Update README: Add OTel, Add serializers
2025-05-24 07:23:59 -04:00
Aleix Conchillo Flaqué
f86d002ceb
Merge pull request #1881 from pipecat-ai/aleix/daily-input-audio-and-video-task-fix
...
daily input audio and video task fix
2025-05-23 19:39:25 -07:00
Aleix Conchillo Flaqué
940926b5ec
TavusVideoService: no need to enable audio/video outputs
2025-05-23 19:29:34 -07:00
Aleix Conchillo Flaqué
85c096df0b
DailyTransport: create audio/video input tasks when input flag is enabled
2025-05-23 19:28:18 -07:00
Filipi da Silva Fuchter
76d93522ac
Merge pull request #1820 from pipecat-ai/tavus_video_service
...
Tavus improvements
2025-05-23 23:11:00 -03:00
Filipi Fuchter
31492831cc
Updating the changelog and readme to reflect the Tavus changes.
2025-05-23 23:04:04 -03:00
Filipi Fuchter
8221dd594e
Creating a Tavus example using the DailyTransport.
2025-05-23 23:03:40 -03:00
Filipi Fuchter
6346ca1a84
Creating a Tavus example using the SmallWebRTCTransport.
2025-05-23 23:03:24 -03:00
Filipi Fuchter
4a3404883f
Creating a Tavus example using the new TavusTransport.
2025-05-23 23:03:16 -03:00
Filipi Fuchter
1ebca35313
Queuing the app messages if the SmallWebrtcTransport is not connected yet.
2025-05-23 23:03:04 -03:00
Filipi Fuchter
e0d1381f87
Refactoring the TavusVideoService to allow to work with any transport.
2025-05-23 23:02:49 -03:00
Filipi Fuchter
86e6841569
Creating TavusTransport and TavusTransportClient.
2025-05-23 23:02:37 -03:00
Aleix Conchillo Flaqué
28b7a92a00
Merge pull request #1880 from pipecat-ai/aleix/daily-resize-event-loop-fix
...
BaseOutputTransport: don't block event loop during image resize
2025-05-23 18:32:00 -07:00
Aleix Conchillo Flaqué
4db5b18694
BaseOutputTransport: don't block event loop during image resize
2025-05-23 18:30:28 -07:00
Aleix Conchillo Flaqué
a628e921c0
Merge pull request #1879 from pipecat-ai/aleix/daily-fix-video-task
...
DailyTransport: fix video task variable
2025-05-23 17:56:08 -07:00
Aleix Conchillo Flaqué
6ca6ff37c9
DailyTransport: fix video task variable
2025-05-23 17:54:25 -07:00
Aleix Conchillo Flaqué
456db3710a
Merge pull request #1828 from pipecat-ai/aleix/daily-use-audio-renderers
...
DailyTransport: replace virtual speaker and microphones
2025-05-23 13:31:51 -07:00
Aleix Conchillo Flaqué
50f024c6f9
LiveKitTransport: use UserAudioRawFrame instead of InputAudioRawFrame
2025-05-23 11:27:53 -07:00
Aleix Conchillo Flaqué
a4de75a8c0
Merge pull request #1867 from pipecat-ai/aleix/user-bot-latency-log-observer
...
observers: added UserBotLatencyLogObserver
2025-05-23 09:23:03 -07:00
Aleix Conchillo Flaqué
88e8fcdaca
observers: added UserBotLatencyLogObserver
2025-05-23 09:17:53 -07:00
unknown
bfe9952c9a
Remove sleep(0), add doc string etc.
2025-05-23 12:11:08 +02:00
Martin Schweiger
7f568e3e7e
Merge branch 'main' into m-ods/assemblyai-universal-streaming
2025-05-23 17:39:00 +08:00
Martin Schweiger
9b8800ac1d
update stt.py
2025-05-23 17:32:31 +08:00
Martin Schweiger
fd53712567
add models for new streaming service
2025-05-23 17:32:12 +08:00
Aleix Conchillo Flaqué
7f74c2465c
SileroVADAnalyzer: improve non-matching sample rate log
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
30d67a78eb
examples(chatbot-audio-recording): use same sample rate to avoid downsampling
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
c3cfd1f0ce
DailyTransport: process audio, video and event callbacks in separate tasks
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
69ac70eed8
DailyTransport: replace virtual microphone with custom microphone track
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
fcf49e79cc
DailyTransport: use participant audio renderers instead of virtual speaker
2025-05-23 01:47:09 -07:00
Aleix Conchillo Flaqué
8d4894846d
pyproject: update to daily-python 0.19.0
2025-05-23 01:47:09 -07:00
Vanessa Pyne
a809b710c5
Merge pull request #1844 from pipecat-ai/vp-docsinreadme
...
add docs link at top of readme
2025-05-22 21:52:18 -05:00
vipyne
f6289e9db2
add docs link at top of readme
2025-05-22 21:51:29 -05:00
Mark Backman
26b4c4df22
Merge pull request #1870 from pipecat-ai/mb/gemini-2.5-flash-update
...
Update GeminiMultimodalLiveLLMService to use Gemini 2.5 Flash Native …
2025-05-22 18:19:55 -04:00
Mark Backman
f3a9844295
Merge pull request #1860 from pipecat-ai/mb/organize-otel-demos
...
Reorganize OpenTelemetry demos, add top-level README
2025-05-22 18:15:20 -04:00
Mark Backman
692821bdae
Merge pull request #1873 from pipecat-ai/mb/readme-sarvam
...
Add SarvamTTSService to README
2025-05-22 18:14:40 -04:00
Mark Backman
ee143d5b3a
Update GeminiMultimodalLiveLLMService to use Gemini 2.5 Flash Native Audio Dialog model
2025-05-22 18:13:41 -04:00
Mark Backman
7e178a634a
Merge pull request #1871 from pipecat-ai/mb/claude-sonnet-4-update
...
Update default model for Anthropic to Claude Sonnet 4
2025-05-22 18:12:47 -04:00
Mark Backman
fe88a3d80b
Add SarvamTTSService to README
2025-05-22 18:11:11 -04:00
Mark Backman
a196eac290
Merge pull request #1872 from pipecat-ai/mb/add-sarvam-tts
...
Add SarvamTTSService
2025-05-22 18:02:36 -04:00
Mark Backman
3c819955a2
Add SarvamTTSService
2025-05-22 16:23:08 -04:00
Mark Backman
ca0d7bbbed
Update default model for Anthropic to Claude Sonnet 4
2025-05-22 15:13:33 -04:00
Mark Backman
f93bd1e817
Merge pull request #1864 from pipecat-ai/mb/fix-11lab-set-model-voice
...
Fix: ElevenLabsTTSService, change voice and model
2025-05-22 14:36:24 -04:00
Mark Backman
415bc6ca0a
Fix: ElevenLabsTTSService, change voice and model
2025-05-22 14:28:50 -04:00
Mark Backman
8543c8d11d
Merge pull request #1869 from pipecat-ai/mb/update-readme-nova-sonic
...
Add AWS Nova Sonic to README
2025-05-22 14:07:35 -04:00
Mark Backman
bf5ad64575
Add AWS Nova Sonic to README
2025-05-22 14:03:28 -04:00
unknown
d42d02d809
Add Google streaming TTS as a base TTS service. Rename non-streaming service to GoogleHttpTTSService.
2025-05-22 11:21:06 +02:00
Aleix Conchillo Flaqué
0718f79ff2
Merge pull request #1866 from pipecat-ai/aleix/base-observers-are-base-objects
...
BaseObserver: inherit from BaseObject so we can have events
2025-05-21 16:07:38 -07:00
Aleix Conchillo Flaqué
9bbce225ce
BaseObserver: inherit from BaseObject so we can have events
2025-05-21 16:04:44 -07:00
Mark Backman
fb35fd6d71
Merge pull request #1859 from pipecat-ai/mb/otel-attribute-naming
...
Update OTel attribute names
2025-05-21 12:10:15 -04:00
Mark Backman
b4fd92aed6
Merge pull request #1862 from marctorsoc/clean-links-in-md-text-filter
...
Add link cleaning in MD text filter
2025-05-21 09:20:27 -04:00
Mark Backman
36931825b3
Merge pull request #1854 from sklinglernv/fix/elevenlab-tts
...
fix(elevenlabs tts): message parameter naming
2025-05-21 09:17:29 -04:00
marc.torsoc
ca35299dcd
add link cleaning and a test for it
2025-05-21 12:08:53 +02:00
Severin Klingler
e74b900914
revert most of the changes except keyword naming fix
2025-05-21 09:24:03 +02:00
Mark Backman
25115668a7
Reorganize OpenTelemetry demos, add top-level README
2025-05-20 23:30:46 -04:00
Mark Backman
fb94db3e64
Update to use GenAI naming
2025-05-20 22:56:02 -04:00
Mark Backman
c4778e770e
Merge pull request #1835 from marcklingen/langfuse-tracing
...
Add examples/open-telemetry-tracing-langfuse
2025-05-20 18:22:55 -04:00
Mark Backman
3860cdf97b
Update OTel attribute names
2025-05-20 18:00:46 -04:00
Aleix Conchillo Flaqué
f3aec0c4ac
Merge pull request #1829 from pipecat-ai/aleix/pipeline-task-add-observer
...
PipelineTask: add add_observer()
2025-05-20 13:18:24 -07:00
Aleix Conchillo Flaqué
d333094149
PipelineTask: add add_observer() and remove_observer()
2025-05-20 13:16:06 -07:00
Aleix Conchillo Flaqué
609ff4e66c
Merge pull request #1841 from pipecat-ai/aleix/base-text-aggregator-async
...
make BaseTextAggregator and BaseTextFilter functions async
2025-05-20 13:13:54 -07:00
Aleix Conchillo Flaqué
cbccbcd9e7
BaseTextFilter: make functions async
2025-05-20 13:11:44 -07:00
Aleix Conchillo Flaqué
54b1d7fcc1
BaseTextAggregator: make functions async
2025-05-20 13:11:42 -07:00
Aleix Conchillo Flaqué
54388c0d9b
Merge pull request #1850 from pipecat-ai/aleix/transcription-message-user-id
...
TranscriptionMessage: add user_id field
2025-05-20 13:10:42 -07:00
Aleix Conchillo Flaqué
228c866aaa
Merge pull request #1857 from pipecat-ai/aleix/avoid-mutable-default-values
...
avoid mutable default constructor values
2025-05-20 13:10:24 -07:00
Aleix Conchillo Flaqué
a09bd648af
avoid mutable default constructor values
2025-05-20 11:59:28 -07:00
Vanessa Pyne
3e4ae61c75
Merge pull request #1856 from pipecat-ai/vp-mcp-debug
...
mcp: fix typo in tool call response
2025-05-20 13:59:11 -05:00
vipyne
7655c432c2
mcp: fix typo in tool call response
2025-05-20 11:16:59 -05:00
Aleix Conchillo Flaqué
25dd651757
TranscriptionMessage: add user_id field
2025-05-19 15:47:54 -07:00
Mark Backman
462aecea3e
Merge pull request #1839 from pipecat-ai/mb/cartesia-speed
...
Add support for Cartesia's speed parameter, update clients and APIs, deprecate emotion
2025-05-19 17:57:25 -04:00
Mark Backman
5f37df790b
Merge pull request #1848 from pipecat-ai/mb/fix-word-wrangler-transport-params
...
Fix: Add audio_in_enabled to Word Wrangler TransportParams
2025-05-19 17:52:05 -04:00
Mark Backman
8e4e03541c
Update CHANGELOG
2025-05-19 17:51:27 -04:00
Aleix Conchillo Flaqué
c1252fc7eb
Merge pull request #1840 from pipecat-ai/aleix/base-object-dont-create-tasks
...
BaseObject: don't create event handler tasks if none is registered
2025-05-19 14:12:31 -07:00
Mark Backman
ed1077cc9a
Fix: Add audio_in_enabled to Word Wrangler TransportParams
2025-05-19 15:53:29 -04:00
Mark Backman
4c761a7b22
Merge pull request #1847 from pipecat-ai/mb/update-otel
...
Keep span identifiers in attributes only
2025-05-19 14:37:42 -04:00
Mark Backman
9bc3df7803
Keep span identifiers in attributes only
2025-05-19 12:25:13 -04:00
Aleix Conchillo Flaqué
5e5060a6fe
BaseObject: don't create event handler tasks if none is registered
2025-05-19 09:24:56 -07:00
Aleix Conchillo Flaqué
2b66eddaa1
Merge pull request #1830 from pipecat-ai/aleix/pipeline-task-frame-events
...
PipelineTask: add new started/stopped/ended/cancelled events
2025-05-19 08:32:28 -07:00
Mark Backman
916b9d6c6d
Add an example for CartesiaHttpTTSService
2025-05-19 11:31:47 -04:00
Mark Backman
bd09ccd608
Update CartesiaHttpTTSService to work with the new cartesia 2.0 client
2025-05-19 11:31:28 -04:00
Mark Backman
682f8e4d45
Bump the cartesia_version for CartesiaTTSService, and cartesia package for CartesiaHttpTTSService
2025-05-19 11:10:03 -04:00
Mark Backman
c9d0af9ee0
Deprecate emotion, add new speed parameter
2025-05-19 09:43:24 -04:00
Severin Klingler
e1299d59bf
fix(elevenlabs tts): Fix message paramter naming and make use of contexts to send out TTSStoppedFrames()
2025-05-19 15:22:13 +02:00
Mark Backman
61da6437ea
Merge pull request #1834 from pipecat-ai/mb/gemini-live-tokens
...
Fix: Make LLMTokenUsage more robust
2025-05-19 09:04:07 -04:00
Marc Klingen
798705469b
Update README.md
2025-05-18 21:11:20 +02:00
Marc Klingen
459a753de3
add reference to main otel example
2025-05-18 19:56:12 +02:00
Marc Klingen
1092ce70b3
add video of langfuse trace
2025-05-18 19:46:38 +02:00
Marc Klingen
9511c189bd
revert original folder
2025-05-18 19:42:13 +02:00
Marc Klingen
66fea9e2ee
create new example folder
2025-05-18 19:41:17 +02:00
Marc Klingen
69ae83516e
use http exporter
2025-05-18 19:11:06 +02:00
Mark Backman
144ea36c81
Fix: Make LLMTokenUsage more robust
2025-05-18 07:41:16 -04:00
Mark Backman
7a8ab9a900
Merge pull request #1672 from golbin/main
...
Use "use_original_timestamps" only for sonic-2 model
2025-05-18 07:24:58 -04:00
Jin Kim
c4b35055b4
Update CHANGELOG.md
2025-05-18 16:54:29 +09:00
Jin Kim
a4c04e7c17
Opt out Sonic models from use_original_timestamps
2025-05-18 16:52:37 +09:00
Jin Kim
a6f7e7fc30
Merge branch 'pipecat-ai:main' into main
2025-05-18 16:48:24 +09:00
Aleix Conchillo Flaqué
d5ebc883b3
PipelineTask: add new started/stopped/ended/cancelled events
2025-05-17 22:46:22 -07:00
Mark Backman
deb43df0a4
Merge pull request #1824 from pipecat-ai/mb/gemini-live-transcribe-user-audio
...
Update GeminiMultimodalLiveLLMService to use Gemini's user transcription
2025-05-16 22:51:04 -04:00
Mattie Ruth
88e472b3f1
Update Modal Readme ( #1825 )
2025-05-16 17:40:57 -04:00
Mark Backman
f59fb8167d
Merge pull request #1784 from thsunkid/thu/handle-transcript-gpt4o-audio
...
Handle audio transcript from gpt-4o-audio and clean up logs
2025-05-16 13:20:16 -04:00
Mark Backman
fac6f526f7
Add comments and docstrings
2025-05-16 10:54:50 -04:00
Mark Backman
2f78d74ce6
Change Gemini Live to use Gemini provided usage metrics
2025-05-16 10:53:01 -04:00
Mark Backman
d3942dda52
Gemini Live to transcribe user audio
2025-05-16 10:53:01 -04:00
Mark Backman
c00e9a8d3a
Merge pull request #1819 from kaikato/lmnt-model-langs
...
LmntTTSService: add model param and additional languages
2025-05-16 08:49:55 -04:00
kaikato
c3b95767f3
LmntTTSService: add model param and additional languages
2025-05-16 04:24:57 +00:00
Mark Backman
90f27a3090
Merge pull request #1816 from pipecat-ai/mb/add-minimax-tts
...
Add MiniMax TTS
2025-05-15 18:05:13 -04:00
Mark Backman
b6f09defc9
Add MiniMax TTS
2025-05-15 18:02:29 -04:00
Aleix Conchillo Flaqué
172813bcfb
Merge pull request #1815 from pipecat-ai/aleix/remove-silerovad-processor
...
remove SileroVAD() frame processor
2025-05-15 13:44:44 -07:00
Aleix Conchillo Flaqué
95c25efab7
remove SileroVAD() frame processor
2025-05-15 11:55:20 -07:00
Aleix Conchillo Flaqué
a51af35024
Merge pull request #1814 from pipecat-ai/aleix/examples-dependabot-05142025
...
examples: updates for dependabot 05/14/2025
2025-05-15 11:38:45 -07:00
Mark Backman
119fd5ba7d
Merge pull request #1025 from fatwang2/main
...
added hailuo tts service
2025-05-15 14:29:24 -04:00
Aleix Conchillo Flaqué
0718a812bd
examples: updates for dependabot 05/14/2025
2025-05-14 22:51:08 -07:00
Mark Backman
3814501b48
Merge pull request #1811 from pipecat-ai/mb/dont-require-tracing-dep
...
Fix: Resolve an issue where tracing imports were required
2025-05-14 12:35:47 -04:00
Mark Backman
7a5205dbda
Fix: Resolve an issue where tracing imports were required
2025-05-14 12:29:08 -04:00
Thu Nguyen
15a5028d23
Revert log changes
2025-05-14 22:28:25 +08:00
Thu Nguyen
fee2648ac0
Handle audio transcript from gpt-4o-audio and clean up logs
2025-05-14 13:02:22 +07:00
Varun Singh
04c02c9a20
Merge pull request #1810 from pipecat-ai/vr000m-receiving-custom-sip-headers
...
added handling for sipHeaders
2025-05-13 23:02:14 -07:00
getchannel
e27da96cdc
Rename file_api to file_api.py
...
added proper .py to file name.
2025-05-13 22:01:02 -04:00
Varun Singh
0ff7195a83
Update README.md
...
updating docs
2025-05-13 19:08:43 -04:00
Varun Singh
3b91aa013a
added handling for sipHeaders
2025-05-13 16:00:05 -07:00
Mark Backman
50f6235edb
Add support for OpenTelemetry tracing ( #1729 )
...
* Also added TurnTrackingObserver, TurnTraceObserver, foundational 29, open-telemetry-example
2025-05-13 17:18:11 -04:00
Aleix Conchillo Flaqué
6f4d94f91b
Merge pull request #1800 from pipecat-ai/aleix/frame-processors-setup
...
introduce frame processors setup
2025-05-13 13:18:06 -07:00
Aleix Conchillo Flaqué
83a4c7d443
RTVIProcessor: remove unused code
2025-05-13 11:26:37 -07:00
Aleix Conchillo Flaqué
8171fec925
SmallWebRTCConnection: complain if av package not found
2025-05-13 11:26:37 -07:00
Aleix Conchillo Flaqué
175f352ea7
add FrameProcessor.setup() to setup processors before StartFrame
2025-05-13 11:26:35 -07:00
Filipi da Silva Fuchter
5290161ac4
Merge pull request #1746 from pipecat-ai/simple_chatbot-react-native
...
Simple chatbot: React Native client
2025-05-13 10:48:09 -03:00
Filipi Fuchter
8762019ed7
Not setting the local audio level when the user stopped speaking.
2025-05-13 10:46:30 -03:00
Filipi Fuchter
61a59fa158
Fixing useNavigation typescript warning.
2025-05-13 10:36:39 -03:00
Filipi Fuchter
55eea20c8e
Renaming expo environment variable
2025-05-13 10:32:27 -03:00
kompfner
9a621f0c54
Merge pull request #1805 from pipecat-ai/pk/aws-nova-sonic-aggregate-user-transcription-text
...
AWS Nova Sonic service - aggregate user transcription text; it was fr…
2025-05-13 09:13:58 -04:00
Paul Kompfner
55fc24e933
AWS Nova Sonic service - aggregate user transcription text; it was fragmented across many conversation history messages before
2025-05-13 09:13:28 -04:00
Filipi da Silva Fuchter
b14608f09b
Merge pull request #1799 from pipecat-ai/daily_audio_source
...
Using audio source for capturing Daily's participant audio
2025-05-13 08:15:10 -03:00
Mark Backman
4a25c57337
Merge pull request #1806 from pipecat-ai/aleix/run-test-observers
...
tests: allow passing observers to run_test()
2025-05-12 22:10:44 -04:00
Aleix Conchillo Flaqué
f800e35ccb
tests: allow passing observers to run_test()
2025-05-12 17:53:02 -07:00
Vanessa Pyne
12d49a9b9d
Merge pull request #1801 from pipecat-ai/vp-fix-typo
...
update examples
2025-05-12 15:33:56 -05:00
vipyne
b25b251a44
update examples
2025-05-12 14:07:17 -05:00
Mattie Ruth
64b2a75a94
Update Modal App: ( #1755 )
...
* Update Modal App:
Updated Modal App to include:
1. Latest Modal API usage
2. Ability to launch different Pipecat pipelines, much like the
simple chatbot example
3. Ability to choose which pipeline is launched via the
/connect endpoint
4. Added a pipeline option for connecting to a self-hosted LLM
on Modal
5. Improved READMEs
6. Added a web client for interacting with the Modal deployment
tmp
* Update README
2025-05-12 12:45:43 -05:00
Aleix Conchillo Flaqué
b33a60f3a5
Merge pull request #1793 from pipecat-ai/khk/deepgram-async-fix
...
Fix Deepgram TTS streaming
2025-05-12 09:59:46 -07:00
Filipi Fuchter
d22dbb1a6d
Fixing ruff format.
2025-05-12 10:36:21 -03:00
Filipi Fuchter
983199a6cd
New example capturing the audio from the participant using the custom audio source.
2025-05-12 10:18:43 -03:00
Filipi Fuchter
133d7ee33a
Fixing the default audio source for capture_participant_audio
2025-05-12 10:16:32 -03:00
Mark Backman
0bd888afc7
Merge pull request #1796 from nikp06/patch-1
...
Wrong deprecation warning when importing ai_services.py
2025-05-12 09:12:48 -04:00
nikp06
537bd1c58d
Update ai_services.py
...
fix: correct deprecation warning format in ai_services module
2025-05-12 12:01:13 +02:00
Kwindla Hultman Kramer
5ef519fe2c
Fix Deepgram TTS to use stream_raw()
2025-05-11 15:40:31 -07:00
Mark Backman
20498fb47f
Merge pull request #1790 from AngeloGiacco/angelo/fix-api-key
...
[elevenlabs tts ] fix api key
2025-05-10 19:16:27 -04:00
Angelo Giacco
b57dfb3b5d
fix lint
2025-05-10 16:36:26 +01:00
Angelo Giacco
0355ed4aa1
move api key to ws header
2025-05-10 16:34:01 +01:00
Angelo Giacco
1e76cc7bdc
fix: elevenlabs api key
2025-05-10 16:09:20 +01:00
Vanessa Pyne
18c0374126
Merge pull request #1785 from pipecat-ai/vp-small-filenmae-change
...
39-aws-nova-sonic.py -> 40-aws-nova-sonic.py
2025-05-09 12:19:09 -05:00
Aleix Conchillo Flaqué
7072fba7e7
Merge pull request #1780 from pipecat-ai/aleix/deprecate-google-generativeai
...
GoogleLLMService: deprecate google-generativeai
2025-05-09 09:18:30 -07:00
Aleix Conchillo Flaqué
3d702a5c39
minor examples cleanup
2025-05-09 09:16:10 -07:00
Aleix Conchillo Flaqué
f31efa42c9
GoogleLLMService: deprecate google-generativeai
2025-05-09 09:14:43 -07:00
getchannel
d86502e79a
add file_api __init__.py
2025-05-09 10:53:31 -04:00
getchannel
59c7744590
add FileData class events.py
2025-05-09 10:52:04 -04:00
getchannel
949971dea9
Create file_api
2025-05-09 10:51:24 -04:00
getchannel
cd4a893c65
add FileAPI to gemini.py
2025-05-09 10:50:27 -04:00
vipyne
74b369ff20
39-aws-nova-sonic.py -> 40-aws-nova-sonic.py
2025-05-09 08:30:59 -05:00
Filipi Fuchter
46eed0a59a
Bumping to use the latest version of @pipecat-ai/react-native-daily-transport, and removing code not needed.
2025-05-08 18:18:00 -03:00
kompfner
9643296e29
Merge pull request #1779 from pipecat-ai/pk/aws-nova-sonic-missing-params-export
...
Add missing `Params` export to AWS Nova Sonic module
2025-05-08 16:04:38 -04:00
Paul Kompfner
c83c5b5a34
Add missing Params export to AWS Nova Sonic module
2025-05-08 15:23:25 -04:00
Filipi Fuchter
277e2d7fc0
Merge branch 'main' into simple_chatbot-react-native
2025-05-08 09:03:16 -03:00
Mark Backman
7280e390d9
Merge pull request #1774 from pipecat-ai/mb/moondream-ex-server
...
Add load_dotenv to moondream example server
2025-05-07 19:02:30 -04:00
Mark Backman
4efc3f0a39
Merge pull request #1775 from pipecat-ai/mb/patient-ex-env
...
Add load_dotenv to patient-intake server file
2025-05-07 19:02:20 -04:00
Mark Backman
cb7e7a8aa3
Add load_dotenv to patient-intake server file
2025-05-07 18:40:04 -04:00
Mark Backman
9136402846
Add load_dotenv to moondream example server
2025-05-07 18:29:27 -04:00
Aleix Conchillo Flaqué
260fc76137
Merge pull request #1773 from pipecat-ai/aleix/pipecat-0.0.67
...
update CHANGELOG for 0.0.67
2025-05-07 15:05:55 -07:00
Aleix Conchillo Flaqué
7cfb9a4d15
update CHANGELOG for 0.0.67
2025-05-07 14:59:16 -07:00
Mark Backman
2089e0c974
Merge pull request #1768 from pipecat-ai/mb/update-observers
...
Add DebugLogObserver
2025-05-07 17:30:49 -04:00
Mark Backman
9e0b4fe5d1
Replace list with tuple
2025-05-07 17:21:09 -04:00
Mark Backman
75ce632f84
Add DebugLogObserver
2025-05-07 17:21:08 -04:00
Mark Backman
efeb96c4e8
Remove unused imports
2025-05-07 17:20:42 -04:00
kompfner
fb5438e9c2
Merge pull request #1770 from pipecat-ai/pk/amazon-nova-sonic-interruption-reliability
...
AWS Nova Sonic service - make interruption handling more reliable, in…
2025-05-07 17:16:06 -04:00
Mark Backman
7da9f66e1c
Merge pull request #1761 from pipecat-ai/mb/elevenlabs-context-id
...
Update ElevenLabsTTSService to use the new websocket API
2025-05-07 17:12:06 -04:00
Mark Backman
9e16e3d614
Update ElevenLabsTTSService to use the new websocket API
2025-05-07 17:09:52 -04:00
Paul Kompfner
84d040c6d0
AWS Nova Sonic service - make interruption handling more reliable, in terms of:
...
- not getting the conversation into a "stuck" state
- not losing assistant text that should've made it into the context
2025-05-07 16:34:18 -04:00
Mark Backman
f3e0beb8f1
Merge pull request #1762 from pipecat-ai/iss-1734-rtvi-function-call-breakage
...
Revert breaking change in RTVI protocol for function calling
2025-05-07 15:25:22 -04:00
Aleix Conchillo Flaqué
e00a1196ef
Merge pull request #1767 from pipecat-ai/aleix/daily-python-0.18.2
...
pyproject: update daily-python to 0.18.2
2025-05-07 12:19:59 -07:00
Aleix Conchillo Flaqué
3867c0f8e7
Merge pull request #1766 from pipecat-ai/aleix/daily-fix-multiple-audio-video-sources
...
fix multiple audio video sources
2025-05-07 12:19:46 -07:00
Aleix Conchillo Flaqué
cdf0953722
pyproject: update daily-python to 0.18.2
2025-05-07 11:56:36 -07:00
Aleix Conchillo Flaqué
ed00f7d071
add video_source field to UserImageRequestFrame
2025-05-07 11:50:21 -07:00
Aleix Conchillo Flaqué
a3038afa02
DailyTransport: fix multiple audio/video sources
2025-05-07 11:50:00 -07:00
kompfner
f9ca0b8cc6
Merge pull request #1704 from pipecat-ai/pk/amazon-nova-sonic
...
Amazon Nova Sonic LLM service
2025-05-07 14:45:28 -04:00
Paul Kompfner
2920aa5af4
[WIP] AWS Nova Sonic service - pull AWS Nova Sonic support out of the aws optional dependency in pyproject.toml and into its own aws-nova-sonic optional dependency. That's because it requires Python >= 3.12, a higher version than the base project's 3.10. This change allows anyone using any of the other AWS services (including our own unit tests) to continue using the lower Python version.
2025-05-07 14:32:32 -04:00
Paul Kompfner
93c9cc4a0e
[WIP] AWS Nova Sonic service - minor fix
2025-05-07 13:54:06 -04:00
Paul Kompfner
b53f9235e4
[WIP] AWS Nova Sonic service - remove unnecessary _context_available state, instead just relying on the presence of _context
2025-05-07 13:54:06 -04:00
Paul Kompfner
1491462d15
[WIP] AWS Nova Sonic service - remove _handling_bot_stopped_speaking, which no longer seems to be necessary; I'm no longer observing back-to-back BotStoppedSpeaking frames
2025-05-07 13:54:06 -04:00
Paul Kompfner
c78f779800
[WIP] AWS Nova Sonic service - log an error message if you try to use AWS Nova Sonic without the proper dependency (e.g. without having done pip install pipecat-ai[aws])
2025-05-07 13:54:06 -04:00
Paul Kompfner
b013e375fb
[WIP] AWS Nova Sonic service - simplify a bit of logic (and do the same simplification in the OpenAI Realtime service)
2025-05-07 13:54:06 -04:00
Paul Kompfner
52036138c1
[WIP] AWS Nova Sonic service - remove unnecessary (no-op) code
2025-05-07 13:54:06 -04:00
Paul Kompfner
4ba9a42861
[WIP] AWS Nova Sonic service - add more accurate typing
2025-05-07 13:54:06 -04:00
Paul Kompfner
27bff7a759
[WIP] AWS Nova Sonic service - fix comment
2025-05-07 13:54:06 -04:00
Paul Kompfner
896f8d85f7
[WIP] AWS Nova Sonic service - remove out-of-date TODO comment
2025-05-07 13:54:06 -04:00
Paul Kompfner
ed06cdd2c7
[WIP] AWS Nova Sonic service - add CHANGELOG entry
2025-05-07 13:54:02 -04:00
Paul Kompfner
8473647269
[WIP] AWS Nova Sonic service - update persistent-context example to better avoid saving "transitional", as opposed to meaningful, context messages
2025-05-07 13:52:51 -04:00
Paul Kompfner
5579145a06
[WIP] AWS Nova Sonic service - post-rebase, update examples to play nicely with recent pipecat changes
2025-05-07 13:52:51 -04:00
Paul Kompfner
35848d10b3
[WIP] AWS Nova Sonic service - remove various TODO comments
2025-05-07 13:52:51 -04:00
Paul Kompfner
c7e223e85a
[WIP] AWS Nova Sonic service - remove print statements in favor of logger
2025-05-07 13:52:51 -04:00
Paul Kompfner
885b2d1d2f
[WIP] AWS Nova Sonic service - make parameters configurable
2025-05-07 13:52:51 -04:00
Paul Kompfner
73020be511
[WIP] AWS Nova Sonic service - minor fix: only try to read received JSON if we have it
2025-05-07 13:52:51 -04:00
Paul Kompfner
d388c057c0
[WIP] AWS Nova Sonic service - recover from unwanted disconnection due to an error
2025-05-07 13:52:51 -04:00
Paul Kompfner
c4d0f91a7f
[WIP] AWS Nova Sonic service - remove some old code that was accidentally still there, possibly sending a duplicate system instruction
2025-05-07 13:52:51 -04:00
Paul Kompfner
467233be04
[WIP] AWS Nova Sonic service - support multi-line system prompt
2025-05-07 13:52:51 -04:00
Paul Kompfner
2b02d08f4c
[WIP] AWS Nova Sonic service - add comments to examples pointing out the us-east-1 is the only supported region so far
2025-05-07 13:52:51 -04:00
Paul Kompfner
9fe265ea64
[WIP] AWS Nova Sonic service - implement ability to persist and load conversations
2025-05-07 13:52:51 -04:00
Paul Kompfner
cc1f4ba81c
[WIP] AWS Nova Sonic service - add a hacky way of programmatically triggering an assistant response
2025-05-07 13:52:51 -04:00
Paul Kompfner
3784bdbd27
[WIP] AWS Nova Sonic service - in our hacky direct manipulation of the context, aggregate assistant text rather than recording every chunk as a separate message
2025-05-07 13:52:51 -04:00
Paul Kompfner
4ffdc3b77c
[WIP] AWS Nova Sonic service - do hacky direct manipulation of the context for now, since I can't seem to get assistant context aggregation working properly with frames, grr
2025-05-07 13:52:51 -04:00
Paul Kompfner
38c9fa681a
[WIP] AWS Nova Sonic service - Protect against back-to-back BotStoppedSpeaking calls, which I've observed
2025-05-07 13:52:51 -04:00
Paul Kompfner
c477039954
[WIP] AWS Nova Sonic service - just for safety, add a short delay after BotStoppedSpeaking before sending LLMFullResponseEndFrame + TTSStoppedFrame, to give a bit of leeway for the LLM to deliver the "FINAL" text block describing what was said
2025-05-07 13:52:51 -04:00
Paul Kompfner
d6ef3d64ac
[WIP] AWS Nova Sonic service - fix context problems of double-counting LLM text, and mis-categorizing user text as LLM text
2025-05-07 13:52:51 -04:00
Paul Kompfner
6938152db6
[WIP] AWS Nova Sonic service - fix comment
2025-05-07 13:52:51 -04:00
Paul Kompfner
2154db07f0
[WIP] AWS Nova Sonic service - remove unnecessary error log
2025-05-07 13:52:51 -04:00
Paul Kompfner
5e0803479e
[WIP] AWS Nova Sonic service - add send_transcription_frames option
2025-05-07 13:52:51 -04:00
Paul Kompfner
3960c604a4
[WIP] AWS Nova Sonic service - fix empty assistant conversation history item in the context after tool use
2025-05-07 13:52:51 -04:00
Paul Kompfner
394648f1c9
[WIP] AWS Nova Sonic service - fix user utterances not making it into the context
2025-05-07 13:52:51 -04:00
Paul Kompfner
da5c4953d5
[WIP] AWS Nova Sonic service - allow passing in tools into initializer
2025-05-07 13:52:51 -04:00
Paul Kompfner
2b7e1cb5b1
[WIP] AWS Nova Sonic service - add tool calling
2025-05-07 13:52:51 -04:00
Paul Kompfner
f182eafb40
[WIP] AWS Nova Sonic service - add ability to pass in OpenAILLMContext
2025-05-07 13:52:51 -04:00
Paul Kompfner
9f7f42e885
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
9b8bce1914
[WIP] AWS Nova Sonic service - add voice_id
2025-05-07 13:52:51 -04:00
Paul Kompfner
96d05e12fc
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
68c1069548
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
5b64613f65
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
1f9baefba8
[WIP] AWS Nova Sonic service - added stubs for handling interruption and user-started-speaking frames
2025-05-07 13:52:51 -04:00
Paul Kompfner
0c255d2618
[WIP] AWS Nova Sonic service - added TTSTextFrame and reworked/cleaned up some bookkeeping logic
2025-05-07 13:52:51 -04:00
Paul Kompfner
a38206de9c
[WIP] AWS Nova Sonic service - added TranscriptionFrame
2025-05-07 13:52:51 -04:00
Paul Kompfner
260f7c9b85
[WIP] AWS Nova Sonic service - format
2025-05-07 13:52:51 -04:00
Paul Kompfner
de294caed9
[WIP] AWS Nova Sonic service - added LLMFullResponseStartFrame, LLMTextFrame, and LLMFullResponseEndFrame
2025-05-07 13:52:51 -04:00
Paul Kompfner
e40aa4f99a
[WIP] AWS Nova Sonic service - added TTSStartedFrame and TTSStoppedFrame
2025-05-07 13:52:51 -04:00
Paul Kompfner
b1d413b9be
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
8cbad070ad
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
13569a5a5a
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
d789334a60
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
7668b27fc0
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
6d30f441e8
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
a9e395b366
[WIP] AWS Nova Sonic service
2025-05-07 13:52:51 -04:00
Paul Kompfner
5e5626f04f
[WIP] AWS Nova Sonic service
2025-05-07 13:52:47 -04:00
Aleix Conchillo Flaqué
d80aa5b44e
Merge pull request #1753 from pipecat-ai/aleix/add-bedrock-support
...
Add support for Amazon Bedrock LLMs
2025-05-07 09:31:48 -07:00
Aleix Conchillo Flaqué
80ef6dc4de
update README with AWS Bedrock and Transcribe
2025-05-07 09:26:26 -07:00
Aleix Conchillo Flaqué
458549f7df
AWSBedrockLLMService: fix function calling
2025-05-07 09:26:26 -07:00
Aleix Conchillo Flaqué
a8405649d0
aws: use AWS prefix for all services
2025-05-07 09:26:26 -07:00
Aleix Conchillo Flaqué
ce1a72850b
tests: add bedrock context aggregator tests
2025-05-07 09:26:26 -07:00
Aleix Conchillo Flaqué
58de381746
AWS: add missing utils
2025-05-07 09:26:26 -07:00
Aleix Conchillo Flaqué
bed2e894a2
BedrockLLMService: pull initial system frame from messages
2025-05-07 09:26:26 -07:00
Aleix Conchillo Flaqué
b4de98cfb7
AWS: various cleanups (logs, imports...)
2025-05-07 09:26:26 -07:00
Aleix Conchillo Flaqué
a4b9db9e07
fix formatting
2025-05-07 09:26:26 -07:00
Adithya Suresh
664111a3c9
Added cache related info to metrics
2025-05-07 09:26:26 -07:00
Adithya Suresh
aa964847f3
System param to be a list
2025-05-07 09:26:26 -07:00
Adithya Suresh
fa5cac7e0a
Bug fix in content format
2025-05-07 09:26:26 -07:00
Adithya Suresh
b2b01861b2
Remove model restriction
2025-05-07 09:26:26 -07:00
Adithya Suresh
f014f718eb
Restructured STT and enabled prosody tags for generative Polly
2025-05-07 09:26:26 -07:00
Adithya Suresh
05ae8d3ffa
Removed OpenAI based context formatting
2025-05-07 09:26:26 -07:00
Adithya Suresh
88c9e08bd8
Updated tools parsing logic
2025-05-07 09:26:26 -07:00
Adithya Suresh
844f61dfea
Initial implementation
2025-05-07 09:26:26 -07:00
Tico Ballagas
acb7d597cb
Change example to use generative voices
2025-05-07 09:19:49 -07:00
Tico Ballagas
2b18f60261
Initial implementation of AWS Transcribe TTS
2025-05-07 09:19:49 -07:00
mattie ruth backman
5b66133a6c
Revert breaking change in RTVI protocol for function calling
2025-05-07 12:08:28 -04:00
Mark Backman
0c5bc6a57a
Merge pull request #1760 from WebinarGeek/wg/daily-active-speaker-event
...
DailyTransport: added on_active_speaker_changed event handler
2025-05-07 11:17:49 -04:00
Mark Backman
7981e00955
Merge pull request #1759 from pipecat-ai/mb/readme-nvidia-riva
...
Update README with Riva services
2025-05-07 11:13:51 -04:00
Dan Berg
5e39c0cfeb
DailyTransport: added on_active_speaker_changed event handler
2025-05-07 15:22:30 +02:00
Mark Backman
a444701929
Update README with Riva services
2025-05-07 09:02:08 -04:00
Mark Backman
f6c1eb5d9d
Merge pull request #1757 from pipecat-ai/mb/remove-canonical
...
Removing CanonicalMetricsService
2025-05-06 21:38:03 -04:00
Mark Backman
a1d46cb26b
Removing CanonicalMetricsService
2025-05-06 21:23:23 -04:00
Aleix Conchillo Flaqué
99ab148d88
Merge pull request #1739 from pipecat-ai/aleix/observers-frame-pushed-class
...
BaseObserver: add FramePushed class and deprecate multiple arguments
2025-05-06 15:29:05 -07:00
Aleix Conchillo Flaqué
d69fa5dba5
update CHANGELOG with UltravoxSTTService fix
2025-05-06 15:26:25 -07:00
Aleix Conchillo Flaqué
0d30b000af
BaseObserver: add FramePushed class and deprecated multiple arguments
2025-05-06 15:26:23 -07:00
Mark Backman
e7c0e742d2
Merge pull request #1752 from pipecat-ai/mb/deepgram-tts-aura-2
...
Update Deepgram TTS default voice to Aura 2 voice
2025-05-06 16:26:26 -04:00
Mark Backman
2aff2dcca3
Merge pull request #1751 from pipecat-ai/mb/11labs-enable_ssml_parsing
...
Add enable_ssml_parsing and enable_logging to ElevenLabsTTSService
2025-05-06 16:25:20 -04:00
Mark Backman
288f8865c8
Add enable_logging to ElevenLabsTTSService
2025-05-06 12:13:26 -04:00
Mark Backman
8691870bcb
Update Deepgram TTS default voice to Aura 2 voice
2025-05-06 11:29:32 -04:00
Mark Backman
e06146c237
Add enable_ssml_parsing to ElevenLabsTTSService
2025-05-06 11:06:57 -04:00
Aleix Conchillo Flaqué
c68e990cda
Merge pull request #1748 from pipecat-ai/aleix/task-manager-dictionary
...
task manager dictionary and cleanup PipelineTask
2025-05-06 07:57:53 -07:00
Aleix Conchillo Flaqué
4583905313
PipelineTask: cleanup if task is cancelled from outside Pipecat
2025-05-05 21:33:21 -07:00
Aleix Conchillo Flaqué
9cc498b1fa
TaskManager: use a dictionary instead of a set to store tasks
2025-05-05 21:27:49 -07:00
Mark Backman
b3c5dc4045
Merge pull request #1443 from adithyaxx/anthropic-client-bug-fixes
...
Handle missing token counts in AsyncAnthropicBedrock client properly
2025-05-05 21:13:11 -04:00
Filipi Fuchter
56ca7360ae
Fixing versions
2025-05-05 19:11:59 -03:00
Filipi Fuchter
d5ab3251f0
Bumping the dependencies, updating readme, adding .gitignore.
2025-05-05 18:43:04 -03:00
Filipi Fuchter
915c284420
Fixing readme
2025-05-05 18:32:04 -03:00
Aleix Conchillo Flaqué
3824da7261
Merge pull request #1745 from pipecat-ai/aleix/make-sure-transports-are-ready
...
only send data to transports after they are really ready
2025-05-05 14:21:36 -07:00
Filipi Fuchter
40154824e8
Creating a RN example for simple-chatbot
2025-05-05 18:17:39 -03:00
Aleix Conchillo Flaqué
855d567b1e
only send data to transports after they are really ready
2025-05-05 14:06:58 -07:00
Mark Backman
b323a7bd88
Merge pull request #1742 from pipecat-ai/mb/pcc-krisp-filter
...
Update pipecat-cloud-example to use Krisp in PCC deployment only
2025-05-05 15:46:12 -04:00
Mark Backman
fa011d0018
Update pipecat-cloud-example to use Krisp in PCC deployment only
2025-05-05 15:09:29 -04:00
Aleix Conchillo Flaqué
e15fa8777a
Merge pull request #1737 from CerebriumAI/kyle/fix-ultravox-spacing
...
[Fix] Ultravox frame spacing issue
2025-05-05 09:34:49 -07:00
Aleix Conchillo Flaqué
2143a6d927
Merge pull request #1732 from pipecat-ai/aleix/daily-remote-custom-tracks
...
DailyTransport: remove custom tracks before leaving
2025-05-05 08:44:11 -07:00
Aleix Conchillo Flaqué
044e2d3e73
DailyTransport: remove custom tracks before leaving
2025-05-05 08:35:35 -07:00
Kyle Gani
be112ec63f
Merge branch 'kyle/fix-ultravox-performance' of github.com:CerebriumAI/pipecat into kyle/fix-ultravox-performance
2025-05-05 17:13:26 +02:00
Kyle Gani
d2f56c4e8f
Fix: Spacing issue
2025-05-05 17:13:21 +02:00
Mark Backman
ddc6a9c695
Merge pull request #1670 from pipecat-ai/mb/daily-twilio-sip-example
...
Add standalone Daily + Twilio SIP example
2025-05-05 10:57:16 -04:00
Mark Backman
2bebdbc371
Merge pull request #1671 from pipecat-ai/khk/rime-arcana
...
support for rime arcana model
2025-05-05 10:54:50 -04:00
Mark Backman
8b9f1f0608
Add a changelog entry
2025-05-05 10:51:46 -04:00
Kwindla Hultman Kramer
b25f3b2ed2
support for rime arcana model
2025-05-05 10:50:46 -04:00
Mark Backman
a995cf81b6
Merge pull request #1724 from pipecat-ai/mb/demo-fixes
...
Demo fixes
2025-05-05 08:44:57 -04:00
Aleix Conchillo Flaqué
75d261639f
Merge pull request #1726 from pipecat-ai/aleix/pipecat-0.0.66
...
update CHANGELOG for pipecat 0.0.66
2025-05-02 20:54:57 -07:00
Aleix Conchillo Flaqué
f720d795d0
update CHANGELOG for pipecat 0.0.66
2025-05-02 20:29:51 -07:00
Aleix Conchillo Flaqué
f6fe83e358
Merge pull request #1725 from pipecat-ai/aleix/update-daily-python-0.18.1
...
update to daily-python 0.18.1
2025-05-02 20:27:50 -07:00
Mark Backman
0513d0b6a8
Update README
2025-05-02 22:44:50 -04:00
Mark Backman
0679bb217d
Remove Twilio from phone-chatbot directory
2025-05-02 22:18:50 -04:00
Mark Backman
38bd55e518
Update README
2025-05-02 22:18:50 -04:00
Mark Backman
65c7423280
Add other dial-in event handlers
2025-05-02 22:18:50 -04:00
Mark Backman
f24a85cc94
Add logic to only forward the first on_dialin_ready event
2025-05-02 22:18:50 -04:00
Mark Backman
53887b7c98
Display phone number in WebRTC call
2025-05-02 22:18:50 -04:00
Mark Backman
523c012c38
Use a Twilio asset to ring the phone throughout
2025-05-02 22:18:50 -04:00
Mark Backman
97c28989c1
Add standalone Daily + Twilio SIP example
2025-05-02 22:18:50 -04:00
Mark Backman
c19be6ebb2
Demo fixes
2025-05-02 20:58:10 -04:00
Aleix Conchillo Flaqué
54971a0735
update to daily-python 0.18.1
2025-05-02 17:47:44 -07:00
Mark Backman
4513e81e13
Merge pull request #1723 from pipecat-ai/mb/base-output-bot-speaking-log
...
Only display the destination in the bot started/stopped speaking log …
2025-05-02 17:32:47 -04:00
Mark Backman
872204b795
Only display the destination in the bot started/stopped speaking log when there is a desintation
2025-05-02 17:29:28 -04:00
Aleix Conchillo Flaqué
a94cbfe6f5
Merge pull request #1722 from pipecat-ai/aleix/base-output-transport-audio-task-fix
...
BaseOutputTransport: always initialize audio task
2025-05-02 14:26:30 -07:00
Aleix Conchillo Flaqué
7152faafb2
BaseOutputTransport: always initialize audio task
...
We also use the audio task to also send synchronized images with audio.
2025-05-02 14:23:15 -07:00
Mark Backman
e6aadaccd8
Merge pull request #1721 from pipecat-ai/mb/simli-silent-frames
...
Fix: SimliVideoService was continuously emitting audio, preventing Bo…
2025-05-02 16:44:39 -04:00
Mark Backman
3a73aa71b8
Merge pull request #1613 from pipecat-ai/mb/improve-storybot-readme
...
demo: Restructure storytelling-chatbot directory, update README steps…
2025-05-02 16:39:59 -04:00
Mark Backman
814e7509e1
demo: Restructure storytelling-chatbot directory, update README steps, link to vercel demo
2025-05-02 16:37:37 -04:00
Vanessa Pyne
e0cf5ec016
Merge pull request #1705 from pipecat-ai/vp-update-nvidia-models
...
Riva Service: add magpie-tts-multilingual model
2025-05-02 15:34:23 -05:00
vipyne
667bd32e6a
Riva: remove deprecated lines in example
2025-05-02 15:33:10 -05:00
vipyne
b2ecd83706
update CHANGELOG with Riva details
2025-05-02 15:33:10 -05:00
vipyne
b2754117c8
Riva: refactor function_id and model_name
2025-05-02 15:33:10 -05:00
vipyne
6c428c303b
update magpie voice
2025-05-02 15:33:10 -05:00
Mark Backman
e7d889a143
Update RivaSTTService to use by default
2025-05-02 15:33:10 -05:00
Mark Backman
da60e7069b
Update pyproject.toml to use nvidia-riva-client 2.19.1
2025-05-02 15:33:10 -05:00
Mark Backman
c14406a3b9
Demos use the latest services
2025-05-02 15:33:10 -05:00
Mark Backman
725ab5ec21
Small fixes: No default api_key of None, ParakeetSTTService uses RivaSTTService.InputParams
2025-05-02 15:33:10 -05:00
Mark Backman
daf9d47e58
Update RivaSegmentedSTTService
2025-05-02 15:33:10 -05:00
vipyne
63a65627a2
Riva Service: add magpie-tts-multilingual model
2025-05-02 15:33:10 -05:00
Mark Backman
02c07755b0
Add Changelog entry for PR 1707
2025-05-02 15:33:10 -05:00
Matt Kim
15cbd18acc
[Rime] Add phonemizeBetweenBrackets and pauseBetweenBrackets to RimeTTSService (ws)
...
There is a fix incoming in
2025-05-02 15:33:10 -05:00
Kwindla Hultman Kramer
93c40b87dc
small groq updates
2025-05-02 15:33:10 -05:00
Mark Backman
eeaa9f67a1
Fix: SimliVideoService was continuously emitting audio, preventing BotStoppedSpeakingFrame from being sent
2025-05-02 16:32:42 -04:00
Mark Backman
b60691c7b2
Merge pull request #1720 from pipecat-ai/mb/changelog-pr-1707
...
Add Changelog entry for PR 1707
2025-05-02 16:13:40 -04:00
Mark Backman
2bb1b0b343
Add Changelog entry for PR 1707
2025-05-02 16:09:50 -04:00
Mark Backman
047ef9f86c
Merge pull request #1707 from rimelabs/matt/rime/url_param_serialization
...
[Rime] Add new params to RimeTTSService
2025-05-02 16:08:01 -04:00
Kwindla Hultman Kramer
9a2c603c91
Merge pull request #1711 from pipecat-ai/khk/groq-updates
2025-05-02 12:21:15 -07:00
Filipi da Silva Fuchter
94c4169407
Merge pull request #1717 from pipecat-ai/local_smart_turn_torch
...
Local smart turn torch
2025-05-02 15:53:30 -03:00
Filipi Fuchter
cb8a551db8
Mentioning the new LocalSmartTurnAnalyzer in the changelog.
2025-05-02 14:32:18 -03:00
Filipi Fuchter
779f09af70
Fixing lint.
2025-05-02 14:22:38 -03:00
Filipi Fuchter
19dc0f2bfb
New example using the local smart turn
2025-05-02 14:21:42 -03:00
Filipi Fuchter
f0709e22ba
Creating a local smart turn using torch.
2025-05-02 14:21:29 -03:00
Mark Backman
8250736f5e
Merge pull request #1708 from pipecat-ai/mb/gemini-user-context
...
Push GeminiMultimodalLiveLLMService TranscriptionFrame Upstream, remo…
2025-05-02 13:10:27 -04:00
Mark Backman
83348a9f93
Merge pull request #1714 from pipecat-ai/mb/fix-gemini-text-modality
...
Restore TEXT modalities support to GeminiMultimodalLiveLLMService
2025-05-02 10:41:05 -04:00
Mark Backman
96d40903a9
Only send TTSStoppedFrame from Gemini when in AUDIO mode, only send one LLMFullResponseEndFrame
2025-05-02 10:18:53 -04:00
Aleix Conchillo Flaqué
2560811805
Merge pull request #1697 from pipecat-ai/aleix/daily-custom-audio-tracks
...
add support for multiple transport destinations
2025-05-02 06:34:09 -07:00
Mark Backman
2b8c44c008
Merge pull request #1710 from pipecat-ai/mb/openai-context-aggregation
...
fix: OpenAIRealtimeBetaLLMService writes two assistant messages to th…
2025-05-02 07:43:35 -04:00
Mark Backman
38e2d37674
Restore TEXT modalities support to GeminiMultimodalLiveLLMService
2025-05-02 07:36:12 -04:00
Vanessa Pyne
6278561f88
Merge pull request #1709 from pipecat-ai/vp-fix-fastpitch-params-update
...
Riva TTS: update FastPitch params
2025-05-01 21:23:10 -05:00
Aleix Conchillo Flaqué
750e79c1ce
DailyParams: rename to camera/microphone_out_enabled
2025-05-01 19:17:14 -07:00
Aleix Conchillo Flaqué
71eb2963c5
examples: added daily-custom-tracks
2025-05-01 19:17:14 -07:00
Aleix Conchillo Flaqué
f44e2c86ea
BaseOutputTransport: compute sample_rate and audio_chunk_size in main class
2025-05-01 19:17:14 -07:00
Aleix Conchillo Flaqué
afe1f0df8c
DailyTransport: make sure we can write audio frames to destination
2025-05-01 19:17:14 -07:00
Aleix Conchillo Flaqué
458fddfb48
update CHANGELOG with new Daily and Transport features
2025-05-01 19:17:14 -07:00
Aleix Conchillo Flaqué
8d915c5ccb
DailyParams: allow enabling/disabling camera/microphone tracks
2025-05-01 19:17:14 -07:00
Aleix Conchillo Flaqué
304153dd03
TTSService: set transport destination to all TTS frames
2025-05-01 19:17:14 -07:00
Aleix Conchillo Flaqué
a6781b7352
rename destination to transport_destination
2025-05-01 19:17:14 -07:00
Aleix Conchillo Flaqué
5ad0058303
update CHANGELOG with frame source/destination support
2025-05-01 19:11:13 -07:00
Aleix Conchillo Flaqué
75c039de33
examples: add daily-multi-translation
2025-05-01 19:11:13 -07:00
Aleix Conchillo Flaqué
74e3c3677e
DailyTransport: fix audio/video renderers registration
2025-05-01 18:58:44 -07:00
Aleix Conchillo Flaqué
dc20327f10
DailyTransport: register audio destination and use custom tracks
2025-05-01 18:58:44 -07:00
Aleix Conchillo Flaqué
e738affd29
BaseOutputTransport: allow sending audio/video to multiple destinations
2025-05-01 18:58:44 -07:00
Aleix Conchillo Flaqué
ef3d732607
DailyTransport: allow capturing multiple simultaneous audio/video sources
2025-05-01 18:58:44 -07:00
Aleix Conchillo Flaqué
6d63cff1bf
DailyTransport: custom audio tracks support
2025-05-01 18:58:44 -07:00
Aleix Conchillo Flaqué
12f42605a1
pyproject: update daily-python to 0.18.0
2025-05-01 18:58:44 -07:00
Kwindla Hultman Kramer
fac3337927
small groq updates
2025-05-01 17:09:15 -07:00
Mark Backman
76d198151c
Push GeminiMultimodalLiveLLMService TranscriptionFrame Upstream, remove direct context addition
2025-05-01 15:41:04 -04:00
Mark Backman
6a907058de
fix: OpenAIRealtimeBetaLLMService writes two assistant messages to the context
2025-05-01 15:37:39 -04:00
vipyne
6e1f531f64
Riva TTS: update FastPitch params
...
91138c3f66 (diff-ece228577b1d233ce600a948243f90cece53e3a9b89554a0b27a48bc4d6e0fdfR45)
2025-05-01 11:14:41 -05:00
Matt Kim
4232cca5b6
[Rime] Add phonemizeBetweenBrackets and pauseBetweenBrackets to RimeTTSService (ws)
...
There is a fix incoming in
2025-04-30 18:09:22 -07:00
Mark Backman
a6a4d3d71f
Merge pull request #1706 from rimelabs/matt/rime/update_url
...
[Rime] - Update url for Websockets API
2025-04-30 19:14:04 -04:00
Mark Backman
c52de0f5de
Merge pull request #1696 from pipecat-ai/mb/fix-gemini-live-context
...
Fix: GeminiMultimodalLiveLLMService was appending tokens to the context
2025-04-30 19:12:06 -04:00
Mark Backman
a1e1255f16
Strip newlines from generated user transcript
2025-04-30 18:27:46 -04:00
Mark Backman
c4f758725e
Ignore TranscriptionFrames too
2025-04-30 18:22:43 -04:00
Aleix Conchillo Flaqué
7bc9a78ce6
udpate CHANGELOG with RTVIObserverParams
2025-04-30 15:13:14 -07:00
Aleix Conchillo Flaqué
f8be71b32c
Merge pull request #1688 from pipecat-ai/aleix/add-rtvi-observer-params
...
RTVIObserver: add RTVIObserverParams to configure what to send
2025-04-30 15:11:18 -07:00
Aleix Conchillo Flaqué
957fa5546d
RTVIObserver: add RTVIObserverParams to configure what to send
2025-04-30 15:09:02 -07:00
Aleix Conchillo Flaqué
039cb8fcae
Merge pull request #1690 from pipecat-ai/aleix/rtvi-function-call-single-param
...
RTVIProcessor: use single FunctionCallParams
2025-04-30 15:04:05 -07:00
Mark Backman
8e05f2f1a1
Merge pull request #1702 from pipecat-ai/mb/stt-mute-transcription-frames
...
Add InterimTranscriptionFrame and TranscriptionFrame to STTMuteFilter…
2025-04-30 17:54:24 -04:00
Matt Kim
8467aa1ed3
[Rime] - Update url for Websockets API
...
Rime has migrated their Websockets api to the base url `user.rime.ai` along with all other tts endpoints.
See the [docs](https://docs.rime.ai/api-reference/endpoint/websockets )
`users-ws.rime.ai` is deprecated and will not reflect upgrades to the rime ws api.
2025-04-30 14:20:13 -07:00
Mark Backman
9c5878af3d
OpenAI Realtime and Gemini Live push LLMTextFrame again, overwrite the assitant context aggregator for LLMTextFrame
2025-04-30 17:18:20 -04:00
Mark Backman
ef29800fe9
Update the changelog
2025-04-30 16:28:17 -04:00
Mark Backman
7e09933070
OpenAI Realtime should push TTSTextFrame only
2025-04-30 16:28:17 -04:00
Mark Backman
82a9d7f992
Gemini Mulitmodal Live to push TTSTextFrame only
2025-04-30 16:28:17 -04:00
Mark Backman
facbebb15f
Transcribe user audio in 26b
2025-04-30 16:28:16 -04:00
Mark Backman
2ba60fc41f
Update TranscriptProcessor to handle GeminiMultimodalLiveLLMService changes
2025-04-30 16:28:16 -04:00
Mark Backman
685f951ae2
Fix: GeminiMultimodalLiveLLMService was appending tokens to the context
2025-04-30 16:28:16 -04:00
Mark Backman
27d4c927a8
Merge pull request #1701 from pipecat-ai/mb/gemini-extend-session
...
Add context_window_compression support to GeminiMultimodalLiveLLMService
2025-04-30 14:35:50 -04:00
Mark Backman
20a59e8c56
Add InterimTranscriptionFrame and TranscriptionFrame to STTMuteFilter frame processing
2025-04-30 10:50:56 -04:00
Mark Backman
d9a0a93667
Add context_window_compression support to GeminiMultimodalLiveLLMService
2025-04-30 09:55:34 -04:00
Mark Backman
154d5d1859
Merge pull request #1699 from pipecat-ai/mb/more-docs-mocks
...
Additional import mocks to fix docs failure
2025-04-30 08:36:57 -04:00
Mark Backman
a192217256
Additional import mocks to fix docs failure
2025-04-29 21:45:27 -04:00
Mark Backman
10cdc47e05
Merge pull request #1689 from pipecat-ai/mb/handle-http-smart-turn-errors
...
Handle case where Fal Smart Turn returns a 500 error
2025-04-29 14:21:45 -04:00
Mark Backman
2b4d41a548
Merge pull request #1693 from flixoflax/bump-modal-example-dependencies
...
Bump modal deployment example dependencies
2025-04-29 14:21:31 -04:00
Filipi da Silva Fuchter
962f8062a5
Merge pull request #1581 from pipecat-ai/voice_agent_ice_servers
...
Configuring the voice-agent example to wait for all the ice candidates.
2025-04-29 13:30:12 -03:00
Filipi Fuchter
d80d385b2f
Adding a section explaining about ice servers.
2025-04-29 12:19:59 -03:00
Filipi Fuchter
b347ca472f
Checking the state again to avoid any eventual race condition
2025-04-29 12:04:20 -03:00
Filipi Fuchter
c3c4952abf
Reducing the timeout to 2 seconds for gathering the ice candidates.
2025-04-29 11:34:58 -03:00
Filipi Fuchter
f369ab4c1a
Printing each new ice candidate.
2025-04-29 11:23:33 -03:00
flixoflax
62b41c6789
removed aiohttp from deps, and version constraint from pipecat-ai
2025-04-29 16:14:51 +02:00
Filipi da Silva Fuchter
2872bc7902
Merge pull request #1587 from pipecat-ai/improving_ice_servers
...
Updated `SmallWebRTCConnection` to support `ice_servers` with credentials.
2025-04-29 11:07:32 -03:00
Filipi Fuchter
9658b75a10
Configuring the voice-agent example to use ice-servers and wait for all the ice candidates.
2025-04-29 10:52:07 -03:00
flixoflax
63de9039e6
Bumb modal deployment example deps
2025-04-29 15:50:56 +02:00
Filipi Fuchter
9352396d7e
Mentioning the new feature in the changelog.
2025-04-29 10:40:09 -03:00
Filipi Fuchter
d1ab1d38b7
Fixing the examples to use the new IceServer structure.
2025-04-29 10:33:19 -03:00
Filipi Fuchter
080f70d91c
Allowing to define the username and credential for the ice servers.
2025-04-29 10:32:42 -03:00
Mark Backman
ebed1fc6ea
Restructure _send_raw_request to raise errors early, then process the successful response
2025-04-29 09:05:14 -04:00
Aleix Conchillo Flaqué
6821b1cdab
RTVIProcessor: use single FunctionCallParams
2025-04-29 05:56:23 -07:00
Mark Backman
144ae9b611
Handle case where Fal Smart Turn returns a 500 error
2025-04-29 08:53:02 -04:00
Aleix Conchillo Flaqué
a2e7331ce2
Merge pull request #1680 from pipecat-ai/aleix/local-input-select-stt-update
...
examples: update local-input-select-stt
2025-04-28 12:01:12 -07:00
Aleix Conchillo Flaqué
8accd3e387
Merge pull request #1681 from pipecat-ai/aleix/tts-service-llm-full-response-end-fix
...
TTSService: do not push LLMFullResponseEndFrame if not needed
2025-04-28 12:00:55 -07:00
Mark Backman
3d05a74dc0
Merge pull request #1678 from Dev-Khant/integrate-mem0-oss
...
Integrate with Mem0 OSS
2025-04-28 14:15:40 -04:00
Aleix Conchillo Flaqué
e3c965f4d5
TTSService: do not push LLMFullResponseEndFrame if not needed
2025-04-28 11:03:22 -07:00
Dev-Khant
5354e5d891
formatting
2025-04-28 22:57:18 +05:30
Aleix Conchillo Flaqué
5784e91cff
update .gitignore
2025-04-28 09:34:45 -07:00
Aleix Conchillo Flaqué
bc5f098aaa
examples: update local-input-select-stt
2025-04-28 09:28:26 -07:00
Aleix Conchillo Flaqué
93534b4692
Merge pull request #1679 from pipecat-ai/aleix/update-package-lock-apr-28
...
examples: update package-lock.json
2025-04-28 09:27:01 -07:00
Aleix Conchillo Flaqué
b23d54c609
examples: update package-lock.json
2025-04-28 09:15:14 -07:00
Dev-Khant
aa23a7b1e6
update changelog
2025-04-28 20:03:20 +05:30
Dev-Khant
c0c41789ab
Integrate with Mem0 OSS
2025-04-28 17:15:53 +05:30
Jin Kim
cf2f249f8a
Use "use_original_timestamps" only for sonic-2 model
2025-04-27 19:33:14 +09:00
Aleix Conchillo Flaqué
029ef4f8c2
Merge pull request #1667 from pipecat-ai/aleix/function-call-single-parameter
...
function call single parameter
2025-04-25 13:53:10 -07:00
Aleix Conchillo Flaqué
9cad6dfce9
RTVIProcessor: simplify handle_function_call() and depreacted handle_function_call_start()
2025-04-25 13:34:05 -07:00
Aleix Conchillo Flaqué
4df6444832
examples: update with single FunctionCallParams parameter
2025-04-25 13:34:05 -07:00
Aleix Conchillo Flaqué
944bc23135
LLMService: use a single FunctionCallParams parameter for function calls
2025-04-25 13:34:03 -07:00
Aleix Conchillo Flaqué
1d863ee7de
Merge pull request #1669 from pipecat-ai/aleix/short-utterances-fixes
...
short utterances fixes
2025-04-25 13:25:15 -07:00
Vanessa Pyne
9ca775d1ab
Merge pull request #1668 from pipecat-ai/vp-update-transport-params-in-ex
...
Update examples with new transport param names
2025-04-25 15:24:28 -05:00
Aleix Conchillo Flaqué
03002ad685
LLMUserContextAggregator: reduce aggregation_timeout to 0.5
2025-04-25 13:21:00 -07:00
Aleix Conchillo Flaqué
99a4154cbc
LLMUserContextAggregator: ignore short uterrances while bot speaking
2025-04-25 13:21:00 -07:00
vipyne
0f68cc182d
Update examples with new transport param names
2025-04-25 15:18:56 -05:00
Aleix Conchillo Flaqué
3ac50b9902
Merge pull request #1664 from CerebriumAI/kyle/fix-ultravox-performance
...
Improved: Ultravox performance
2025-04-25 12:59:25 -07:00
Michael Louis
9557705b53
Changed warmup to internal function
2025-04-25 14:40:19 -04:00
Mark Backman
a7718926e9
Merge pull request #1666 from pipecat-ai/mb/add-vad-start-stop-events
...
Add VADUserStartedSpeakingFrame and VADUserStoppedSpeakingFrame
2025-04-25 10:49:17 -04:00
Mark Backman
dfa10af6ed
Simplify VAD events to be detected and emitted from BaseInputTransport
2025-04-25 10:28:44 -04:00
Mark Backman
8485ea6c5e
Merge pull request #1650 from pipecat-ai/mb/fal-smart-turn-readme
...
Add hosted demo link to Fal smart turn README
2025-04-25 09:39:54 -04:00
Mark Backman
b298376766
Add VADUserStartedSpeakingFrame and VADUserStoppedSpeakingFrame
2025-04-25 09:06:54 -04:00
Mark Backman
7cfefe4f84
Merge pull request #1593 from WebinarGeek/wg/gladia-translations
...
Push gladia translations as a TranscriptionFrame
2025-04-25 08:35:36 -04:00
Mark Backman
71c7373987
Update CHANGELOG
2025-04-25 08:26:40 -04:00
Mark Backman
d1086914fe
Add TranslationFrame and use in GladiaSTTService; add 13c-gladia-translation.py
2025-04-25 08:25:39 -04:00
Dan Berg
2fb85941d3
Add hint installing test requirements
2025-04-25 08:24:51 -04:00
Dan Berg
be8788e4da
Push gladia translations as a TranscriptionFrame
2025-04-25 08:24:51 -04:00
Mark Backman
acb6abd761
Merge pull request #1644 from pipecat-ai/mb/add-transport-examples
...
Add transports examples to foundational examples
2025-04-25 08:22:26 -04:00
Mark Backman
a528aad957
Merge pull request #1642 from pipecat-ai/mb/foundational-requirements
...
Add deepgram and cartesia to foundational example requirements to mak…
2025-04-25 08:22:08 -04:00
Mark Backman
5c13252801
Merge pull request #1658 from pipecat-ai/mb/update-fal-smart-turn-version
...
Update daily-transport version in fal-smart-turn demo
2025-04-25 08:21:50 -04:00
Mark Backman
a4422ac6c2
Add transports examples to foundational examples
2025-04-25 08:20:04 -04:00
Mark Backman
985a031353
Merge pull request #1657 from pipecat-ai/mb/word-wrangler-example
...
Add Word Wrangler demos
2025-04-25 08:16:02 -04:00
Kyle Gani
5c4079b286
Cleaned up: layout
2025-04-25 13:18:03 +02:00
Kyle Gani
5489ac5a73
Merge branch 'main' into kyle/fix-ultravox-performance
2025-04-25 13:16:48 +02:00
Kyle Gani
49fbcc86ac
Improved: Ultravox performance
2025-04-25 13:12:08 +02:00
Aleix Conchillo Flaqué
d20c3307b9
Merge pull request #1648 from pipecat-ai/aleix/always-push-audio
...
input transports now always push audio frames
2025-04-24 18:59:09 -07:00
Aleix Conchillo Flaqué
9fd76923fd
STTService: passthrough audio frames by default
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
a753a623d4
examples: allow setting custom program arguments
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
4ee6c4b59e
BaseOutputTransport: reword camera with video
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
e79a002e5a
examples: update camera_* with video_*
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
420912dd4b
transports: deprecate TransportParams.camera_* in favor of video_*
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
de7185e8db
examples: remove vad_enabled=True
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
8bfcfe8b1d
transports: deprecate TransportParams.vad_enabled
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
26d2ce5926
examples: remove vad_audio_passthrough=True
2025-04-24 17:14:18 -07:00
Aleix Conchillo Flaqué
9ee56bff9e
transports: push audio by default. s/vad_audio_passthrough/audio_in_passthrough/
2025-04-24 17:14:16 -07:00
Vanessa Pyne
2e0d77e4f0
Merge pull request #1627 from pipecat-ai/vp-mcp-take-3
...
MCP Service
2025-04-24 18:16:19 -05:00
vipyne
4cc8a4312c
Revert "update 39* examples as per #1648 "
...
This reverts commit b29ffeef29 .
2025-04-24 18:11:35 -05:00
vipyne
cb7cb381aa
Add MCPClient changelog line
2025-04-24 18:05:20 -05:00
vipyne
b29ffeef29
update 39* examples as per #1648
2025-04-24 17:19:50 -05:00
vipyne
b7b2a5b7a1
mcp service fix and add multiple mcp example
2025-04-24 17:13:40 -05:00
vipyne
3384598e07
mcp_service: pr notes
2025-04-24 17:13:40 -05:00
vipyne
c420dbe57f
MCP Service
...
WIP getting mcp.run to work
add mcp[cli] to toml and lint
mcp stdio example
mcp sse example
mcp_run POC
ruff formatting
2025-04-24 17:13:40 -05:00
Mark Backman
fa8aafc7a5
Merge pull request #1660 from pipecat-ai/mb/foundational-examples-readme
...
Update foundational README with ToC
2025-04-24 18:12:27 -04:00
Mark Backman
4b364dda29
Update foundational README with ToC
2025-04-24 18:04:36 -04:00
Mark Backman
6bb765e40f
Update daily-transport version in fal-smart-turn demo
2025-04-24 15:06:08 -04:00
Mark Backman
c80d09f66c
Add Word Wrangler demos
2025-04-24 14:31:48 -04:00
Mark Backman
f8ff10c5d5
Add hosted demo link to Fal smart turn README
2025-04-23 21:27:53 -04:00
Mark Backman
09ff836ef6
Merge pull request #1640 from pipecat-ai/mb/fal-smart-turn-example
...
Fal Smart Turn example
2025-04-23 17:27:27 -04:00
Mark Backman
e446ecac14
Merge pull request #1649 from pipecat-ai/mb/fix-smart-turn-metrics
...
fix: SmartTurnMetricsData was reporting 0 for inference and processin…
2025-04-23 17:23:16 -04:00
Mark Backman
8c0c8a6153
Code review fixes
2025-04-23 17:22:19 -04:00
Mark Backman
70033ae00b
fix: SmartTurnMetricsData was reporting 0 for inference and processing time
2025-04-23 17:17:46 -04:00
Mark Backman
ac9dce63ae
README updates
2025-04-23 16:55:35 -04:00
Mark Backman
8b2df48fab
Fix DailyTransport bot name
2025-04-23 16:43:54 -04:00
Mark Backman
156a5690fc
Merge pull request #1647 from mattmatters/fix-typo
...
Fix wating -> waiting typo
2025-04-23 16:27:00 -04:00
Matt Lewis
d42c618398
Fix wating -> waiting typo
2025-04-23 15:55:14 -04:00
Mark Backman
b23ca5a4a8
Merge pull request #1641 from pipecat-ai/mb/11labs-input-params
...
ElevenLabs: InputParams can be set individually
2025-04-23 14:31:37 -04:00
Mark Backman
63a6697a90
ElevenLabs: InputParams can be set individually
2025-04-23 14:28:38 -04:00
Aleix Conchillo Flaqué
f1e45d0f02
Merge pull request #1646 from pipecat-ai/aleix/pipecat-0.0.65
...
update CHANGELOG for 0.0.65
2025-04-23 11:27:25 -07:00
Mark Backman
4ad227ca2d
Merge pull request #1643 from pipecat-ai/mb/gladia-keepalive
...
Add a keepalive task to GladiaSTTService
2025-04-23 14:27:15 -04:00
Aleix Conchillo Flaqué
66cc18194b
update CHANGELOG for 0.0.65
2025-04-23 11:25:32 -07:00
Mark Backman
7d65132c93
Add a keepalive task to GladiaSTTService
2025-04-23 14:21:44 -04:00
Mark Backman
db7d7a4204
Merge pull request #1645 from pipecat-ai/mb/telnyx-auto-hang-up
...
Add auto_hang_up to Telnyx serializer
2025-04-23 14:20:28 -04:00
Mark Backman
7bbac11084
Add docstrings to TelnyxFrameSerializer
2025-04-23 14:13:20 -04:00
Mark Backman
76c8322b57
Make call_sid optional in TwilioFrameSerializer
2025-04-23 14:08:50 -04:00
Mark Backman
7b1cd3523d
Twilio: send only one hangup command
2025-04-23 13:41:36 -04:00
Mark Backman
6bd821ac9a
Add auto_hang_up to Telnyx serializer
2025-04-23 13:29:54 -04:00
Mark Backman
a6d51c343e
Add deepgram and cartesia to foundational example requirements to make quickstart smoother
2025-04-23 08:47:47 -04:00
Mark Backman
1a5cf7a521
Add local run and deployment steps to README
2025-04-22 21:37:35 -04:00
Mark Backman
69491417ec
Fal Smart Turn example
2025-04-22 21:16:41 -04:00
Aleix Conchillo Flaqué
b91780ced2
Merge pull request #1638 from pipecat-ai/aleix/pipecat-0.0.64
...
update CHANGELOG for 0.0.64
2025-04-22 17:35:25 -07:00
Aleix Conchillo Flaqué
8ded666958
update CHANGELOG for 0.0.64
2025-04-22 17:32:06 -07:00
Filipi da Silva Fuchter
2490c804a5
Merge pull request #1631 from pipecat-ai/smart_turn_timeout
...
Returning the turn as complete if the request don’t return a result within SmartTurnParams stop_secs
2025-04-22 19:51:10 -03:00
Filipi Fuchter
dd8856a673
Merge branch 'main' into smart_turn_timeout
...
# Conflicts:
# dot-env.template
2025-04-22 19:49:32 -03:00
Aleix Conchillo Flaqué
e7da08dab1
move smart turn files to audio.turn.smart_turn package
2025-04-22 15:29:31 -07:00
Aleix Conchillo Flaqué
ae60d42016
s/SmartTurnAnalyzer/HttpSmartTurnAnalyzer/ and add FalSmartTurnAnalyzer
2025-04-22 15:13:12 -07:00
Aleix Conchillo Flaqué
50e8d82ece
SmartTurn: some linting cleanup
2025-04-22 14:39:02 -07:00
Mark Backman
cc9901a82f
Replace httpx with aiohttp
2025-04-22 17:14:19 -04:00
Aleix Conchillo Flaqué
1fd43e8a3f
Merge pull request #1636 from pipecat-ai/aleix/examples-logging
...
examples: always use loguru for logging
2025-04-22 13:06:40 -07:00
Aleix Conchillo Flaqué
fdc508a1a5
examples: always use loguru for logging
2025-04-22 11:51:49 -07:00
Mark Backman
37269db247
Merge pull request #1634 from pipecat-ai/mb/twilio-end-call
...
Automatically hangup Twilio calls
2025-04-22 14:05:10 -04:00
Mark Backman
51269aabbd
Added cancel method to WebsocketServerOutputTransport
2025-04-22 13:58:39 -04:00
Mark Backman
74ecc19e09
Code review feedback
2025-04-22 13:54:12 -04:00
Mark Backman
c6d48c16df
Add twilio to pyproject.toml, update demo to use twilio option
2025-04-22 13:01:56 -04:00
Mark Backman
873d84aa09
Twilio serializer to return None
2025-04-22 12:50:11 -04:00
Mark Backman
7360866c97
Add docstrings
2025-04-22 12:49:17 -04:00
Mark Backman
81f4768661
Automatically hangup Twilio calls
2025-04-22 12:45:34 -04:00
Vanessa Pyne
972d65f61b
Merge pull request #1628 from pipecat-ai/vp-typo-fixes
...
typo fixes in phone-chatbot example
2025-04-22 10:05:56 -05:00
Mark Backman
1da9d398e3
Merge pull request #1619 from pipecat-ai/mb/grok-3-beta
...
GrokLLMService uses grok-3-beta as default model
2025-04-22 10:33:32 -04:00
Filipi Fuchter
7358bc6428
Returning the turn as complete if the request don’t return a result within SmartTurnParams stop_secs
2025-04-22 10:35:14 -03:00
vipyne
a6af499f84
typo fixes in phone-chatbot example
2025-04-21 23:49:13 -05:00
Aleix Conchillo Flaqué
f9d1a53e28
Merge pull request #1609 from pipecat-ai/aleix/pyproject-py-typed
...
pyproject: fix license fields
2025-04-21 16:14:22 -07:00
Mark Backman
3f3010af79
Add a SmartTurnMetricsData class, emitted by Metrics Frame in response to smart turn responses
2025-04-21 18:56:14 -04:00
Aleix Conchillo Flaqué
a02d47ddbd
Merge pull request #1625 from 0xPatryk/patch-1
...
Fixed AttributeError: object has no attribute '_sample_rate"
2025-04-21 15:40:54 -07:00
Patryk
a649aff3e7
Fixed AttributeError: 'OpenAITTSService' object has no attribute '_sample_rate'
2025-04-21 11:03:45 +02:00
Mark Backman
a9b551d73e
GrokLLMService uses grok-3-beta as default model
2025-04-19 08:05:59 -04:00
Mark Backman
747a821943
Merge pull request #1614 from pipecat-ai/mb/changelog-for-1525
...
Add CHANGELOG entry for PR 1525
2025-04-19 07:10:13 -04:00
Aleix Conchillo Flaqué
010db3ccd5
README: minor update
2025-04-18 20:57:05 -07:00
Aleix Conchillo Flaqué
db773b8b93
Merge pull request #1616 from pipecat-ai/aleix/new-readme
...
make README more fun
2025-04-18 18:15:35 -07:00
Mark Backman
16b7bf71b4
Additional README changes
2025-04-18 21:00:57 -04:00
Aleix Conchillo Flaqué
82d19508a4
make README more fun
2025-04-18 14:37:28 -07:00
Mark Backman
dc3646f0e7
Merge pull request #1615 from pipecat-ai/mb/issue-template
...
Add issue templates and move the pull request template to .github
2025-04-18 14:58:09 -04:00
Mark Backman
62e659cd3a
Update to .yml templates so that types are used
2025-04-18 13:21:01 -04:00
Mark Backman
b2945f44fd
Add issue templates and move the pull request template to .github
2025-04-18 12:17:46 -04:00
Mark Backman
618fbef81c
Add CHANGELOG entry for PR 1525
2025-04-18 11:32:34 -04:00
Mark Backman
70c42dfa6e
Merge pull request #1525 from shaiyon/google-default-creds
...
Enable usage of Application Default Credentials in Google services
2025-04-18 11:31:08 -04:00
Mark Backman
9ab374dd1f
Merge pull request #1612 from pipecat-ai/mb/07g-stt-model
...
examples: Fix 07g by changing STT model
2025-04-18 08:04:20 -04:00
Mark Backman
cc6d284417
examples: Fix 07g by changing STT model
2025-04-18 07:13:34 -04:00
Filipi da Silva Fuchter
f77d8f0b6f
Merge pull request #1611 from pipecat-ai/smart_turn_changelog
...
Mentioning the Smart Turn Detection into the changelog.
2025-04-17 23:02:57 -03:00
Varun Singh
9c0beb05cf
Merge pull request #1597 from pipecat-ai/vr000m-opus-added
...
Changing default codec to OPUS for telephony
2025-04-17 18:42:12 -07:00
Aleix Conchillo Flaqué
858981c404
Merge pull request #1610 from pipecat-ai/aleix/add-base-turn-analyzer
...
audio: add BaseTurnAnalyzer class
2025-04-17 18:38:08 -07:00
Aleix Conchillo Flaqué
9eed225aa2
audio: add BaseTurnAnalyzer class
2025-04-17 18:37:52 -07:00
Filipi Fuchter
9f7371e485
Mentioning the Smart Turn Detection into the changelog.
2025-04-17 22:31:40 -03:00
Aleix Conchillo Flaqué
d77c37ff14
pyproject: add py.typed (PEP 561)
2025-04-17 17:29:04 -07:00
Aleix Conchillo Flaqué
b4916f9dae
pyproject: fix license fields
2025-04-17 17:28:14 -07:00
Aleix Conchillo Flaqué
004a920920
Merge pull request #1563 from Bnowako/packaging-type-information
...
Add marker file for static type checkers
2025-04-17 17:26:15 -07:00
Filipi da Silva Fuchter
203c5a3a60
Merge pull request #1592 from pipecat-ai/smart_turn
...
Smart turn
2025-04-17 18:21:47 -03:00
Filipi Fuchter
7f6fb1754b
Merge remote-tracking branch 'origin/smart_turn' into smart_turn
2025-04-17 17:53:53 -03:00
Filipi Fuchter
a390ce13a4
Removing the UserEndOfTurnFrame
2025-04-17 17:53:31 -03:00
Filipi da Silva Fuchter
61d31d1c40
Restoring stop_secs to default value.
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-04-17 17:44:47 -03:00
Filipi da Silva Fuchter
e872ff943a
Using the default model for OpenAi.
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-04-17 17:43:39 -03:00
Filipi da Silva Fuchter
c71005e249
Using the default model for OpenAi.
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-04-17 17:43:23 -03:00
Filipi Fuchter
6e06bf97c0
Preventing emitting the UserStartedSpeaking event multiple times.
2025-04-17 17:21:29 -03:00
Filipi Fuchter
a80dc94e91
Fixing ruff format.
2025-04-17 16:47:17 -03:00
Filipi Fuchter
3ea9cfd251
Keeping the _speech_triggered as true if the state is incomplete.
2025-04-17 16:46:15 -03:00
Filipi Fuchter
a80f82cdb6
Moving the environment variables to inside the demo.
2025-04-17 16:28:50 -03:00
Aleix Conchillo Flaqué
d24bab354f
Merge pull request #1607 from pipecat-ai/aleix/fix-websocket-disconnects
...
services: fix TTS websocket services disconnections
2025-04-17 12:27:52 -07:00
Filipi Fuchter
53ee3fb64c
Changing the log levels used in smart_turn
2025-04-17 16:14:13 -03:00
Filipi Fuchter
3599761e4e
Changing the default behavior to only use the last vad segment, and increasing the default stop_secs to 3
2025-04-17 16:07:03 -03:00
Aleix Conchillo Flaqué
c0b3fe3985
services: only read from TTS websocket if websocket connection established
2025-04-17 11:54:07 -07:00
Aleix Conchillo Flaqué
497d48b6c8
services: fix TTS websocket services disconnections
...
Fixes #1467
2025-04-17 11:29:49 -07:00
Filipi Fuchter
e179916c9c
Creating a new param use_only_last_vad_segment
2025-04-17 11:49:51 -03:00
Filipi Fuchter
b0b38beb19
Returning the max duration back to 8 seconds.
2025-04-17 11:39:48 -03:00
Filipi Fuchter
8577139d21
Fixing to keep the last max samples.
2025-04-17 11:39:06 -03:00
Filipi Fuchter
e2fbbb4b40
Renaming the smart turn classes.
2025-04-17 10:43:21 -03:00
Filipi Fuchter
88ce117e84
Changing the max duration default value to 16 seconds.
2025-04-17 10:35:13 -03:00
Filipi Fuchter
266537c3f4
Fixing to respect the stop_secs.
2025-04-17 10:07:08 -03:00
Filipi Fuchter
230d2f80fa
Merge branch 'main' into smart_turn
2025-04-17 09:36:30 -03:00
Filipi Fuchter
3f0688aefa
Testing smart turn using stop_secs as 5 seconds
2025-04-17 09:36:03 -03:00
Filipi da Silva Fuchter
5be3e6979e
Merge pull request #1533 from pipecat-ai/daily_small_webrtc
...
Example interoping between SmallWebRTC and Daily
2025-04-17 09:19:23 -03:00
Mark Backman
9c19cff818
Merge pull request #1585 from ArmanJR/main
...
Troubleshooting SSL error
2025-04-16 22:46:45 -04:00
Mark Backman
95f3537bde
Merge pull request #1598 from pipecat-ai/mb/11labs-http-timestamps
...
Added word/timestamp pairs to ElevenLabsHttpTTSService
2025-04-16 22:38:26 -04:00
Mark Backman
7ff748defd
Merge pull request #1600 from pipecat-ai/mb/11labs-previous-text
...
Add previous_text context to ElevenLabsHttpTTSService
2025-04-16 22:33:38 -04:00
Mark Backman
2dafbee2aa
Code review fixes
2025-04-16 22:29:33 -04:00
Mark Backman
1e0a9d7b06
Add previous_text context to ElevenLabsHttpTTSService
2025-04-16 22:22:08 -04:00
Mark Backman
4a23e138b1
Added word/timestamp pairs to ElevenLabsHttpTTSService
2025-04-16 22:20:51 -04:00
Mark Backman
384f80983f
Added word/timestamp pairs to ElevenLabsHttpTTSService
2025-04-16 21:55:00 -04:00
Aleix Conchillo Flaqué
f6f01ea7e4
Merge pull request #1588 from pipecat-ai/aleix/llm-aggregator-params
...
LLM aggregator params
2025-04-16 15:25:21 -07:00
Aleix Conchillo Flaqué
f385cc0460
pyproject: add websockets as google dependency
2025-04-16 15:19:25 -07:00
Aleix Conchillo Flaqué
e97de43de2
add LLMUserAggregatorParams and LLMAssistantAggregatorParams
2025-04-16 15:19:19 -07:00
Aleix Conchillo Flaqué
8299c96ad4
Merge pull request #1603 from pipecat-ai/aleix/deepgram-tavus-fixes
...
deepgram/tavus fixes
2025-04-16 14:55:45 -07:00
Aleix Conchillo Flaqué
e9af585edd
DeepgramTTSService: re-add base_url to constructor
2025-04-16 14:54:02 -07:00
Aleix Conchillo Flaqué
31f7082d12
DeepgramTTSService: use Deepgram's asyncrest instead of asyncio.to_thread
2025-04-16 14:40:59 -07:00
Aleix Conchillo Flaqué
6cea71270e
tts: use smaller audio chunk sizes
2025-04-16 14:40:59 -07:00
Aleix Conchillo Flaqué
d05b2d0e8d
TavusVideoService: fix rate limiting and max size
2025-04-16 14:40:59 -07:00
Filipi Fuchter
a458c1e92b
Improving the README and fixing the env.example
2025-04-16 18:38:48 -03:00
Filipi Fuchter
5bbf1d0209
Example interoping between SmallWebRTC and Daily.
2025-04-16 17:14:12 -03:00
Mark Backman
235cd9cecc
Merge pull request #1586 from rahultayal22/rah_google_vertex_issue
...
Fixed params issue in Google Vertex ai
2025-04-16 14:56:46 -04:00
Mark Backman
829f3ed2db
Merge pull request #1601 from pipecat-ai/mb/eject-at-exp-token
...
Add eject_at_token_exp to Daily REST helpers, modify default values
2025-04-16 14:54:41 -04:00
Rahul Tayal
ac64f0ba91
Run ruff on code
2025-04-16 23:19:09 +05:30
Rahul Tayal
ce41a7585b
Resolved comment to update change log
2025-04-16 22:24:25 +05:30
Mark Backman
ce92dfb5ec
Add eject_at_token_exp to Daily REST helpers, modify default values
2025-04-16 12:26:33 -04:00
Mark Backman
ee132a2188
Merge pull request #1596 from pipecat-ai/mb/gpt-4.1
...
Update services and examples to use gpt-4.1 by default
2025-04-16 08:37:48 -04:00
Mark Backman
5f3bbf9828
Rely on default OpenAI model for examples and tests
2025-04-16 08:33:34 -04:00
Mark Backman
55d1d81430
Merge pull request #1595 from pipecat-ai/mb/rtvi-start-convo
...
Update client/server demos to kick off conversation in on_client_read…
2025-04-16 08:23:16 -04:00
Filipi Fuchter
8e36bdbed7
Adding some comments to the code.
2025-04-16 09:11:27 -03:00
Filipi Fuchter
cd8bd7f487
Adding some comments to the code.
2025-04-16 08:58:40 -03:00
Filipi Fuchter
5fa47b7a5c
Adding the dependencies for the remote smart turn
2025-04-16 08:45:01 -03:00
Filipi Fuchter
616961b487
Stop removing segments from the end
2025-04-16 08:04:38 -03:00
Filipi Fuchter
650d4d9ee2
Changing the start speech time and adding logs.
2025-04-16 07:55:20 -03:00
Filipi Fuchter
2627cb6bf2
Allowing to define SmartTurnParams
2025-04-16 07:13:13 -03:00
Filipi Fuchter
0e4115049b
Refactoring to use keep alive sessions.
2025-04-16 06:44:57 -03:00
Filipi Fuchter
3ebef9346f
Adding support for RemoteSmartTurn
2025-04-16 06:33:42 -03:00
Filipi Fuchter
3e2d21779f
Refactoring the BaseEndOfTurnAnalyzer to include most of the logic
2025-04-16 06:11:56 -03:00
Filipi Fuchter
cfefcac35f
Resetting the silence frames when the user speaks.
2025-04-15 20:51:36 -03:00
Filipi Fuchter
57b39c084f
Triggering to check if the turn is complete based on the maximum timeout
2025-04-15 20:42:41 -03:00
Filipi Fuchter
11b6de0900
Triggering to check if the turn is complete each time the user stops speaking based on the vad
2025-04-15 17:28:00 -03:00
Varun Singh
824bc9bf16
Update dial.js
2025-04-15 12:48:33 -07:00
Varun Singh
d0ddef6c12
Update server.py
2025-04-15 12:37:33 -07:00
Mark Backman
ad40a0f076
Update OpenAILLMService and OpenPipeLLMService to use gpt-4.1 by default
2025-04-15 15:11:05 -04:00
Filipi Fuchter
e6325a8229
Integrating with the smart turn model to predict
2025-04-15 16:01:09 -03:00
Mark Backman
6d10732889
Update OpenAILLMService examples to use gpt-4.1
2025-04-15 14:59:55 -04:00
Mark Backman
fdb46a0fa9
Update client/server demos to kick off conversation in on_client_ready handler
2025-04-15 14:50:38 -04:00
Filipi Fuchter
3588b06718
Adding missing torch dependency.
2025-04-15 12:28:36 -03:00
Filipi Fuchter
73874f6ec0
Loading the smart turn model.
2025-04-15 12:11:06 -03:00
Filipi Fuchter
6ab9a8ad7f
Starting to create a local smart turn
2025-04-15 11:24:39 -03:00
Filipi Fuchter
821e303249
Bringing Aleix initial implementation for the smart turn.
2025-04-15 10:21:40 -03:00
chadbailey59
efae26a5a8
Client connect/disconnect events for DailyTransport ( #1544 )
...
* added multi transport example
* added working example
* restructured example and added readme
* removed image
* cleanup
* changed data type of callback signature
* removed pipecat example
* added changelog
2025-04-14 15:56:41 -05:00
Aleix Conchillo Flaqué
d16ace22ac
Merge pull request #1583 from pipecat-ai/aleix/soundfilemixer-constructor-updates
...
SoundfileMixer: add mixing argument and require keywords
2025-04-14 10:59:30 -07:00
Rahul Tayal
001c26b79c
Fixed params issue in Google Vertex ai
2025-04-14 23:29:16 +05:30
Arman
8dc4f1cda0
Troubleshooting SSL error
2025-04-14 13:39:53 -04:00
Aleix Conchillo Flaqué
ab6be11a0e
SoundfileMixer: add mixing argument and require keywords
2025-04-14 08:30:56 -07:00
Filipi da Silva Fuchter
054158b0ff
Merge pull request #1579 from pipecat-ai/fixing_smallwebrtc_issue
...
Fixed an issue in `SmallWebRTCTransport`
2025-04-14 10:44:22 -03:00
Filipi da Silva Fuchter
174cf13abd
Merge pull request #1580 from pipecat-ai/fixing_voice_agent_example
...
Fixing the voice agent example to always create the video transceiver.
2025-04-14 10:44:07 -03:00
Filipi Fuchter
099d2c02e1
Fixing the voice agent example to always create the video transceiver.
2025-04-14 10:41:39 -03:00
Filipi Fuchter
e1108466f6
Fixed an issue in SmallWebRTCTransport where an error was thrown if the client did not create a video transceiver.
2025-04-14 10:36:25 -03:00
Mark Backman
edd53d425e
Merge pull request #1577 from pipecat-ai/hush/trackStoppedSimpleChatbot
...
docs: Fix TrackStopped typo in SimpleChatbot
2025-04-14 08:32:58 -04:00
James Hush
b160cf34e9
Remove formatting
2025-04-14 15:13:45 +08:00
James Hush
dae3b927e1
docs: Fix TrackStopped typo in SimpleChatbot
2025-04-14 15:12:17 +08:00
Mark Backman
bd3d30111a
Merge pull request #1569 from pipecat-ai/pipecat-0.0.63
...
Update CHANGELOG for 0.0.63
2025-04-11 20:09:58 -04:00
Mark Backman
8c7e16e717
Update CHANGELOG for 0.0.63
2025-04-11 20:04:50 -04:00
Mark Backman
f6accbd510
Updating foundation examples to use SmallWebRTCTransport and pipecat-ai-small-webrtc-prebuilt ( #1534 )
...
Co-authored-by: Filipi Fuchter <filipi@daily.co >
2025-04-11 19:44:16 -04:00
Mark Backman
8186219879
Merge pull request #1513 from pipecat-ai/mb/gemini-context-formatting
...
Fix: GeminiMultimodalLiveLLMService, add spaces between words in assi…
2025-04-11 15:30:51 -04:00
Mark Backman
b9a2ed5b58
Fix: GeminiMultimodalLiveLLMService, add spaces between words in assistant context messages
2025-04-11 15:14:52 -04:00
Mark Backman
7ac12ffc85
Merge pull request #1550 from pipecat-ai/mb/cartesia-spelling-timestamps
...
Fix: Cartesia's spelling feature adds whole word to context
2025-04-11 15:13:55 -04:00
Filipi da Silva Fuchter
f623cf96f7
Merge pull request #1560 from pipecat-ai/bot_left_signalling
...
Bot left signalling message
2025-04-11 16:08:01 -03:00
Mark Backman
06be20eb16
Fix: Cartesia's spelling feature adds whole word to context
2025-04-11 15:04:58 -04:00
Filipi Fuchter
816b3a9545
Fixing ruff format
2025-04-11 15:37:16 -03:00
Filipi Fuchter
255666925b
Sending a new signalling message peerLeft.
2025-04-11 15:35:50 -03:00
Mark Backman
0df065fda4
Merge pull request #1566 from pipecat-ai/mb/gemini-live-beta
...
Add Gemini Live support for languages, native model transcriptions, media resolution, and VAD settings
2025-04-11 12:40:04 -04:00
Mark Backman
241a947b8b
Add CHANGELOG entries
2025-04-11 11:46:48 -04:00
Mark Backman
e28c199dd1
Add GeminiMultimodalLiveLLMService support for VAD Params
2025-04-11 11:46:48 -04:00
Filipi da Silva Fuchter
6220ee4efb
Merge pull request #1565 from pipecat-ai/fixing_video_transform_demo
...
Fixing the video transform demo to use 20ms audio.
2025-04-11 11:45:29 -03:00
Filipi Fuchter
b650d043bf
Fixing the video transform demo to use 20ms audio.
2025-04-11 11:22:41 -03:00
Mark Backman
121e6d2157
Add media resolution support to GeminiMultimodalLiveLLMService
2025-04-11 10:18:29 -04:00
Mark Backman
dbd7869de7
Add model transcription support
2025-04-11 10:02:52 -04:00
Mark Backman
b7d56d5ff0
Add language support for Gemini Live
2025-04-11 09:21:14 -04:00
Bnowako
61cba0136f
Add marker file for static type checkers
2025-04-11 11:00:57 +02:00
Filipi da Silva Fuchter
ed743b55d4
Merge pull request #1561 from pipecat-ai/fixing_voice_agent
...
Fixing voice agent example
2025-04-10 23:33:35 -03:00
Filipi Fuchter
fb074895f5
Fixing ruff format.
2025-04-10 23:19:31 -03:00
Filipi Fuchter
d916865ccc
Fixing voice agent example to work with the last released version of pipecat.
2025-04-10 23:10:50 -03:00
Filipi Fuchter
6378a8ccd3
Starting to implement a signalling message to when the bot has left
2025-04-10 23:02:27 -03:00
Aleix Conchillo Flaqué
5dbb5f176b
Merge pull request #1551 from pipecat-ai/aleix/daily-python-0.17.0
...
pyproject: update daily-python to 0.17.0
2025-04-10 09:06:55 -07:00
Filipi da Silva Fuchter
b89f2611f7
Merge pull request #1539 from pipecat-ai/small_wbertc_mute_state
...
SmallWebRTC mute state
2025-04-10 11:26:53 -03:00
Filipi Fuchter
db0f783c55
Updating the video-transform demo to use the latest version of the SmallWebRTCTransport.
2025-04-10 11:23:28 -03:00
Filipi Fuchter
20ec323647
Refactoring the video-transform demo to be able to enable or disable the cam.
2025-04-10 11:23:05 -03:00
Filipi Fuchter
f71c09a4fd
Added support in SmallWebRTCTransport to detect when remote tracks are muted.
2025-04-10 11:22:37 -03:00
Mark Backman
cba4ebfcf9
Merge pull request #1555 from pipecat-ai/mb/gemini-beta-base
2025-04-10 09:01:16 -04:00
Mark Backman
3b9a8946f9
Update GeminiMultimodalLiveLLMService base_url
2025-04-10 08:17:52 -04:00
Mark Backman
db3620c4be
Merge pull request #1553 from balaji-atoa/main
...
feat: change default model name on live api
2025-04-10 08:10:35 -04:00
Mark Backman
11338ea92d
Merge pull request #1552 from pipecat-ai/mb/p2p-capture-image
...
Add image capture to SmallWebRTCTransport
2025-04-10 07:52:13 -04:00
Filipi da Silva Fuchter
90563a4091
Merge pull request #1542 from pipecat-ai/small_webrtc_prebuilt_ui
...
Using the small-webrtc-prebuilt-ui
2025-04-10 07:39:26 -03:00
Filipi da Silva Fuchter
937f5f7cb7
Update examples/p2p-webrtc/video-transform/server/requirements.txt
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-04-10 07:37:23 -03:00
Filipi da Silva Fuchter
4f221b817a
Update examples/p2p-webrtc/video-transform/README.md
...
Co-authored-by: Mark Backman <mark@daily.co >
2025-04-10 07:37:07 -03:00
balaji-atoa
c79c1f65fc
feat: change default model name on live api
2025-04-10 11:59:11 +05:30
Mark Backman
8ad2ad0e59
Add image capture to SmallWebRTCTransport
2025-04-09 23:01:06 -04:00
Aleix Conchillo Flaqué
499b258bf9
pyproject: update daily-python to 0.17.0
2025-04-09 18:59:10 -07:00
Filipi Fuchter
05b6a5ae4b
Improving the video-transform readme
2025-04-09 15:55:13 -03:00
Filipi Fuchter
65fcea28ce
Using the small-webrtc-prebuilt-ui
2025-04-09 15:45:30 -03:00
Kwindla Hultman Kramer
005c0b55b6
Merge pull request #1545 from pipecat-ai/khk/gem-live-0408
...
Gemini Multimodal Live API base_url format fix
2025-04-08 21:46:30 -07:00
Kwindla Hultman Kramer
1828127f41
small fix to wss base_url
2025-04-08 20:22:26 -07:00
Filipi da Silva Fuchter
77ab841cab
Merge pull request #1532 from pipecat-ai/p2p_ios_demo
...
iOS demo for the p2p-webrtc video-transform example
2025-04-07 16:58:06 -03:00
Filipi Fuchter
3bbc75110a
Mentioning the iOS client inside the changelog and fixing the readme.
2025-04-07 16:54:26 -03:00
Filipi Fuchter
b2ce1d9378
Merge branch 'main' into p2p_ios_demo
2025-04-07 16:50:58 -03:00
Filipi Fuchter
58714865df
Using the public version of pipecat-client-ios-small-webrtc
2025-04-07 16:48:18 -03:00
Mark Backman
03b3635b0a
Merge pull request #1521 from pipecat-ai/mb/increase-bot-vad-stop-secs
...
Increase BOT_VAD_STOP_SECS for services with slower speech patterns
2025-04-07 14:44:31 -04:00
Mark Backman
aaa7b5e626
Merge pull request #1524 from pipecat-ai/mb/tts-generate-with-text
...
TTS: Skip generation when there is no text
2025-04-07 14:44:18 -04:00
Varun Singh
0b8486ce39
Merge pull request #1418 from pipecat-ai/vr000m-pcc-dialin-webhook-server
...
Pipecat Cloud: Companion server to handle webhooks for pinless dial-in
2025-04-07 09:00:38 -07:00
Mark Backman
d4ae091ddd
Update port in FastAPI README, add run steps to nextjs README
2025-04-07 11:09:43 -04:00
Mark Backman
9e0a57a6de
Rename directories
2025-04-07 10:44:41 -04:00
Mark Backman
fc4c1e4110
README updates
2025-04-07 10:33:18 -04:00
Mark Backman
9b740d9e72
Merge pull request #1537 from pipecat-ai/mb/azure-tts-lang
...
Fix: Set language for Azure TTS services
2025-04-07 09:46:08 -04:00
Mark Backman
b03563765f
Fix: Set language for Azure TTS services
2025-04-07 09:24:31 -04:00
Filipi Fuchter
a1578bd67a
iOS demo for the p2p-webrtc video-transform example
2025-04-04 16:40:52 -03:00
Filipi da Silva Fuchter
6466573b84
Merge pull request #1498 from pipecat-ai/aiortc_example_ios
...
Improvements for the SmallWebRTCTransport
2025-04-04 16:39:06 -03:00
Filipi Fuchter
b42dc83696
Improvements for the SmallWebRTCTransport:
...
- Wait until the pipeline is ready before triggering the `connected` event.
- Queue messages if the data channel is not ready.
- Update the aiortc dependency to fix an issue where the 'video/rtx' MIME type
was incorrectly handled as a codec retransmission.
- Avoid initial video delays.
2025-04-04 16:33:57 -03:00
Filipi Fuchter
fe5931b884
Updating aiortc to fix an issue where 'video/rtx' MIMEType retransmission incorrectly handled as a codec
2025-04-04 16:28:54 -03:00
Filipi Fuchter
4b438ff7d7
Allowing ngrok connections to the video-transform demo
2025-04-04 16:28:37 -03:00
Filipi da Silva Fuchter
89a8c16676
Merge pull request #1531 from pipecat-ai/fix_chunk_default_value
...
Fixed SmallWebRTCTransport to support dynamic chunk values.
2025-04-04 16:04:05 -03:00
Filipi Fuchter
c4c92585f9
Fixed SmallWebRTCTransport to support dynamic chunk values.
2025-04-04 15:38:12 -03:00
Prem Adithya
c510870736
Merge branch 'pipecat-ai:main' into anthropic-client-bug-fixes
2025-04-04 16:41:04 +11:00
Shaiyon Hariri
af23200511
Use default google creds as fallback when not provided in llm_vertex,stt, and tts
2025-04-03 16:42:58 -04:00
Mark Backman
63146d6f85
TTS: Skip generation when there is no text
2025-04-03 16:15:58 -04:00
Mattie Ruth
ec00edc893
Update client examples to use latest versions ( #1523 )
2025-04-03 15:47:03 -04:00
Mark Backman
a21be058e2
Increase BOT_VAD_STOP_SECS for services with slower speech patterns
2025-04-03 15:25:48 -04:00
Mark Backman
c226c20e12
Merge pull request #1519 from pipecat-ai/mb/ref-docs-toc
...
Docs: Update ToC With Adapters and Observers
2025-04-03 15:19:35 -04:00
Aleix Conchillo Flaqué
78e6669105
Merge pull request #1514 from pipecat-ai/aleix/producer-consumer-processors
...
processors: add ProducerProcessor and ConsumerProcessor
2025-04-03 12:18:49 -07:00
Aleix Conchillo Flaqué
79f29e14dd
processors: add ProducerProcessor and ConsumerProcessor
2025-04-03 09:44:56 -07:00
Mark Backman
d4a00fd080
Merge pull request #1517 from pipecat-ai/mb/update-simple-chatbot-packages
...
Update client packages for simple-chatbot JS and React
2025-04-03 10:07:40 -04:00
Mark Backman
d4186fa115
Merge pull request #1518 from pipecat-ai/mb/openai-verse
...
Add verse voice and bump the OpenAI version
2025-04-03 09:48:09 -04:00
Mark Backman
3536cbcd13
Add docstrings to FunctionSchema, update CONTRIBUTING.md with docstrings guidance, ignore __init__ docstrings if a class is sufficiently documented
2025-04-03 09:21:26 -04:00
Mark Backman
e3bcb70b13
Update ToC With Adapters and Observers
2025-04-03 09:02:09 -04:00
Mark Backman
19a82f9522
Add verse voice and bump the OpenAI version
2025-04-03 08:23:59 -04:00
Mark Backman
8c0a847449
Update client packages for simple-chatbot JS and React
2025-04-03 07:43:25 -04:00
Dominic Stewart
e3704cd1a1
Updated imports to work with pipecat 0.62 ( #1515 )
2025-04-03 15:07:02 +08:00
Dominic Stewart
1ba037865b
Call Transfer demo ( #1348 )
...
* Updated code to dial out to an operator, keep track of operator conversation while escalated and then return to conversation when finished
* Removed unnecessary imports
* Updated bot runner code, added call routing file and then updated the call transfer and voicemail detection examples
* Updated the bot files
* Made prompt one level higher in the body and an array
* Updated call transfer examples to work correctly
* Updated gemini voicemail detection example to work
* Added twilio bot support back to the bot_runner
* Moved some state management, participant management and other logic to the helper file.
* Updated comments
* Updated env and requirements file
* Ran the examples and made sure code works. Still need to work on the prompts a bit
* Fixed format issue
* Add support to disable summary in call transfer
* Added support for operator transfer mode
* Updated readme file
* Updated readme based on feedback, and handling of various properties in the json to be more flexible for future examples
* Updated number of endpoints
* Updated readme to remove fly deployment text and replaced with Pipecat Cloud
* Starting to tweak function calls and prompts
* Updated examples to more consistently call the functions and say what they need to say
* Updated examples
* Updated examples
* Updated examples to work correctly
* Add simple bot versions of dialin and dialout
* Refactored the bot runner file to make adding future examples easier
* Based on feedback, removed examples for multiple LLMs and also adjusted voicemail detection code to be simpler
* Made sure to only capture the users transcription once
* Updated readme with latest changes
* Forgot to update the order of examples in one place
* Fixed formatting issue
* Adjusted based on james feedback
* Changed default_mode to default_calltransfer_mode
2025-04-03 09:03:23 +09:00
Aleix Conchillo Flaqué
909520f76e
Merge pull request #1508 from pipecat-ai/mb/gemini-push-stop-speaking-frame
...
LLMAssistantContextAggregator should push BotStoppedSpeakingFrames
2025-04-02 16:25:08 -07:00
Mark Backman
d06cfcd597
Merge pull request #1512 from pipecat-ai/mb/fix-gemini-examples
...
Examples: Fix context_aggregator.assistant() pipeline position
2025-04-02 19:07:09 -04:00
Mark Backman
2579d0cf57
Examples: Fix context_aggregator.assistant() pipeline position
2025-04-02 16:11:03 -04:00
Mark Backman
1ec20b2e74
Merge pull request #1509 from pipecat-ai/mb/openia-voices
...
Add new voices to OpenAITTSService
2025-04-02 15:50:39 -04:00
Mark Backman
55a6e5aa4c
Add new voices to OpenAITTSService
2025-04-02 12:09:36 -04:00
Varun Singh
2229730169
moving to appropriate directory
2025-04-01 23:45:09 -07:00
Varun Singh
24b54c66ee
fixes review comments
2025-04-01 23:39:21 -07:00
Varun Singh
a14205415f
replaced dailyAPIKey with pccApiKey, also allow handling of messages when hmac is missing
2025-04-01 23:34:24 -07:00
Varun Singh
18b56d4a10
Fix README.md
2025-04-01 23:32:50 -07:00
Mark Backman
b85bd91d08
LLMAssistantContextAggregator should push BotStoppedSpeakingFrames
2025-04-01 23:35:09 -04:00
Aleix Conchillo Flaqué
23f3285a7d
Merge pull request #1507 from pipecat-ai/aleix/pipecat-0.0.62
...
update CHANGELOG for 0.0.62
2025-04-01 19:00:06 -07:00
Aleix Conchillo Flaqué
94f6436619
update CHANGELOG for 0.0.62
2025-04-01 18:55:04 -07:00
Aleix Conchillo Flaqué
480692971c
Merge pull request #1506 from pipecat-ai/aleix/websockets-mixer-loop-fixes
...
transports(websocket): close connection from last transport
2025-04-01 18:52:47 -07:00
Aleix Conchillo Flaqué
5df5f6ae4c
transports(websocket): close connection from last transport
2025-04-01 18:32:03 -07:00
Aleix Conchillo Flaqué
6940112ab9
Merge pull request #1504 from pipecat-ai/aleix/base-output-transport-audio-10ms-chunk-update
...
TransportParams: set audio_out_10ms_chunks to 4
2025-04-01 15:15:24 -07:00
Aleix Conchillo Flaqué
80584e9138
TransportParams: set audio_out_10ms_chunks to 4
2025-04-01 15:13:28 -07:00
Aleix Conchillo Flaqué
1fd01e715d
Merge pull request #1503 from pipecat-ai/aleix/function-call-result-system-frame
...
frames: make FunctionCallResultFrame a SystemFrame
2025-04-01 15:08:26 -07:00
Aleix Conchillo Flaqué
a7a1cd0cde
Merge pull request #1502 from pipecat-ai/aleix/test-user-idle-py310
...
tests: fix test_user_idle_processor for python 3.10
2025-04-01 15:08:10 -07:00
Aleix Conchillo Flaqué
e5a6b9d2b4
Merge pull request #1500 from pipecat-ai/aleix/base-output-transport-optimize-bot-speaking
...
BaseOutputTransport: optimize BotSpeakingFrames
2025-04-01 14:59:25 -07:00
Aleix Conchillo Flaqué
169b50af61
frames: make FunctionCallResultFrame a SystemFrame
2025-04-01 14:42:22 -07:00
Aleix Conchillo Flaqué
31311d8ac5
tests: fix test_user_idle_processor for python 3.10
2025-04-01 13:54:59 -07:00
Aleix Conchillo Flaqué
bfd06b321d
BaseOutputTransport: optimize BotSpeakingFrames
2025-04-01 11:11:49 -07:00
Aleix Conchillo Flaqué
3efbcab39c
Merge pull request #1499 from pipecat-ai/aleix/base-output-transport-set-chunks-size
...
BaseOutputTransport: allow setting 10ms output audio chunks
2025-04-01 11:10:34 -07:00
Aleix Conchillo Flaqué
b40ca391f5
BaseOutputTransport: allow setting 10ms output audio chunks
2025-04-01 10:48:36 -07:00
Aleix Conchillo Flaqué
43008c8c5b
Merge pull request #1501 from pipecat-ai/aleix/transcription-processor-interruption
...
TranscriptProcessor: send TranscriptionUpdateFrame after interruption
2025-04-01 10:46:16 -07:00
Aleix Conchillo Flaqué
3a37b11e56
TranscriptProcessor: send TranscriptionUpdateFrame after interruption
2025-04-01 10:21:21 -07:00
Mark Backman
9ea81bc982
Merge pull request #1497 from pipecat-ai/mb/gladia-languages
...
Align languages with Gladia's supported languages, remove audio_enhancer option
2025-04-01 11:54:24 -04:00
Mark Backman
98b499e2e9
Remove audio_enhancer option
2025-04-01 10:26:28 -04:00
Mark Backman
72c8f6c8c3
Update GladiaSTTService language list
2025-04-01 10:17:42 -04:00
Mark Backman
ea61256ddc
Merge pull request #1496 from pipecat-ai/mb/gladia-model
...
Update GladiaSTTService default model
2025-04-01 08:52:13 -04:00
Mark Backman
babafadbe4
Merge pull request #1494 from pipecat-ai/mb/p2p-examples-gitignore
...
Add .gitignore to p2p video-transform example
2025-04-01 07:39:35 -04:00
Mark Backman
a5660f6dc7
Add .gitignore to p2p video-transform example
2025-04-01 07:20:39 -04:00
Aleix Conchillo Flaqué
64ad916c5f
Merge pull request #1492 from pipecat-ai/aleix/downgrade-to-aiohttp-3.11.12
...
pyproject: downgrade to aiohttp 3.11.12
2025-03-31 19:01:04 -07:00
Aleix Conchillo Flaqué
13d0563298
pyproject: downgrade to aiohttp 3.11.12
...
See https://pypi.org/project/aiohttp/#history
2025-03-31 18:59:41 -07:00
Mark Backman
20a1dd066d
Update GladiaSTTService default model
2025-03-31 19:02:28 -04:00
Mark Backman
56f6e3ceb4
Merge pull request #1490 from pipecat-ai/fix_ruff_format
...
Fixing ruff format.
2025-03-31 18:37:19 -04:00
Mark Backman
3afab63870
Merge pull request #1488 from pipecat-ai/mb/stt-mute-filter-logline
...
Clarify the mute/unmute log line in STTMuteFilter
2025-03-31 18:35:47 -04:00
Filipi Fuchter
d3b9a0aab0
Fixing ruff format.
2025-03-31 19:17:40 -03:00
Filipi da Silva Fuchter
6b21081a7d
Merge pull request #1487 from pipecat-ai/smallwebrtc_ios_support
...
SmallWebRTCTransport: Improvements to work with mobile
2025-03-31 19:10:03 -03:00
Aleix Conchillo Flaqué
648bdea64c
fix formatting
2025-03-31 15:04:45 -07:00
milo157
ed387e876a
Merge pull request #1486 from CerebriumAI/feature/ultravox
...
Feature/ultravox - bug fixes
2025-03-31 15:03:26 -07:00
Aleix Conchillo Flaqué
2fb9aa4d76
Merge pull request #1489 from pipecat-ai/aleix/base-ai-services-restructure
...
services: restructure base AI services into modules
2025-03-31 15:00:13 -07:00
Aleix Conchillo Flaqué
9eba8f1637
services: restructure base AI services into modules
2025-03-31 13:53:36 -07:00
Mark Backman
43c255f58a
Clarify the mute/unmute log line in STTMuteFilter
2025-03-31 16:45:02 -04:00
Filipi Fuchter
121e70a029
Improvements on the video transform example to work on mobile.
2025-03-31 17:11:38 -03:00
Filipi Fuchter
70e28a0547
Adding support to yuvj420p which is the format that we receive from mobile iOS.
2025-03-31 13:12:20 -03:00
Mark Backman
c9a93f2504
Merge pull request #1469 from pipecat-ai/mb/update-gladia
...
Refactor GladiaSTTService to support addition params
2025-03-31 11:18:32 -04:00
Adithya Suresh
e8783f6a33
Handle cache token counts being none
2025-03-31 15:25:11 +11:00
Mark Backman
8a12470efd
Reorganize into a directory
2025-03-30 20:01:40 -04:00
Mark Backman
05d53bc66f
Refactor GladiaSTTService; add support for additional params
2025-03-30 19:54:55 -04:00
Aleix Conchillo Flaqué
e763cd7bee
Merge pull request #1471 from pipecat-ai/aleix/services-restructure
...
services: restructure services into folders
2025-03-30 16:23:26 -07:00
Aleix Conchillo Flaqué
94ec5118e6
track already reported deprecated modules (mark's update)
2025-03-30 16:21:00 -07:00
Aleix Conchillo Flaqué
7203ef6885
examples: use new services packages
2025-03-30 16:21:00 -07:00
Aleix Conchillo Flaqué
3074a62bb1
services: restructure services into folders
2025-03-30 16:21:00 -07:00
Mark Backman
31712b84ac
Merge pull request #1479 from pipecat-ai/mb/qwen-pyproject-entry
2025-03-29 22:36:40 -04:00
Mark Backman
c99ec0b0b7
Add placeholder entry for qwen to pyproject.toml
2025-03-29 20:20:48 -04:00
Mark Backman
cd7abd2962
Merge pull request #1478 from pipecat-ai/mb/alibaba-cloud-offerings
...
Add QwenLLMService
2025-03-29 20:13:21 -04:00
Mark Backman
c7544954cf
Merge pull request #1476 from pipecat-ai/mb/ref-docs-mem0-mlx-whisper
...
Update reference docs generation for mem0 and mlx-whisper
2025-03-29 20:12:58 -04:00
Mark Backman
4f390b15a3
Merge pull request #1477 from pipecat-ai/mb/fix-mem0-example-number
...
Renumber mem0 example, small changelog updates
2025-03-29 20:04:45 -04:00
Mark Backman
f2a05b065d
Add QwenLLMService
2025-03-29 19:43:37 -04:00
Mark Backman
5d5041eb2b
Renumber mem0 example, small changelog updates
2025-03-29 18:45:39 -04:00
Mark Backman
f4dc66cb13
Update reference docs generation for mem0 and mlx-whisper
2025-03-29 18:42:08 -04:00
Mark Backman
b88744b18d
Merge pull request #1475 from pipecat-ai/khk/whisper-mlx-example
...
Example and CHANGELOG for WhisperSTTServiceMLX service
2025-03-29 18:09:17 -04:00
Kwindla Hultman Kramer
209de2638d
WhisperSTTServiceMLX example and CHANGELOG
2025-03-29 18:04:07 -04:00
Mark Backman
5d829fb6a9
Merge pull request #1474 from pipecat-ai/khk/mem0-changelog
...
Changelog entry for mem0 service
2025-03-29 18:02:32 -04:00
Mark Backman
a978a5cd4a
Fix Whisper formatting
2025-03-29 17:57:50 -04:00
Mark Backman
b9ea3f0fd9
Update README, organize pyproject.toml
2025-03-29 17:56:17 -04:00
Kwindla Hultman Kramer
d2f5ee2915
Changelog entry for mem0 service
2025-03-29 17:55:26 -04:00
Mark Backman
acddddc508
Merge pull request #1472 from pipecat-ai/mb/small-webrtc-readme
...
Add README link for SmallWebRTCTransport
2025-03-29 17:38:15 -04:00
Kwindla Hultman Kramer
0c2c6fa771
Merge pull request #1383 from zboyles/add-mlx-whisper
...
Added Support for MLX Whisper models on Apple M-Series
2025-03-29 14:25:37 -07:00
Mark Backman
80088c6138
Merge pull request #1473 from pipecat-ai/mb/ref-docs-updates
...
Update packages for auto-generating docs
2025-03-29 17:20:46 -04:00
Kwindla Hultman Kramer
766639a9a4
Merge pull request #1388 from deshraj/user/dyadav/mem0-integration
...
Added mem0 service.
2025-03-29 13:12:58 -07:00
Mark Backman
675e2b1498
Update packages for auto-generating docs
2025-03-29 08:21:58 -04:00
Mark Backman
af6c23f7b1
Add README link for SmallWebRTCTransport
2025-03-28 21:29:24 -04:00
Aleix Conchillo Flaqué
d212e88030
Merge pull request #1468 from pipecat-ai/aleix/smallwebrtc-updates
...
transports(webrtc): some SmallWebRTC updates
2025-03-28 14:41:45 -07:00
Aleix Conchillo Flaqué
d6758bf2ad
transports(webrtc): rename appMessage to app-message
2025-03-28 14:35:11 -07:00
Filipi Fuchter
5abfb15300
Registering the event handlers and fixing the examples.
2025-03-28 17:30:06 -03:00
Aleix Conchillo Flaqué
f576254d61
transports(webrtc): some SmallWebRTC updates
2025-03-28 13:19:23 -07:00
Aleix Conchillo Flaqué
a90807a3d2
Merge pull request #1465 from roey-priel/main
...
Tavus / Deepgram TTS compatibility
2025-03-28 08:43:09 -07:00
roey
a06fc4ce50
yield outside of the loop
2025-03-28 08:41:36 -07:00
roey
80cb4497f0
Merge pull request #1 from roey-priel/deepgram-tts-tavus-compatibility
...
Update deepgram.py
2025-03-27 17:06:33 -07:00
roey
8aa878c5e9
Update deepgram.py
2025-03-27 17:05:29 -07:00
Filipi da Silva Fuchter
e982b3d919
Merge pull request #1290 from pipecat-ai/aiortc_example
...
P2P WebRTC transport option to Pipecat
2025-03-27 18:29:44 -03:00
Filipi Fuchter
8945fd1fc6
Starting the server by default as localhost.
2025-03-27 18:27:56 -03:00
Filipi Fuchter
16b97d151b
Adding the SmallWebRTCTransport to the changelog.
2025-03-27 17:56:12 -03:00
Filipi Fuchter
f7ac142ad2
Merge branch 'main' into aiortc_example
2025-03-27 17:50:46 -03:00
Filipi da Silva Fuchter
2355067f61
Merge pull request #1441 from pipecat-ai/aiortc_example_small_webrtc_transport
...
P2P WebRTC transport - example improvements.
2025-03-27 17:49:12 -03:00
Filipi Fuchter
76f9626d35
Using the @pipecat-ai/small-webrtc-transport from npm.
2025-03-27 17:48:32 -03:00
Filipi da Silva Fuchter
f82c2566e8
Merge pull request #1270 from pipecat-ai/improve_protobuf_serializer
...
Added support to `ProtobufFrameSerializer` to send the transport messages
2025-03-27 17:28:37 -03:00
Filipi Fuchter
b6007bb3d6
Added support to ProtobufFrameSerializer to send the transport messages
2025-03-27 17:26:03 -03:00
Filipi Fuchter
311a5360ad
Renaming the example to p2p-webrtc
2025-03-27 16:46:00 -03:00
Filipi Fuchter
62cb0376f2
Changing the file types.
2025-03-27 16:34:40 -03:00
Filipi Fuchter
91a69b7029
Improving the readmes for the webrtc examples.
2025-03-27 16:32:46 -03:00
Mark Backman
1d4d7f28a1
Merge pull request #1463 from pipecat-ai/mb/add-piper-readme
...
Add Piper to README
2025-03-27 08:52:31 -04:00
Mark Backman
a55a7bbb96
Add Piper to README
2025-03-27 08:03:16 -04:00
Mark Backman
a394b35e85
Merge pull request #1459 from pipecat-ai/mb/issue-1454
...
Fix: GoogleTTSService was emitting two TTSStoppedFrames
2025-03-27 08:00:16 -04:00
Mark Backman
aa85df4fd6
Fix: GoogleTTSService was emitting two TTSStoppedFrames
2025-03-27 07:55:19 -04:00
Filipi da Silva Fuchter
3bb1f5f7a8
Merge pull request #1130 from pedro-a-n-moreira/piper-tts
...
Add support for Piper TTS
2025-03-27 08:08:05 -03:00
Filipi Fuchter
7c115f9d59
Merge branch 'main' into piper-tts
...
# Conflicts:
# CHANGELOG.md
2025-03-27 08:01:38 -03:00
Filipi Fuchter
a82b847971
Fixing ruff format.
2025-03-27 07:58:53 -03:00
Filipi Fuchter
50515aa842
Adding PiperTTSService to the changelog.
2025-03-27 07:50:47 -03:00
Filipi Fuchter
b348fde32b
Refactoring PiperTTSService to match the others TTS services provided by Pipecat and fixing noise issue due to wav header.
2025-03-27 07:46:38 -03:00
Filipi Fuchter
45787520b2
Refactoring the piper test to use run_test provided by Pipecat
2025-03-27 07:45:28 -03:00
Filipi Fuchter
053bf72da2
Adding pytest-aiohttp to the dev requirements.
2025-03-27 07:44:46 -03:00
Filipi Fuchter
ca4893397a
Creating a foundational example which uses the piper service.
2025-03-27 07:44:26 -03:00
Filipi Fuchter
c1f6a4e079
Adding PIPER_BASE_URL to the env template.
2025-03-27 07:44:05 -03:00
Aleix Conchillo Flaqué
135ed811f1
Merge pull request #1460 from pipecat-ai/aleix/segmented-tts-ignore-emulated-frames
...
segmented tts ignore emulated frames
2025-03-26 16:03:59 -07:00
Aleix Conchillo Flaqué
055a3f1c53
LLMAssistantContextAggregator: stop emulations if the user starts speaking
2025-03-26 14:39:12 -07:00
Aleix Conchillo Flaqué
750bb88586
SegmentedSTTService: ignore emulated frames
2025-03-26 14:38:48 -07:00
Aleix Conchillo Flaqué
c4f9171fe1
frames: indicate if UserStartedSpeakingFrame/UserStoppedSpeakingFrame are emulated
2025-03-26 14:37:36 -07:00
Filipi Fuchter
d223201c3f
Merge branch 'main' into piper-tts
...
# Conflicts:
# test-requirements.txt
2025-03-26 16:47:45 -03:00
Mark Backman
86701fd3c7
Merge pull request #1457 from pipecat-ai/mb/fix-rtvi-observer-gemini
...
Fix: Resolve an issue where Google LLM context messages were causing …
2025-03-26 14:18:37 -04:00
Mark Backman
b414077a07
Fix: Resolve an issue where Google LLM context messages were causing a TypeError
2025-03-26 13:55:42 -04:00
kompfner
15f23929e9
Merge pull request #1455 from pipecat-ai/prepare-0.0.61
...
Update CHANGELOG for 0.0.61
2025-03-26 13:50:29 -04:00
Mark Backman
cc9e4047d0
Merge pull request #1447 from nicougou/feat/support_tts_instruct
...
feature/support instructions in OpenAITTSService
2025-03-26 13:35:41 -04:00
Paul Kompfner
4ef4dcefce
Update CHANGELOG for 0.0.61
2025-03-26 13:06:31 -04:00
kompfner
f3caa8cf7a
Merge pull request #1452 from pipecat-ai/daily-python-0.16.1
...
Bump daily-python dependency to 0.16.1 to pick up a bugfix
2025-03-26 13:01:38 -04:00
Mark Backman
e5470fec7a
Merge pull request #1453 from pipecat-ai/khk/groq
...
New GroqTTSService
2025-03-26 12:49:18 -04:00
Mark Backman
887c197bce
Add sample_rate to the constructor
2025-03-26 12:29:40 -04:00
Kwindla Hultman Kramer
f5d49fea81
try/catch import of groq SDK
2025-03-26 12:29:40 -04:00
Kwindla Hultman Kramer
e087f6ec5d
GroqTTSService added to CHANGELOG.md
2025-03-26 12:29:39 -04:00
Kwindla Hultman Kramer
406f5a395b
fix class heirarchy and audio chunking
2025-03-26 12:29:18 -04:00
Kwindla Hultman Kramer
060bb4c26b
wip
2025-03-26 12:29:18 -04:00
Nico
499e69846d
review: add changelog entries
2025-03-26 17:13:30 +01:00
Paul Kompfner
e6e339a02e
Bump daily-python dependency to 0.16.1 to pick up a bugfix
2025-03-26 11:22:23 -04:00
Nico
dc2ee2bf0a
review: remove websocket_base_url
2025-03-26 15:41:42 +01:00
Nico
d982fc35d8
fix: formatter
2025-03-26 15:41:42 +01:00
Nico
72d373e565
feature/support instructions in OpenAITTSService
2025-03-26 15:41:42 +01:00
Aleix Conchillo Flaqué
59fdfe697d
Merge pull request #1449 from pipecat-ai/aleix/google-assistant-aggregator-function-call-result
...
GoogleAssistantContextAggregator: allow any value as function call result
2025-03-26 07:25:34 -07:00
Filipi da Silva Fuchter
97c9e0676e
Merge pull request #1451 from pipecat-ai/set-tool-choice-from-context-aggregator
...
Set tool choice from context aggregator
2025-03-26 09:12:26 -03:00
Filipi Fuchter
aeac40312e
Added the feature to change dynamically the tool choice to the changelog.
2025-03-26 09:06:29 -03:00
Filipi Fuchter
ce9f75a851
Fixing the tool choice extra type to be a dict instead of string.
2025-03-26 08:17:50 -03:00
Filipi Fuchter
c45d852f6b
Merge branch 'main' into set-tool-choice-from-context-aggregator
...
# Conflicts:
# src/pipecat/processors/aggregators/llm_response.py
2025-03-26 07:14:57 -03:00
Deshraj Yadav
55cc1fe9f6
Fix import lines
2025-03-25 23:35:47 -07:00
Deshraj Yadav
1ba7e2d6fa
Format imports properly
2025-03-25 23:30:01 -07:00
Deshraj Yadav
1b8d326b49
Run ruff
2025-03-25 23:15:35 -07:00
Aleix Conchillo Flaqué
077952b658
GoogleAssistantContextAggregator: allow any value as function call result
2025-03-25 19:11:27 -07:00
Deshraj Yadav
e694971423
Merge pull request #2 from pipecat-ai/khk/mem0
...
small changes to make 35-mem0.py
2025-03-25 18:10:36 -07:00
Kwindla Hultman Kramer
d00ae492e5
small changes to make 35-mem0.py like the other foundational single-file examples.
2025-03-25 15:51:38 -07:00
Aleix Conchillo Flaqué
9450b07ec5
Merge pull request #1442 from pipecat-ai/aleix/on-context-updated-as-task
...
LLMAssistantContextAggregator: create a task to run on_context_updated
2025-03-25 15:39:36 -07:00
Aleix Conchillo Flaqué
19b464ba23
tests: add assistant aggregator function call frame handling
2025-03-25 15:37:06 -07:00
Aleix Conchillo Flaqué
8aebf00c2d
GoogleAssistantContextAggregator: function call result should be a JSON object
2025-03-25 15:37:06 -07:00
Aleix Conchillo Flaqué
01458895c2
LLMAssistantContextAggregator: create a task to run on_context_updated
2025-03-25 14:37:11 -07:00
kompfner
2082d023ef
Merge pull request #1448 from pipecat-ai/daily-python-0.16.0
...
Bump daily-python dependency to 0.16.0 to pick up support in `DailyTr…
2025-03-25 17:32:38 -04:00
Paul Kompfner
c99436b80e
Bump daily-python dependency to 0.16.0 to pick up support in DailyTransport for updating remote participants' canReceive permission via the update_remote_participants() method
2025-03-25 17:29:48 -04:00
Filipi Fuchter
f884c93826
Refactoring the video-transform example to use pipecat client.
2025-03-25 17:32:25 -03:00
Deshraj Yadav
2780c6eed6
Incorporate suggestions
2025-03-25 10:45:08 -07:00
Deshraj Yadav
7ad36eeaf4
Add mem0 as a service integration
2025-03-25 10:44:12 -07:00
Filipi Fuchter
67a93d09c2
Merge branch 'main' into aiortc_example
2025-03-25 10:31:53 -03:00
Aleix Conchillo Flaqué
f3b50bc3c4
Revert "LLMAssistantContextAggregator: create a task to run on_context_updated"
...
This reverts commit 397bae29f7 .
2025-03-24 15:40:26 -07:00
Aleix Conchillo Flaqué
397bae29f7
LLMAssistantContextAggregator: create a task to run on_context_updated
2025-03-24 15:39:35 -07:00
Mark Backman
3b3fdd0da1
Merge pull request #1439 from pipecat-ai/mb/fix-rtvi-bot-speaking-events
...
Fix: RTVIObserver now outputs a single bot started and stopped speaki…
2025-03-24 11:44:31 -04:00
Mark Backman
a9b1298f3b
Fix: RTVIObserver now outputs a single bot started and stopped speaking event per turn
2025-03-24 10:25:31 -04:00
Filipi Fuchter
2fcf4e6d70
Fixing ruff format
2025-03-24 11:23:55 -03:00
Filipi Fuchter
fcb8b9a5b3
Refactoring how we are creating the answer so we don't need to wait for the client gathering all ice candidates.
2025-03-24 11:12:41 -03:00
Filipi Fuchter
fee0409f63
Logging if the remote peer supports trickle ice.
2025-03-24 08:59:21 -03:00
Filipi Fuchter
3be6973e2c
Adding support to define ice servers.
2025-03-24 08:57:24 -03:00
Filipi Fuchter
5184d178ef
Merge branch 'main' into aiortc_example
2025-03-24 08:37:08 -03:00
Thomas B.
48e8d3968a
fix: recognition language correctly set for Azure STT ( #1436 )
2025-03-23 19:29:52 -07:00
Aleix Conchillo Flaqué
59644a939a
Merge pull request #1434 from pipecat-ai/aleix/examples-07-interruptible-local
...
examples: add foundational 07x-interruptible-local.py
2025-03-23 05:44:40 -07:00
Aleix Conchillo Flaqué
3311afc581
examples: add foundational 07x-interruptible-local.py
2025-03-22 21:58:55 -07:00
Filipi da Silva Fuchter
a3ccbf91f7
Merge pull request #1429 from pipecat-ai/fixing_set_tool_issue
...
Only checking the length if tools is a list.
2025-03-21 13:56:45 -03:00
Filipi Fuchter
3ed764a769
Only checking the length if tools is a list.
2025-03-21 12:56:05 -03:00
Mark Backman
be8d5a31f5
Merge pull request #1425 from Allenmylath/patch-25
...
Update env.example
2025-03-21 08:39:03 -04:00
Mark Backman
480bcc1ab1
Merge pull request #1424 from Allenmylath/patch-24
...
Update requirements.txt
2025-03-21 08:38:54 -04:00
allenmylath
dd81048ddb
Update env.example
...
EXAMPLE USES CARTESI NOT ELEVNE LABS
2025-03-21 10:11:28 +05:30
allenmylath
04d462ff02
Update requirements.txt
...
example uses cartesia not elevenlabs
2025-03-21 10:09:09 +05:30
Aleix Conchillo Flaqué
7e7aaeddd9
Merge pull request #1423 from pipecat-ai/aleix/elevenlabs-pcm-8000
...
ElevenLabs: add support for a sample rate of 8000
2025-03-20 19:34:16 -07:00
Aleix Conchillo Flaqué
e77f7c8456
update ruff and pyright versions
2025-03-20 19:19:08 -07:00
Aleix Conchillo Flaqué
442f18d47b
ultravox: fix formatting
2025-03-20 19:19:08 -07:00
Aleix Conchillo Flaqué
fc78e6fc5a
ElevenLabs: add support for a sample rate of 8000
2025-03-20 19:13:23 -07:00
Aleix Conchillo Flaqué
d71b520153
update CHANGELOG.md and fix formatting
2025-03-20 18:58:06 -07:00
milo157
3b4d91e1c1
Fixed ultravox service bugs ( #1420 )
2025-03-20 18:55:43 -07:00
Aleix Conchillo Flaqué
09c62d939a
Merge pull request #1422 from pipecat-ai/aleix/pipecat-0.0.60
...
update CHANGELOG for 0.0.60
2025-03-20 16:25:52 -07:00
Aleix Conchillo Flaqué
f2b9789acf
update CHANGELOG for 0.0.60
2025-03-20 16:17:34 -07:00
Aleix Conchillo Flaqué
1592703e77
Merge pull request #1421 from pipecat-ai/aleix/rollback-deepgram-to-3.8.0
...
pyproject: rollback deepgram-sdk to 3.8.0
2025-03-20 16:16:08 -07:00
Aleix Conchillo Flaqué
66e42ae410
pyproject: rollback deepgram-sdk to 3.8.0
2025-03-20 16:15:43 -07:00
Mark Backman
8d6dbbe293
Merge pull request #1417 from pipecat-ai/mb/update-realtime-transcription
...
Update InputAudioTranscription to use gpt-4o-transcribe model, update…
2025-03-20 18:49:06 -04:00
Mark Backman
2ac8f2ec2d
Fix linting
2025-03-20 18:40:16 -04:00
Paul Kompfner
41688205be
Provide new settings in OpenAI Realtime example
2025-03-20 18:23:25 -04:00
Mark Backman
541a4b6063
Update InputAudioTranscription to use gpt-4o-transcribe model, update 19 examples to use FunctionSchema
2025-03-20 18:23:24 -04:00
Aleix Conchillo Flaqué
8f6d92ce7d
update CHANGELOG with BaseOpenAILLMService default_headers
2025-03-20 13:47:15 -07:00
Aleix Conchillo Flaqué
96fa6c19a8
Merge pull request #1398 from nicougou/feature/openai_custom_headers
...
feature: add custom headers to AsyncOpenAI
2025-03-20 13:45:57 -07:00
Varun Singh
c9f7882728
initial commit
2025-03-20 12:31:08 -07:00
Aleix Conchillo Flaqué
0fdd577ae7
Merge pull request #1416 from pipecat-ai/aleix/pipecat-0.0.59
...
update CHANGELOG for 0.0.59
2025-03-20 11:48:14 -07:00
Aleix Conchillo Flaqué
2133152e5b
update CHANGELOG for 0.0.59
2025-03-20 11:42:54 -07:00
Aleix Conchillo Flaqué
c3f3f4603d
Merge pull request #1413 from pipecat-ai/aleix/llm-user-aggregator-emulate-fixes
...
LLMUserContextAggregator: fix emulated user started/stopped speaking issues
2025-03-20 11:41:26 -07:00
Aleix Conchillo Flaqué
b20ce7d655
examples: move 07u-interruptible-neuphonic to 07v
2025-03-20 11:38:29 -07:00
Aleix Conchillo Flaqué
66ba1116a4
pyproject: rollback azure to 1.42.0
2025-03-20 11:23:40 -07:00
Aleix Conchillo Flaqué
08956e914a
livekit: remove unnecessary transport cleanup() function
2025-03-20 11:23:40 -07:00
Aleix Conchillo Flaqué
5a39f146f6
LLMUserContextAggregator: fix emulated user started/stopped speaking issues
2025-03-20 11:23:40 -07:00
kompfner
de8a831ee1
Merge pull request #1414 from pipecat-ai/march-main
...
March OpenAI updates
2025-03-20 14:22:09 -04:00
Aleix Conchillo Flaqué
efa5f133d7
openai_realtime: fix and update function calling
2025-03-20 11:14:59 -07:00
Paul Kompfner
44380bc8c0
Remove duplicate changelog entry due to rebase mistake
2025-03-20 13:51:16 -04:00
Paul Kompfner
721ee75887
Comment tweak
2025-03-20 13:43:00 -04:00
Paul Kompfner
ada68f0699
More robust handling of conversation item retrieval errors in OpenAIRealtimeBetaLLMService
2025-03-20 13:43:00 -04:00
Mark Backman
70dbf0d6fc
Updated default models for OpenAISTTService and OpenAITTSService to gpt-4o based models
2025-03-20 13:42:56 -04:00
Paul Kompfner
f0774268cc
Rename gpt-4o-transcribe-latest to gpt-4o-transcribe in OpenAIRealtimeBetaLLMService
2025-03-20 13:39:40 -04:00
Chad Bailey
2ae5bdd8a9
lets talk about dogs
2025-03-20 13:39:40 -04:00
Chad Bailey
0d74bcacb7
updated models in the 07g example
2025-03-20 13:39:40 -04:00
Paul Kompfner
f94a099111
Revert the default model to be "gpt-4o-realtime-preview-2024-12-17" In OpenAIRealtimeBetaLLMService
2025-03-20 13:39:36 -04:00
Paul Kompfner
3dd4ef7230
Tweak changelog entries describing slate of recent updates to OpenAIRealtimeBetaLLMService
2025-03-20 13:36:22 -04:00
Paul Kompfner
e707efbffa
Update changelog with slate of recent updates to OpenAIRealtimeBetaLLMService
2025-03-20 13:35:12 -04:00
Paul Kompfner
7b594093dd
Handle the possibility of multiple concurrent calls to retrieve_conversation_item() in the OpenAIRealtimeBetaLLMService
2025-03-20 13:31:28 -04:00
Paul Kompfner
31317ce77d
Add error handling to the retrieve_conversation_item() method of the OpenAIRealtimeBetaLLMService
2025-03-20 13:31:28 -04:00
Paul Kompfner
f693a3c70f
Add retrieve_conversation_item() method to OpenAIRealtimeBetaLLMService, using the new conversation.item.retrieve introspection message.
2025-03-20 13:31:28 -04:00
Paul Kompfner
39ca607bbb
Add on_conversation_item_created and on_conversation_item_updated events to OpenAIRealtimeBetaLLMService.
...
The hope is that this will expose to the user conversation item ids at relevant times for them to use with the new `conversation.item.retrieve` introspection message.
2025-03-20 13:31:28 -04:00
Paul Kompfner
9840abd85b
Make it so you specifying model=None when creating a InputAudioTranscription results in a validation error
2025-03-20 13:31:28 -04:00
Paul Kompfner
1075c25055
Add new semantic turn detection option to OpenAIRealtimeBetaLLMService
2025-03-20 13:31:28 -04:00
Paul Kompfner
e91610c69e
linter fix
2025-03-20 13:31:28 -04:00
Paul Kompfner
1a20d9bed7
Add new input_audio_noise_reduction option to OpenAIRealtimeBetaLLMService
2025-03-20 13:31:28 -04:00
Paul Kompfner
d009b80438
Add new GPT-4o transcription option to OpenAIRealtimeBetaLLMService
2025-03-20 13:31:28 -04:00
kompfner
fe5fc30211
Revert "Add new GPT-4o transcription option to OpenAIRealtimeBetaLLMService"
2025-03-20 13:31:28 -04:00
Paul Kompfner
be2cf6d556
formatting fix
2025-03-20 13:31:28 -04:00
Paul Kompfner
e80bfe22de
Add new GPT-4o transcription option to OpenAIRealtimeBetaLLMService
2025-03-20 13:31:28 -04:00
Paul Kompfner
214c8f79eb
linter fix
2025-03-20 13:31:28 -04:00
Paul Kompfner
16accafa6d
formatting fix
2025-03-20 13:31:28 -04:00
Kwindla Hultman Kramer
4449e9a25b
add response.done status=failed error
2025-03-20 13:31:28 -04:00
Kwindla Hultman Kramer
bfdf52bd69
change examples/foundational/19-openai-realtime-beta.py to use the new preview model
2025-03-20 13:31:28 -04:00
Kwindla Hultman Kramer
2b4debec11
add support for conversation.item.input_audio_transcription.delta
2025-03-20 13:31:28 -04:00
Mark Backman
f4626287cd
Merge pull request #1411 from pipecat-ai/mb/add-fal-wizper
...
Add FalSTTService
2025-03-20 13:08:08 -04:00
Mark Backman
e4bb4aacb4
Example: Rename 07 ultravox example
2025-03-20 12:46:00 -04:00
Mark Backman
f298febacf
Add FalSTTService
2025-03-20 12:45:16 -04:00
Aleix Conchillo Flaqué
c51291190b
Merge pull request #1394 from pipecat-ai/aleix/function-calls-as-tasks
...
function calls as tasks
2025-03-20 09:34:37 -07:00
Aleix Conchillo Flaqué
e0c3f6ad83
services: mark function calls as completed even the result is None
2025-03-20 08:51:25 -07:00
Aleix Conchillo Flaqué
b1d506c137
GoogleAssistantContextAggregator: properly update function response
2025-03-20 08:51:25 -07:00
Aleix Conchillo Flaqué
1f6ed01ba6
LLMAssistantContextAggregator: remove tool call id with image requests
2025-03-20 08:51:25 -07:00
Aleix Conchillo Flaqué
3e9678db84
user image requests can now be related to function calls
2025-03-20 08:51:25 -07:00
Aleix Conchillo Flaqué
d455fd070e
update CHANGELOG
2025-03-20 08:51:25 -07:00
Aleix Conchillo Flaqué
d1550d5a85
tests: remove TestFrameProcessor, reimplement with run_test()
2025-03-20 08:51:25 -07:00
Aleix Conchillo Flaqué
c15286b148
examples: deprecate start_callback from LLMService.register_function()
2025-03-20 08:51:25 -07:00
Aleix Conchillo Flaqué
a98000fd1d
function calling now run in tasks
2025-03-20 08:51:25 -07:00
Aleix Conchillo Flaqué
fc06306efd
Merge pull request #1406 from pipecat-ai/aleix/pipeline-task-idle-timeouts
...
PipelineTask: automatically cancel tasks if pipeline is idle
2025-03-20 08:37:39 -07:00
Mark Backman
039fa59165
Merge pull request #1409 from pipecat-ai/aleix/segmented-stt-service-vad-events
...
SegmentedSTTService: use VAD events to detect valid audio
2025-03-20 09:11:08 -04:00
Aleix Conchillo Flaqué
0e14cec139
pyproject: update multiple libraries
2025-03-20 01:22:33 -07:00
Aleix Conchillo Flaqué
2417ec4f92
LLMUserContextAggregator: increase bot_interruption_timeout to 5 seconds
2025-03-20 01:20:34 -07:00
Aleix Conchillo Flaqué
7cdcd1c3d1
OpenAITTSService: allow specifying any model name
2025-03-20 01:20:34 -07:00
Aleix Conchillo Flaqué
b6be25ab84
SegmentedSTTService: use VAD events to detect valid audio
2025-03-20 00:31:49 -07:00
Aleix Conchillo Flaqué
e18d9f6a11
PipelineTask: automatically cancel tasks if pipeline is idle
2025-03-19 23:30:46 -07:00
Mark Backman
3a73346a41
Merge pull request #1408 from pipecat-ai/mb/claude-models-example
...
Update to Claude 3.7 Sonnet latest in examples
2025-03-20 01:44:59 -04:00
Aleix Conchillo Flaqué
8d58d1c8bb
Merge pull request #1404 from pipecat-ai/aleix/gemini-push-frame-fixes
...
GeminiMultimodalLiveLLMService: fix duplicated messages in context
2025-03-19 21:51:39 -07:00
Mark Backman
07a77e066f
Update to Claude 3.7 Sonnet latest in examples
2025-03-19 23:18:30 -04:00
Aleix Conchillo Flaqué
3024896d3d
Merge pull request #1405 from pipecat-ai/aleix/tts-services-fallback
...
WebsocketTTSService: add `on_connection_error` and `reconnect_on_error`
2025-03-19 19:39:51 -07:00
Aleix Conchillo Flaqué
a3b5e4413a
WebsocketTTSService: add on_connection_error and reconnect_on_error
2025-03-19 19:38:08 -07:00
Aleix Conchillo Flaqué
f31e77c4f6
pyproject: added empty tavus dependencies
2025-03-19 18:43:07 -07:00
Aleix Conchillo Flaqué
8942c2e053
GeminiMultimodalLiveLLMService: fix duplicated messages in context
...
Fixes #1384
2025-03-19 15:33:54 -07:00
Aleix Conchillo Flaqué
afb26be0ad
Merge pull request #1396 from pipecat-ai/aleix/stt-service-audio-passthrough
...
SegmentedSTTService: allow audio to pass-through downstream
2025-03-19 11:16:40 -07:00
Aleix Conchillo Flaqué
48d73a2636
SegmentedSTTService: allow audio to pass-through downstream
2025-03-19 11:06:12 -07:00
Aleix Conchillo Flaqué
da531dabfd
Merge pull request #1304 from pipecat-ai/aleix/handle-emails-user-email-gathering
...
add skip tags aggregator to support TTS service spelling out tags
2025-03-19 11:05:10 -07:00
Aleix Conchillo Flaqué
336e2f1579
TTSServices: for now just specify a single text aggregator
2025-03-19 11:02:29 -07:00
Aleix Conchillo Flaqué
fc0f404d26
examples: add new 36-user-email-gathering.py
2025-03-19 10:57:29 -07:00
Aleix Conchillo Flaqué
54620133d4
services: add spelling out support to CartesiaTTSService and RimeTTSService
2025-03-19 10:57:29 -07:00
Aleix Conchillo Flaqué
e7224473f2
utils(text): add new SkipTagsAggregator
2025-03-19 10:57:29 -07:00
Aleix Conchillo Flaqué
1a3a268c9d
utils(string): add new function parse_start_end_tags()
2025-03-19 10:57:29 -07:00
Aleix Conchillo Flaqué
11984b89b7
utils(string): add support for floating point numbers
2025-03-19 10:57:29 -07:00
Aleix Conchillo Flaqué
1dbad2326a
utils(string): support email addresses in end of sentence matching
2025-03-19 10:57:27 -07:00
Mark Backman
2e0c6c2bd1
Merge pull request #1397 from pipecat-ai/mb/disconnect-bot
...
Fix: RTVI message disconnect-bot now pushes EndTaskFrame
2025-03-19 10:45:24 -04:00
Nico
5f28834588
feature: add custom headers to AsyncOpenAI
2025-03-19 14:49:51 +01:00
Mark Backman
7f1ccab445
Fix: RTVI message disconnect-bot now pushes EndTaskFrame
2025-03-19 07:07:45 -04:00
Aleix Conchillo Flaqué
7ddac4eb88
Merge pull request #1395 from pipecat-ai/aleix/multiple-text-filters-and-aggregators
...
TTSService: allow passing multiple text filters and aggregators
2025-03-18 21:25:29 -07:00
Aleix Conchillo Flaqué
514ecda755
TTSService: allow passing multiple text filters and aggregators
2025-03-18 17:31:01 -07:00
balalo
48b6850df4
allow other function names
2025-03-18 20:45:31 +01:00
Aleix Conchillo Flaqué
71a38a120e
Merge pull request #1376 from pipecat-ai/aleix/event-handlers-as-tasks
...
event handlers are now executed in separate tasks
2025-03-18 12:10:34 -07:00
Mark Backman
79616de7a4
Merge pull request #1392 from pipecat-ai/mb/fix-google-stt-timeout
...
Fix an issue where GoogleSTTService would timeout due to stream inact…
2025-03-18 14:17:44 -04:00
Mark Backman
6368fbe0dd
Merge pull request #1318 from Vaibhav159/vl_google_vertex_llm
...
adding vertex google llm
2025-03-18 14:17:21 -04:00
Mark Backman
5dc8b48fbe
Fix an issue where GoogleSTTService would timeout due to stream inactivity
2025-03-18 14:06:32 -04:00
Aleix Conchillo Flaqué
9112ff114f
Merge pull request #1359 from lucasrothman/tavus-output-sample-rate
...
Tavus support for custom output rate
2025-03-18 10:16:34 -07:00
Aleix Conchillo Flaqué
32609b1132
event handlers are now executed in separate tasks
2025-03-18 09:25:39 -07:00
Vaibhav159
4303ed4991
rename service
2025-03-18 20:58:21 +05:30
Mark Backman
4677c34663
Merge pull request #1387 from pipecat-ai/mb/pattern-aggregator
...
Add PatternPairAggregator
2025-03-18 08:46:42 -04:00
Mark Backman
b28276446d
Code review feedback
2025-03-18 07:49:54 -04:00
Mark Backman
2dee882710
Add unit tests
2025-03-18 07:30:37 -04:00
Mark Backman
6ec4052f29
Add CHANGELOG entries
2025-03-18 07:30:36 -04:00
Mark Backman
ddcc1fbb2f
Add foundational example 35
2025-03-18 07:30:11 -04:00
Mark Backman
e731a0d41f
Add PairPatternAggregator
2025-03-18 07:30:11 -04:00
Mark Backman
4918eab4e8
Merge pull request #1371 from pipecat-ai/mb/openai-realtime-transcription
...
Add TranscriptProcessor support for OpenAIRealtimeBetaLLMService
2025-03-18 07:28:07 -04:00
Mark Backman
11987765d8
Merge pull request #1381 from pipecat-ai/mb/recording-example-stt
...
Update the 34-audio-recording.py example to include an STT processor
2025-03-18 07:20:42 -04:00
Mark Backman
6f09ee25b8
Merge pull request #1385 from pipecat-ai/mb/add-neuphonic-readme
...
Add Google Imagen and Neuphonic TTS to README
2025-03-18 07:20:15 -04:00
Mark Backman
83dda8a759
Merge pull request #1390 from adnansiddiquei/add-neuphonic-languages
...
Added 5 new languages for Neuphonic: FR, PT, RU, ZH, HI.
2025-03-18 07:18:27 -04:00
Adnan Siddiquei
188677e601
Added 4 new languages: FR, PT, RU, ZH, HI.
2025-03-18 10:35:22 +00:00
balalo
dc5067407d
Fix ruff check
2025-03-18 11:12:51 +01:00
balalo
1c19777d5e
Fix format
2025-03-18 11:09:40 +01:00
balalo
2e1a18503b
Set tool choice from context aggregator
2025-03-18 10:41:43 +01:00
Lucas Rothman
c57fa93a70
Renamed to sample_rate
2025-03-17 16:22:36 -07:00
Mark Backman
6885d07e88
Simplify the TranscriptProcessor _emit_aggregated_text logic
2025-03-17 16:36:03 -04:00
Mark Backman
acd0660f66
Update GeminiMultimodalLiveLLMService to work with the TranscriptProcessor
2025-03-17 16:36:03 -04:00
Mark Backman
3f002f8ffb
Remove unnecessary TranscriptProcessor examples
2025-03-17 16:36:02 -04:00
Mark Backman
d5776c27f4
Update 19-openai-realtime-beta
2025-03-17 16:35:35 -04:00
Mark Backman
6e6905405b
Update CHANGELOG
2025-03-17 16:35:35 -04:00
Mark Backman
571c10403f
tests: Add additional coverage to test_transcript_processor
2025-03-17 16:35:35 -04:00
Mark Backman
5b6b700214
OpenAIRealtimeBetaLLMService outputs a TTSTextFrame
2025-03-17 16:35:35 -04:00
Mark Backman
1ad8e28025
Update TranscriptProcessor to more robustly handle different TTSTextFrame outputs
2025-03-17 16:35:35 -04:00
Mark Backman
3458f1b6de
Add Google Imagen to README
2025-03-17 11:43:40 -04:00
Mark Backman
02dbef8f5a
Add Neuphonic TTS to README
2025-03-17 11:28:51 -04:00
Zac
1baa52a17e
Enhanced whisper.py with MLX Whisper model support and added optional mlx-whisper to pyproject.toml. Added error handling for missing modules and created a new WhisperSTTServiceMLX class for MLX Whisper integration.
2025-03-16 02:18:54 -04:00
Mark Backman
c1382b0691
Update the 34-audio-recording.py example to include an STT processor
2025-03-15 20:30:35 -04:00
Vaibhav159
5f000efc61
adding example
2025-03-15 10:36:26 +05:30
Vaibhav159
fa7da8f5f6
adding vertex llm
2025-03-15 10:21:40 +05:30
Mark Backman
8b86f6991d
Merge pull request #1343 from pipecat-ai/mb/pipecat-cloud-example
...
Add a Pipecat Cloud deployment example
2025-03-14 20:49:45 -04:00
Mark Backman
d3cd1a6c59
Update with latest starter
2025-03-14 20:40:33 -04:00
Mark Backman
24220f38f0
Add a Pipecat Cloud deployment example
2025-03-14 20:40:29 -04:00
Aleix Conchillo Flaqué
1f8752ab03
Merge pull request #1378 from pipecat-ai/aleix/remove-deprecations
...
removed most deprecations
2025-03-14 14:42:34 -07:00
Aleix Conchillo Flaqué
16d7df1c9f
removed most deprecations
2025-03-14 14:37:08 -07:00
Aleix Conchillo Flaqué
2474211291
Merge pull request #1379 from pipecat-ai/aleix/introduce-text-aggregators
...
introduce text aggregators
2025-03-14 13:03:49 -07:00
Aleix Conchillo Flaqué
b632d71465
TTSService: flush_audio() should be in the base class
2025-03-14 10:48:25 -07:00
Aleix Conchillo Flaqué
f8610a69a5
introduce text aggregators
2025-03-14 10:48:25 -07:00
Aleix Conchillo Flaqué
624a454f8b
Merge pull request #1366 from adnansiddiquei/neuphonic-tts-plugin
...
Add integration for Neuphonic TTS
2025-03-14 10:27:24 -07:00
Aleix Conchillo Flaqué
11ba08b7ba
Merge pull request #1377 from pipecat-ai/aleix/task-upstream-downstream-filters
...
PipelineTask: only call event handlers if a filter is matched
2025-03-14 08:49:24 -07:00
Adnan Siddiquei
11b13d053b
Fixed a bug from previous commit. Removed the concept of model from Neuphonic.
2025-03-14 11:17:22 +00:00
Adnan Siddiquei
7dec8431e1
Review comments by aconchillo.
2025-03-14 10:52:13 +00:00
Aleix Conchillo Flaqué
ce3f3b2edb
Merge pull request #1372 from pipecat-ai/khk-fix-multimodal-live-example
...
fix for 26-gemini-multimodal-live.py
2025-03-13 20:22:07 -07:00
Aleix Conchillo Flaqué
1b3b4ee04a
PipelineTask: only call event handlers if a filter is matched
2025-03-13 18:44:30 -07:00
Mark Backman
676c5d9ba7
Merge pull request #1374 from pipecat-ai/mb/add-riva-to-readme
2025-03-13 20:41:05 -04:00
Mark Backman
6eb3a8409f
README: Add Parakeet and FastPitch
2025-03-13 18:42:19 -04:00
Filipi Fuchter
526f9c2e06
Fixing the voice agent feedback when disconnected.
2025-03-13 18:41:40 -03:00
Kwindla Hultman Kramer
c9a31ea513
fix for 26-gemini-multimodal-live.py
2025-03-13 14:35:47 -07:00
Filipi Fuchter
2770d64a25
Fixing ruff format.
2025-03-13 17:38:11 -03:00
Filipi Fuchter
8a7e305619
Closing the old peer connection
2025-03-13 17:35:47 -03:00
Filipi Fuchter
8f2dadf5a0
Improving the reconnection logic to be able to recreate the peer connection in some cases.
2025-03-13 17:07:32 -03:00
Aleix Conchillo Flaqué
c0c7c5d600
Merge pull request #1370 from pipecat-ai/aleix/minor-ultravox-updates
...
services(ultravox): CHANGELOG, formatting and minor changes
2025-03-13 12:05:13 -07:00
Aleix Conchillo Flaqué
87004937be
services(ultravox): CHANGELOG, formatting and minor changes
2025-03-13 11:49:18 -07:00
Aleix Conchillo Flaqué
b426be3067
Merge pull request #1331 from CerebriumAI/feature/ultravox
...
Added ultravox service
2025-03-13 10:40:00 -07:00
Aleix Conchillo Flaqué
b71e2b97ff
Merge pull request #1368 from pipecat-ai/aleix/pipelinetask-frame-event-handlers
...
PipelineTask: add on_frame_reached_upstream and on_frame_reached_downstream
2025-03-13 10:31:33 -07:00
Aleix Conchillo Flaqué
25dcf7def6
PipelineTask: add on_frame_reached_upstream/on_frame_reached_downstream
2025-03-13 10:26:11 -07:00
Filipi Fuchter
30432639b4
Creating a keep alive connection
2025-03-13 14:20:25 -03:00
Adnan Siddiquei
1bf964a667
Added two examples on how to use Neuphonic as a TTS (07u).
2025-03-13 14:42:42 +00:00
Adnan Siddiquei
08fb931ef6
Swapped NEUPHONIC_API_TOKEN for NEUPHONIC_API_KEY.
2025-03-13 12:10:03 +00:00
Aleix Conchillo Flaqué
c5aa931096
Merge pull request #1358 from pipecat-ai/aleix/abstractmethod-fixes
...
ai_services: fix abstractmethod issues
2025-03-12 17:26:48 -07:00
Filipi Fuchter
d33a4b3a11
Implementing reconnection logic.
2025-03-12 18:23:12 -03:00
Filipi Fuchter
9cad8bfcc6
Increasing the time that we are waiting for the frame.
2025-03-12 15:36:40 -03:00
Mark Backman
b084a3e9e7
Merge pull request #1367 from MaCaki/macaki/rime/send_msg_in_flush_audio
...
[rime client] Sending over trailing space to help indicate end of utt…
2025-03-12 14:25:18 -04:00
macaki
5c9e33bc7a
formatting
2025-03-12 12:20:18 -06:00
Filipi Fuchter
93d8ddf4f2
Only showing the timout warning to receive frame if the client is connected.
2025-03-12 15:13:59 -03:00
Adnan Siddiquei
0b9c4b2255
Fixed a couple of small bugs.
2025-03-12 18:04:48 +00:00
macaki
effb5f6cd8
added changelog
2025-03-12 11:57:25 -06:00
Adnan Siddiquei
ead555eb4b
Corrected versions on pyproject.toml.
2025-03-12 17:39:04 +00:00
macaki
f843482968
[rime client] Sending over trailing space to help indicate end of utterance after a punctuation.
2025-03-12 11:26:43 -06:00
Adnan Siddiquei
23a4933af9
Initial implementation of Neuphonic service. A TTS provider.
2025-03-12 17:15:31 +00:00
Filipi Fuchter
0d05312071
Supporting renegotiation inside the voice agent server.
2025-03-12 11:55:38 -03:00
Filipi Fuchter
f8e33d8b7b
Improving the video transform feedback when we are connecting, and cleaning the pc_id when disconnected.
2025-03-12 11:49:33 -03:00
Filipi Fuchter
f24c5b0aa7
Adding support for renegotiation.
2025-03-12 11:31:18 -03:00
Michael Louis
d9ef19233a
Added foundational example for ultravox
2025-03-12 10:30:23 -04:00
Mark Backman
357334e3c9
Merge pull request #1341 from pipecat-ai/mb/fix-google-typo
...
Add a set_language convenience method for GoogleSTTService
2025-03-12 09:05:52 -04:00
Filipi Fuchter
da25e0c008
Configuring the bot to receive the video live.
2025-03-12 10:00:33 -03:00
Filipi Fuchter
c99d02d8bb
Adding support for interruptions when using SmallWebRTCTransport.
2025-03-12 09:09:11 -03:00
Mark Backman
59ea94af86
Merge pull request #1360 from pipecat-ai/mb/update-cartesia-voice
...
Update Cartesia voice for demos
2025-03-12 08:02:26 -04:00
Mark Backman
4a363bebf0
Add a set_language convenience method for GoogleSTTService
2025-03-12 07:58:29 -04:00
Mark Backman
c196fb5f98
Merge pull request #1342 from pipecat-ai/mb/lmnt-flush-audio
2025-03-11 22:22:38 -04:00
Mark Backman
5f97f6ff94
Add flush_audio() to LmntTTSService
2025-03-11 21:57:54 -04:00
Mark Backman
5860fe5319
Merge pull request #1340 from pipecat-ai/mb/fish-flush
...
Add flush_audio to FishTTSService
2025-03-11 21:56:44 -04:00
Mark Backman
3522bbb533
tmp
2025-03-11 21:55:18 -04:00
Mark Backman
cfca7269f4
Update the Cartesia voice in all demos with one built for sonic-2
2025-03-11 21:53:03 -04:00
Mark Backman
e6f269a903
Add flush_audio to FishTTSService
2025-03-11 21:48:41 -04:00
Mark Backman
468e936a5f
Merge pull request #1356 from pipecat-ai/mb/add-chirp-tts-support
...
Add support for Chirp voices in GoogleTTSService
2025-03-11 20:12:52 -04:00
Lucas Rothman
ecc4411128
Tavus support for custom output rate
2025-03-11 16:02:33 -07:00
Aleix Conchillo Flaqué
740ba4e759
ai_services: fix abstractmethod issues
2025-03-11 14:29:03 -07:00
Filipi Fuchter
e56c8f881c
Full video transformation example using SmallWebRTCTransport.
2025-03-11 11:36:47 -03:00
Filipi Fuchter
a747f08017
Simple voice agent example using SmallWebRTCTransport.
2025-03-11 11:36:23 -03:00
Filipi Fuchter
c6c0b73345
P2P WebRTC transport option to Pipecat: SmallWebRTCTransport.
2025-03-11 11:35:39 -03:00
Filipi Fuchter
fde90ee01d
Creating an EventEmitter util class
2025-03-11 11:33:47 -03:00
Filipi Fuchter
689a844aaf
Created a new transport param to inform if the camera input should be enabled.
2025-03-11 11:33:24 -03:00
Filipi Fuchter
aab98b61a0
Fixed issue where sending too many images per second caused Gemini to ignore them.
2025-03-11 11:32:38 -03:00
Mark Backman
a62741df94
Add support for Chirp voices in GoogleTTSService
2025-03-11 07:56:27 -04:00
Mark Backman
5bd359ada9
Merge pull request #1354 from pipecat-ai/mb/cartesia-changelog
...
Changelog entry for Cartesia model update
2025-03-11 07:20:04 -04:00
Mark Backman
40562402a2
Changelog entry for Cartesia model update
2025-03-10 21:10:11 -04:00
Mark Backman
98e5089fbe
Merge pull request #1353 from kunal-cai/main
...
[Cartesia] Update the default alias for Cartesia TTS Service
2025-03-10 21:07:19 -04:00
Kunal Shah
e1c8a09b60
[Cartesia] Update the default alias for Cartesia TTS Service
2025-03-10 14:43:58 -07:00
Filipi da Silva Fuchter
154fe65011
Merge pull request #1336 from pipecat-ai/fixing_function_calling_examples
...
Pipecat small fixes and refactored function calling examples
2025-03-07 16:10:27 -03:00
Mark Backman
61f534ca34
Merge pull request #1334 from pipecat-ai/aleix/user-and-bot-turn-audio
...
add support for user and bot turn audio
2025-03-06 18:35:56 -05:00
Mark Backman
a91c26785f
Store recording in a folder
2025-03-06 18:31:48 -05:00
Aleix Conchillo Flaqué
d7e93551d2
examples(chatbot-audio-recording): add support for user/bot turn audio
2025-03-06 11:49:01 -08:00
Aleix Conchillo Flaqué
06c742a2ad
AudioBufferProcessor: add on_user_turn_audio_data and on_bot_turn_audio_data
2025-03-06 11:49:01 -08:00
Filipi Fuchter
55b0797fd5
Removing the extra examples inside the unified-format-function-calling folder
2025-03-06 12:00:22 -03:00
Filipi Fuchter
21443b9a08
Refactored gemini multimodal example to use the unified format for function calling.
2025-03-06 11:59:08 -03:00
Filipi Fuchter
4b167a3c3d
Fixing the ruff format.
2025-03-06 10:38:45 -03:00
Filipi Fuchter
2df77430aa
Refactoring the 14 series examples to use the unified format for function calling.
2025-03-06 10:35:26 -03:00
Filipi Fuchter
2d114b15f9
Adding missing flush_audio method to AzureTTSService.
2025-03-06 10:34:25 -03:00
Filipi Fuchter
26000b616d
Fixing the base_whisper services to implement set_language.
2025-03-06 10:15:04 -03:00
Aleix Conchillo Flaqué
710eebab09
Merge pull request #1332 from pipecat-ai/aleix/base-object-and-event-handlers
...
introduce BaseObject class
2025-03-05 13:41:27 -08:00
Dominic Stewart
532423eb4c
Updated example to switch pipelines per the original request ( #1320 )
2025-03-05 13:40:36 -08:00
Aleix Conchillo Flaqué
bb29e50adb
introduce BaseObject class
2025-03-05 13:38:53 -08:00
Filipi da Silva Fuchter
4048d6782b
Merge pull request #1211 from pipecat-ai/function_calling_unified_format
...
Unified format for function calling
2025-03-05 18:30:22 -03:00
Filipi Fuchter
76d36a312b
Adding the unified format function calling to the changelog.
2025-03-05 14:18:37 -03:00
Filipi Fuchter
2a75373c04
Created examples for unified format function calling.
2025-03-05 14:12:30 -03:00
Filipi Fuchter
a840b0e815
Prevents pytest from collecting TestFrameProcessor.
2025-03-05 14:11:52 -03:00
Filipi Fuchter
ebcde719a6
Integration test for function calling.
2025-03-05 14:11:16 -03:00
Filipi Fuchter
5c912927bb
Unit tests for function calling adapters.
2025-03-05 14:11:02 -03:00
Filipi Fuchter
0e55db054e
Created script to fix ruff format issues.
2025-03-05 14:10:47 -03:00
Filipi Fuchter
5967ac0d4f
Implementing unified format for function calling.
2025-03-05 14:10:32 -03:00
Aleix Conchillo Flaqué
1451483cf7
Merge pull request #1330 from pipecat-ai/aleix/playht-update-0.1.12
...
pyproject: update pyht to 0.1.12
2025-03-04 18:35:03 -08:00
Michael Louis
3fe7c1d730
Added ultravox service
2025-03-04 13:59:03 -05:00
Aleix Conchillo Flaqué
c14b85c12b
pyproject: update pyht to 0.1.12
...
Fixes #1309
2025-03-04 10:26:11 -08:00
kompfner
9f3c0219d7
Merge pull request #1329 from pipecat-ai/add-permissions-to-daily-meeting-token-properties
...
Add the `permissions` property to `DailyMeetingTokenProperties`
2025-03-03 14:44:10 -05:00
Aleix Conchillo Flaqué
ec36fef26e
updated CHANGELOG and fix GladiaSTTService formatting
2025-03-03 09:53:03 -08:00
allenmylath
5f1848d24b
Update gladia.py ( #1317 )
...
* Update gladia.py
According to gladia docs
https://docs.gladia.io/api-reference/v2/live/init
speech threshould value close to 1 enables gladia to better isolate speeech from noise.
2025-03-03 09:51:11 -08:00
Aleix Conchillo Flaqué
d6867bd12f
Merge pull request #1321 from pipecat-ai/aleix/allow-setting-context-aggregator-parameters
...
LLMService: add user/assistant args to create_context_aggregator()
2025-03-03 09:48:31 -08:00
Aleix Conchillo Flaqué
17a1f30572
LLMService: add user/assistant args to create_context_aggregator()
2025-03-03 09:46:37 -08:00
Paul Kompfner
8e0dc1f256
Add the permissions property to DailyMeetingTokenProperties
2025-03-03 10:13:25 -05:00
Kwindla Hultman Kramer
b9100beee3
Merge pull request #1327 from pipecat-ai/azure-realtime-changelog
...
CHANGELOG.md entry for AzureRealtimeBetaLLMService
2025-03-02 20:30:40 -08:00
Mark Backman
b8bc3d2565
Merge pull request #1326 from pipecat-ai/mb/11labs-speed
...
Add speed as InputParam to ElevenLabs TTS services
2025-03-02 15:20:01 -05:00
Kwindla Hultman Kramer
3213e85b7d
CHANGELOG.md entry for AzureRealtimeBetaLLMService
2025-03-02 12:16:50 -08:00
Kwindla Hultman Kramer
de3bcd64c4
Merge pull request #1324 from pipecat-ai/azure-realtime
...
Support for Azure OpenAI Realtime API
2025-03-02 12:13:29 -08:00
Mark Backman
ad7f1eec12
Create a function to build voice_settings dictionary
2025-03-02 08:27:29 -05:00
Mark Backman
29310b4e92
Add speed as InputParam to ElevenLabs TTS services
2025-03-02 08:19:44 -05:00
Kwindla Hultman Kramer
2f4d36a146
docstring fixup
2025-03-01 15:44:10 -08:00
Kwindla Hultman Kramer
6c9bb782b1
add __init__.py
2025-03-01 15:42:20 -08:00
Kwindla Hultman Kramer
010d9103d4
support for Azure OpenAI Realtime API
2025-03-01 15:39:19 -08:00
Aleix Conchillo Flaqué
12131eb7c5
Merge pull request #1313 from Vaibhav159/vl_add_automated_formatting
...
using ruff automated formatting to avoid action failures.
2025-02-28 13:12:31 -08:00
Aleix Conchillo Flaqué
80b830322a
Merge pull request #1311 from pipecat-ai/aleix/llm-full-response-aggregator
...
add new LLMFullResponseAggregator
2025-02-28 13:08:06 -08:00
Aleix Conchillo Flaqué
8db9d16174
add new LLMFullResponseAggregator
2025-02-28 13:05:21 -08:00
Aleix Conchillo Flaqué
1c92fab1fb
Merge pull request #1308 from Vaibhav159/vl_google_openai_format
...
adding GoogleLLMOpenAIBetaService
2025-02-28 12:04:37 -08:00
Vaibhav159
974717d1b9
sync with main
2025-03-01 01:16:21 +05:30
Vaibhav159
59fb631390
fixing function calling and adding example
2025-03-01 01:14:37 +05:30
Vaibhav159
4824220260
adding GoogleLLMOpenAIBetaService
2025-03-01 01:14:26 +05:30
Mark Backman
55a338614d
Merge pull request #1312 from pipecat-ai/mb/move-server-message-frame
...
Rename ServerMessageFrame to RTVIServerMessageFrame and move to rtvi.py
2025-02-28 13:59:31 -05:00
Vaibhav159
f033046963
using ruff automated formatting to avoid repeated failures
2025-02-28 08:25:15 +05:30
Mark Backman
6018fc068c
Rename ServerMessageFrame to RTVIServerMessageFrame and move to rtvi.py
2025-02-27 20:07:07 -05:00
Aleix Conchillo Flaqué
d5b634301f
Merge pull request #1302 from pipecat-ai/aleix/cleanup-llm-tts-logging
...
services: minor LLM and TTS logging improvements
2025-02-27 13:51:04 -08:00
Aleix Conchillo Flaqué
a37eb1049d
Merge pull request #1310 from Canonical-AI-Inc/without-audio
...
Optional Recording
2025-02-27 13:37:39 -08:00
Adrian Cowham
803ea9d8bc
update the canonical client so that the audio recording is optional as long as there is a transcript
2025-02-27 12:31:02 -08:00
Mark Backman
499bc25217
Merge pull request #1303 from pipecat-ai/mb/add-server-to-client-msg
...
Add a new generic server to client message and frame type
2025-02-27 12:56:57 -05:00
Mark Backman
53d403af4b
Remove the RTVIServerMessage logic from the RTVIProcessor
2025-02-27 12:50:43 -05:00
Aleix Conchillo Flaqué
a0a8ea1641
Merge pull request #1301 from pipecat-ai/aleix/example-22d-fix-llm-aggregator
2025-02-26 22:39:48 -08:00
Mark Backman
26c68ccd7c
Add a new generic server to client message and frame type
2025-02-26 18:59:06 -05:00
Aleix Conchillo Flaqué
fa010c8644
services: minor LLM and TTS logging improvements
2025-02-26 15:36:25 -08:00
Aleix Conchillo Flaqué
d58f398bc4
examples: fix for 22d-natural-conversation-gemini-audio.py
2025-02-26 13:15:07 -08:00
Aleix Conchillo Flaqué
11383a86a1
Merge pull request #1300 from pipecat-ai/aleix/prepare-0.0.58
...
update CHANGELOG for 0.0.58
2025-02-26 11:31:24 -08:00
Aleix Conchillo Flaqué
daa52ff8df
update CHANGELOG for 0.0.58
2025-02-26 11:29:04 -08:00
Mark Backman
a5f41e22f7
Merge pull request #1299 from pipecat-ai/mb/add-track-level-recording
...
Added on_track_audio_data callback to AudioBufferProcessor for track level recording
2025-02-26 13:49:36 -05:00
Mark Backman
530bb5233d
example: Added a foundational example (34) for audio recording
2025-02-26 13:44:32 -05:00
Aleix Conchillo Flaqué
4a64e09f6c
Merge pull request #1297 from pipecat-ai/aleix/daily-python-0.15.0
...
pyproject: update daily-python, aiohttp and pydantic
2025-02-26 10:26:59 -08:00
Aleix Conchillo Flaqué
74582bb8d5
pyproject: update daily-python, aiohttp and pydantic
2025-02-26 10:22:34 -08:00
Mark Backman
1ca2101e3a
Added on_track_audio_data callback to AudioBufferProcessor for track level recording
2025-02-26 10:48:56 -05:00
Aleix Conchillo Flaqué
e80311c323
Merge pull request #1296 from pipecat-ai/aleix/google-always-send-text-with-audio
...
GoogleLLMService: always send text with audio
2025-02-26 07:47:56 -08:00
Aleix Conchillo Flaqué
2f24c422b6
Merge pull request #1289 from pipecat-ai/aleix/tts-http-improvements
...
small TTS http improvements
2025-02-26 07:47:26 -08:00
Mark Backman
0d0b9fddef
Merge pull request #1291 from pipecat-ai/mb/playht-http-protocol
...
PlayHTHttpTTSService now takes a separate protocol input
2025-02-26 08:09:49 -05:00
Mark Backman
1753cc99f4
PlayHTHttpTTSService now takes a separate protocol input
2025-02-26 08:01:54 -05:00
Aleix Conchillo Flaqué
4f8b036abe
pyproject: remote httpx old dependency and upgrade anthropic/google-genai
2025-02-25 22:28:21 -08:00
Aleix Conchillo Flaqué
f83c89c202
examples: update google examples
2025-02-25 22:28:02 -08:00
Aleix Conchillo Flaqué
bb89a036e5
google: always send text part when sending inline audio
2025-02-25 22:27:38 -08:00
Aleix Conchillo Flaqué
b994a03466
examples: add more HTTP TTS services examples
2025-02-25 21:40:41 -08:00
Aleix Conchillo Flaqué
27161f8e3b
BaseOutputTransport: cleanup audio buffer after bot stops talking
2025-02-25 21:39:47 -08:00
Aleix Conchillo Flaqué
8acf9a488b
tts: some small HTTP-based services improvements
2025-02-25 21:39:47 -08:00
Aleix Conchillo Flaqué
96c6aeaada
Merge pull request #1295 from pipecat-ai/aleix/pipelinetask-keyword-arguments
...
PipelineTask: force constructor keyword arguments
2025-02-25 19:00:58 -08:00
Aleix Conchillo Flaqué
6722aae598
PipelineTask: force constructor keyword arguments
2025-02-25 18:58:47 -08:00
Aleix Conchillo Flaqué
66564392a6
Merge pull request #1293 from pipecat-ai/aleix/log-pipecat-version
...
log pipecat version on application startup
2025-02-25 18:57:52 -08:00
Aleix Conchillo Flaqué
f258f5ab66
Merge pull request #1292 from pipecat-ai/aleix/audiocontext-terminate-nicely
...
AudioContextWordTTSService: wait for all requested audio
2025-02-25 18:56:41 -08:00
Aleix Conchillo Flaqué
f8f0578c3d
log pipecat version on application startup
2025-02-25 18:55:45 -08:00
Aleix Conchillo Flaqué
aa60a413f3
Merge pull request #1294 from pipecat-ai/aleix/improve-test-requirements
...
improve test-requirements.txt
2025-02-25 18:55:18 -08:00
Aleix Conchillo Flaqué
3e66f2378d
improve test-requirements.txt
2025-02-25 17:34:33 -08:00
Aleix Conchillo Flaqué
9a50f33e36
AudioContextWordTTSService: wait for all requested audio
2025-02-25 15:35:47 -08:00
Aleix Conchillo Flaqué
4bd5e9c0a7
Merge pull request #1285 from pipecat-ai/aleix/handle-stop-task-gracefully
...
handle stop task gracefully
2025-02-25 11:25:38 -08:00
Mark Backman
12092c8715
Merge pull request #1288 from pipecat-ai/mb/clean-up-tts-text-input
...
TTSService: Remove newlines before sending text to TTS service to gen…
2025-02-25 14:00:43 -05:00
Mark Backman
92cc6d39f2
TTSService: Remove newlines before sending text to TTS service to generate
2025-02-25 13:37:25 -05:00
Aleix Conchillo Flaqué
34a50033cb
tk: use TkTransportParams in examples
2025-02-25 10:24:24 -08:00
Aleix Conchillo Flaqué
e60b65228b
allow multiple StartFrames
2025-02-25 10:24:04 -08:00
Mark Backman
e74864335b
Merge pull request #1287 from pipecat-ai/mb/30-observer-pipeline-task
...
Example 30: Move observers to PipelineTask
2025-02-25 12:11:23 -05:00
Mark Backman
27a088a457
Merge pull request #1286 from pipecat-ai/mb/update-grok-2
...
Set grok-2 as default model for GrokLLMSService
2025-02-25 12:11:09 -05:00
Mark Backman
cfe72143b8
Example 30: Move observers to PipelineTask
2025-02-25 10:54:25 -05:00
Mark Backman
36a729cbfe
Set grok-2 as default model for GrokLLMSService
2025-02-25 10:00:45 -05:00
Aleix Conchillo Flaqué
d2f006682c
introduce new BaseTaskManager
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
fb7fe540f5
tts: don't connect to websocket if already connected
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
1ec68bd071
make sure we don't create tasks if already created
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
4536d03e82
FrameProcessor: cancel input/push tasks on CancelFrame
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
699704732c
asyncio: re-raise CancelledError in wait_for_task()
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
376d969a77
task: handle StopFrame and StopTaskFrame gracefully
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
68789dfcf0
frames: add new StopFrame
2025-02-24 21:34:23 -08:00
Aleix Conchillo Flaqué
fe9fc61c4e
Merge pull request #1282 from pipecat-ai/aleix/pipelinetask-observers-constructor
...
PipelineTask: pass observers in contructor parameter
2025-02-24 21:29:46 -08:00
Aleix Conchillo Flaqué
6028f0f23a
PipelineTask: pass observers in contructor parameter
2025-02-24 21:29:17 -08:00
Aleix Conchillo Flaqué
e9a0959e28
Merge pull request #1283 from pipecat-ai/aleix/check-dangling-tasks
...
PipelineTask: add check_dangling_tasks parameter
2025-02-24 21:26:32 -08:00
Dominic Stewart
f66be2cfa7
Dom/gemini system prompt switching ( #1260 )
...
* Updated example to use Gemini
* Fixed typo
* Based on feedback, made the gemini file something that can be called separately
* Updated the readme
* Updated the readme
* Changed example to use gemini 2.0 flash lite
* This works
* Improvement
* I think this works
* Updated the code to use the correct prompt broken down into smaller pieces
* Added a few more things to detect in the prompt
* Fixed import ordering
* Updated prompt for non gemini bot to look for more voicemail examples, plus added logic to detect if we're doing dialin or not to avoid a non-fatal dialin related error
* moved terminate call to handlers class
* Simplified logic for dialin
* Forgot to use the same logic for the openai bot
* Starting to add logic for native audio input for flash lite
* Fixed logic
* Fixed some code based on suggestions
2025-02-24 22:29:55 -06:00
Aleix Conchillo Flaqué
f818bed58f
Merge pull request #1281 from pipecat-ai/aleix/google-context-aggregator-upgrade-context
...
google: updgrade OpenAILLMContext to GoogleLLMContext
2025-02-24 17:37:26 -08:00
Aleix Conchillo Flaqué
07b9be5308
PipelineTask: add check_dangling_tasks parameter
2025-02-24 17:33:10 -08:00
Aleix Conchillo Flaqué
40c2452d6e
google: updgrade OpenAILLMContext to GoogleLLMContext
2025-02-24 15:35:18 -08:00
Aleix Conchillo Flaqué
30cdd1b71a
Merge pull request #1280 from pipecat-ai/aleix/add-completion-timeout
...
services(llm): add on_completion_timeout event
2025-02-24 15:07:20 -08:00
Aleix Conchillo Flaqué
2110b79507
services(llm): add on_completion_timeout event
2025-02-24 14:55:36 -08:00
Aleix Conchillo Flaqué
fc544fa61c
Merge pull request #1272 from pipecat-ai/aleix/tts-websocket-interruptions
...
services: fix some TTS websocket service interruption handling
2025-02-24 14:54:41 -08:00
Mark Backman
976fe95304
Merge pull request #1279 from pipecat-ai/mb/remove-open-optional-dep
...
Remove `openai` optional dependency from services as it's now required
2025-02-24 17:42:53 -05:00
Aleix Conchillo Flaqué
408270b647
lmnt: don't send "eof" before closing the socket
2025-02-24 14:37:37 -08:00
Mark Backman
1dfb75bc9d
Merge pull request #1278 from pipecat-ai/mb/claude-3-7
...
Update AnthropicLLMService to use claude-3-7-sonnet-20250219 by default
2025-02-24 15:41:28 -05:00
Mark Backman
cefc2a1088
Fix test-requirements.text ordering
2025-02-24 15:06:13 -05:00
Mark Backman
3b9b9200ea
Remove openai optional dependency from services as it's now required
2025-02-24 15:05:42 -05:00
Mark Backman
d6f29a0f4b
Update AnthropicLLMService to use claude-3-7-sonnet-20250219 by default
2025-02-24 14:32:00 -05:00
Aleix Conchillo Flaqué
5b762d11ef
Merge pull request #1228 from CarlKho-Minerva/main
...
Missing Cartesia~=1.3.1 → `test-requirements`
2025-02-24 08:47:41 -08:00
Aleix Conchillo Flaqué
2f3e2da6b9
Merge pull request #1259 from pipecat-ai/openai-not-optional
...
Since the `openai` package is used by pretty much everything in pipec…
2025-02-24 08:45:45 -08:00
allenmylath
45058d4a94
Update audio_buffer_processor.py ( #1266 )
2025-02-24 08:41:19 -08:00
Aleix Conchillo Flaqué
5b637bd826
services: fix some TTS websocket service interruption handling
2025-02-24 08:37:22 -08:00
Mark Backman
2d4fd7e903
Merge pull request #1274 from pipecat-ai/mb/add-ellipsis-test
...
Add one additional ellipsis test to test_utils_string
2025-02-23 11:26:20 -05:00
Mark Backman
b5662520aa
Add one additional ellipsis test to test_utils_string
2025-02-23 11:04:24 -05:00
Aleix Conchillo Flaqué
af45c170b5
Merge pull request #1264 from pipecat-ai/aleix/add-log-observers
...
add initial log observers
2025-02-21 15:20:45 -08:00
Aleix Conchillo Flaqué
65f548b2ec
examples(30-observer): update to use LLMLogObserver
2025-02-21 15:15:16 -08:00
Aleix Conchillo Flaqué
b29ab8c608
observers: add LLMLogObserver and TranscriptionLogObserver
2025-02-21 15:15:16 -08:00
Aleix Conchillo Flaqué
d6dc37f0b6
Merge pull request #1269 from pipecat-ai/aleix/endofsentence-support-ellipses
...
utils: add support for ellipses in match_endofsentence()
2025-02-21 15:08:22 -08:00
Aleix Conchillo Flaqué
12bce2e8c0
utils: add support for ellipses in match_endofsentence()
2025-02-21 15:05:50 -08:00
Aleix Conchillo Flaqué
4acf7296e0
Merge pull request #1261 from pipecat-ai/aleix/emualted-frames-being-triggered-prematurely
...
LLMUserContextAggregator: don't reset timer with interim transcription
2025-02-21 10:15:28 -08:00
Aleix Conchillo Flaqué
98706d429c
LLMUserContextAggregator: make sure incoming transcription has text
2025-02-21 10:12:54 -08:00
Aleix Conchillo Flaqué
41720b1a13
LLMUserContextAggregator: don't reset timer with interim transcription
...
It turns out that in some cases we only get interim transcriptions (e.g. someone
is speaking very very softly or someone is talking in the background). In those
cases we don't want to interrupt the bot because there's really nothing to
interrupt the bot for.
We originally thought we should interrupt the bot right at the time we got an
interim frame, but this is causing too many false positives. It's actually
better to simply wait for a real transcription before interrupting (in case VAD
didn't interrupt).
2025-02-21 09:05:56 -08:00
Aleix Conchillo Flaqué
3ef4245166
Merge pull request #1265 from pipecat-ai/aleix/transport-remove-audio-out-is-live
2025-02-21 06:51:09 -08:00
Filipi da Silva Fuchter
3bb0797922
Merge pull request #1257 from pipecat-ai/fastapi_disconnect_issue
...
Fixed an issue where FastAPI was not triggering on_client_disconnected.
2025-02-21 09:15:15 -03:00
Filipi Fuchter
7c7b4c52af
Fixed an issue where EndTaskFrame was not triggering on_client_disconnected or closing the WebSocket in FastAPI.
2025-02-21 09:11:58 -03:00
Aleix Conchillo Flaqué
01f083b7fc
transports: remove TransportParams.audio_out_is_live
2025-02-20 23:33:06 -08:00
Aleix Conchillo Flaqué
91fcaebe25
Merge pull request #1263 from Vaibhav159/vl_fix_deepgram_sample_rate_mismatch
...
fixing deepgram mismatch
2025-02-20 22:39:06 -08:00
Vaibhav159
9c5fe5c85e
fixing deepgram mismatch
2025-02-21 09:32:40 +05:30
Aleix Conchillo Flaqué
7e5e167a4b
Merge pull request #1250 from pipecat-ai/aleix/context-aggregation-simulatenous-text-tools
...
AssistantContextAggregator: append aggregation and tools in the same turn
2025-02-20 17:32:57 -08:00
Aleix Conchillo Flaqué
d04c4b36f3
AssistantContextAggregator: append aggregation and tools in the same turn
2025-02-20 17:29:43 -08:00
Aleix Conchillo Flaqué
a811e53626
Merge pull request #1253 from pipecat-ai/aleix/http-tts-services-stopped-frame
...
HTTP TTS services stopped frame
2025-02-20 17:28:05 -08:00
Paul Kompfner
df57202a05
Since the openai package is used by pretty much everything in pipecat (due to OpenAILLMContext being the standard context representation), let's make it a non-optional dependency.
...
This change solves an issue faced by users who aren't intending to use OpenAI getting scary error messages saying that they need the `openai` optional dependency "in order to use OpenAI", along with an instruction to set the OPENAI_API_KEY environment variable.
Note that with this change we could theoretically remove from pyproject.toml a number of defined optional dependencies that list only the `openai` package as a dependency (like `deepseek`, for example), but I didn't want to "break the API" in terms of how users install/consume pipecat and its set of built-in services.
Finally, I removed the `python-deepcompare` dependency from the `openai` optional dependency, since it appears to me like it was added by mistake (my guess is it was used for debugging during development and then never removed).
2025-02-20 15:21:35 -05:00
Aleix Conchillo Flaqué
69e6f3fdb7
rime: pass aiohttp session to constructor
2025-02-20 07:36:24 -08:00
Aleix Conchillo Flaqué
6809254963
tts: fix metrics and TTSStoppedFrame frame in HTTP services
...
Fixes #1247
2025-02-20 07:36:21 -08:00
Aleix Conchillo Flaqué
81093d3bed
Merge pull request #1252 from pipecat-ai/aleix/remove-vad-extra-logging
...
BaseInputTransport: remove VAD logging
2025-02-20 07:32:20 -08:00
Aleix Conchillo Flaqué
d9a67164f6
Merge pull request #1251 from pipecat-ai/aleix/fish-tts-service-push-stop-frame
...
FishAudioTTSService should push TTSStoppedFrame
2025-02-20 07:32:05 -08:00
Aleix Conchillo Flaqué
d0f67fc189
BaseInputTransport: remove VAD logging
...
These logs are very verbose. They were added to try to find an issue that
resulted in being because of low CPU/memory resources, but these logs were not
helpful to determine that.
2025-02-19 21:55:11 -08:00
Aleix Conchillo Flaqué
6e3f96aa83
fish: automatically send TTSStoppedFrame after timeout
2025-02-19 21:41:18 -08:00
Aleix Conchillo Flaqué
293677588d
tts: make push_stop_frames default to 2.0s
2025-02-19 21:39:00 -08:00
Carl Kho
a5cdd5f1b8
Add Cartesia API key to dot-env.template
2025-02-14 21:29:37 -08:00
Carl Kho
5f937b8479
Update test requirements to include Cartesia version 1.3.1
2025-02-14 21:14:32 -08:00
fatwang2
8cda4512ad
Merge branch 'pipecat-ai:main' into main
2025-02-06 10:50:25 +08:00
Pedro Moreira
79ac696973
Add support for Piper TTS
2025-02-04 13:51:33 -03:00
fatwang2
fc90bdc638
changed to HailuoHttpTTSService
2025-01-19 09:43:48 +08:00
fatwang2
5a88165a26
Merge branch 'pipecat-ai:main' into main
2025-01-19 09:40:08 +08:00
fatwang2
3466842cd4
add hailuo tts service
2025-01-17 12:46:05 +08:00