Mark Backman
446bb0aeaf
Merge pull request #702 from pipecat-ai/mb/azure-websocket
...
Add an Azure TTS websocket service
2024-11-09 17:41:53 -05:00
Aleix Conchillo Flaqué
d839080834
Merge pull request #642 from pipecat-ai/aleix/input-queues-block-frames
...
introduce frame processor input queues block frames
2024-11-09 14:30:17 -08:00
Mark Backman
230b51a117
Add an Azure TTS websocket service
2024-11-09 12:37:29 -05:00
Kwindla Hultman Kramer
a54ca08405
fixes for anthropic function calling
2024-11-08 16:33:02 -08:00
Filipi da Silva Fuchter
4379db43ed
Merge pull request #689 from pipecat-ai/filipi/krisp
...
Making pipecat work with Krisp
2024-11-08 16:22:52 -03:00
Filipi Fuchter
e915c676aa
Added support for Krisp audio filter
2024-11-08 16:18:10 -03:00
Mark Backman
e0a003afa1
Merge pull request #695 from pipecat-ai/mb/initialize-azure-lang
...
Initialize the speech_recognition_language for Azure TTS
2024-11-08 06:40:40 -05:00
James Hush
d5666727ce
feat: toggle looping with soundfile mixer ( #693 )
...
* feat: toggle looping with soundfile mixer
* Implement PR changes
2024-11-07 21:08:37 -08:00
Mark Backman
aefe190c9f
Initialize the speech_recognition_language for Azure TTS
2024-11-07 15:14:05 -05:00
Aleix Conchillo Flaqué
beb3271168
services(tts): make sure word timestamp is reset properly
2024-11-06 18:54:12 -08:00
Aleix Conchillo Flaqué
17f4286942
transports(daily): call on_transcription_message event handler
2024-11-06 15:10:58 -08:00
Aleix Conchillo Flaqué
ce89bbb16e
tts(elevenlabs): support pausing and resuming frames while speaking
2024-11-06 14:38:33 -08:00
Aleix Conchillo Flaqué
865768039b
processors: remove block_on_frames and add pause_processing_frames() instead
2024-11-06 14:20:25 -08:00
Aleix Conchillo Flaqué
7071482583
try to use queue_frame() instead of process_frame()
2024-11-06 14:18:21 -08:00
Aleix Conchillo Flaqué
a9e565f355
processors: fix input queue interruptions
2024-11-06 13:12:24 -08:00
Aleix Conchillo Flaqué
49005d02f5
services(tts): use TTSSpeakFrame in say() method
2024-11-06 13:05:03 -08:00
Aleix Conchillo Flaqué
6d8b885071
transports(base_output): push bot started/stopped frames downstream
2024-11-06 13:04:37 -08:00
Aleix Conchillo Flaqué
2eccb33e73
processors: allow passing a callback when queued frame is processed
2024-11-06 13:04:37 -08:00
Aleix Conchillo Flaqué
22ca4c5a02
processors: cancel input task and empty queue with interruptions
2024-11-06 13:04:37 -08:00
Aleix Conchillo Flaqué
84f26ac1ca
processors: introduce input queues
...
Frame processors can now decide if they should continue processing frames or
not, and if so also decide when to continue processing frames. For example,
asynchronous TTS services will stop processing frames until they have generated
all the audio for an LLM response.
2024-11-06 12:13:49 -08:00
Aleix Conchillo Flaqué
8aab068ffd
rtvi: bot-ready message needs to be sent manual
2024-11-05 10:52:54 -08:00
Aleix Conchillo Flaqué
bd50201ce4
transports(daily): just make it clear we subscribe to camera
2024-11-04 17:32:46 -08:00
Aleix Conchillo Flaqué
358c458265
transports(base_input): handle filter contorl frames
2024-11-04 16:19:52 -08:00
Aleix Conchillo Flaqué
807dbbe326
audio(noisereduce): allow enabling/disabling filter
2024-11-04 16:13:29 -08:00
Aleix Conchillo Flaqué
3c116b291d
audio(mixers): some cosmetics
2024-11-04 15:37:08 -08:00
Aleix Conchillo Flaqué
0dd413ee90
audio(filters): add noisereduce filter
2024-11-04 15:37:08 -08:00
Aleix Conchillo Flaqué
abc8ede3d7
introduce audio filters
2024-11-04 15:37:08 -08:00
Aleix Conchillo Flaqué
126324ca1b
Merge pull request #687 from pipecat-ai/aleix/transport-audio-mixers
...
introduce transport audio mixers
2024-11-04 13:14:36 -08:00
Aleix Conchillo Flaqué
0ac9e2dd3f
transports(network): synchronize with time before sending data
2024-11-04 13:04:18 -08:00
Aleix Conchillo Flaqué
81c476dd4c
introduce output transport audio mixers
2024-11-03 11:13:02 -08:00
Kwindla Hultman Kramer
151242d3a0
Merge pull request #666 from pipecat-ai/khk/realtime-pipecat-vad
...
Support using Pipecat turn detection instead of OpenAI Realtime API turn detection
2024-11-02 08:36:31 -07:00
Kwindla Hultman Kramer
93c6e5098c
added comment explaining config of TurnDetection
2024-11-02 08:24:54 -07:00
Aleix Conchillo Flaqué
4455b2a428
rtvi: create queues before tasks
2024-11-01 23:06:50 -07:00
Aleix Conchillo Flaqué
94062592ef
base_output: generate smaller audio frames of the same incoming type
2024-11-01 23:06:50 -07:00
Aleix Conchillo Flaqué
d2401a76c8
base_output: only generate bot speaking with TTS audio frames
2024-11-01 23:06:50 -07:00
Mark Backman
802c29e9e1
Add recording events and callbacks
2024-11-01 10:20:00 -04:00
Aleix Conchillo Flaqué
018e51e8a3
add notifiers and more frame filters
2024-10-30 16:36:17 -07:00
Vanessa Pyne
b050143952
Merge pull request #676 from RonakAgarwalVani/fix/chunk-choices-delta-none
...
Fix uncaught exception when accessing 'tool_calls' in NoneType delta in response handling
2024-10-30 14:44:32 -05:00
Mark Backman
98ea1f0791
Merge pull request #675 from pipecat-ai/mb/playht-add-request-id
...
Add a request_id to each TTS sequence
2024-10-30 13:56:15 -04:00
Mark Backman
8272c35527
Use a request_id in TTS commands for the PlayHT websocket service
2024-10-30 13:54:18 -04:00
Mark Backman
e973e82e05
Merge pull request #672 from pipecat-ai/mb/fix-playht
...
Fix PlayHT TTFB metrics
2024-10-30 13:53:02 -04:00
RonakAgarwalVani
d1396bf618
Update openai.py
2024-10-30 14:26:49 +05:30
Mark Backman
2e57d21b89
Fix ttfb metrics
2024-10-28 20:27:24 -04:00
Aleix Conchillo Flaqué
e3ce619284
transports(base_output): use audio frames for bot speaking detection
2024-10-28 10:07:37 -07:00
Aleix Conchillo Flaqué
b32448e967
transports(daily): make functions async
2024-10-25 15:01:52 -07:00
Aleix Conchillo Flaqué
b905b57dfc
transports(daily): allow updating subscriptions before join
2024-10-25 14:46:17 -07:00
Kwindla Hultman Kramer
e1a7edfb58
make it possible to use Pipecat turn detection instead of OpenAI turn detection
2024-10-25 15:59:48 -05:00
Aleix Conchillo Flaqué
55026898f6
transports(base_output): use vad stop secs for bot stopped speaking
2024-10-25 12:59:15 -07:00
Aleix Conchillo Flaqué
4283557894
audio(vad): expose params property
2024-10-25 12:59:15 -07:00
Aleix Conchillo Flaqué
5ab00e01aa
transports(base_output): fix constant bot started/stopped speaking frames
2024-10-25 12:10:24 -07:00
