Aleix Conchillo Flaqué
f87ecd3a51
Merge pull request #1048 from pipecat-ai/aleix/add-unittest-utils
...
tests: add some initial run_test() utilities
2025-01-21 17:39:06 -08:00
Mark Backman
b96a922aa8
Fix trace log line for resume_processing_frames
2025-01-21 18:15:03 -05:00
Aleix Conchillo Flaqué
ab4221a4db
task: added BaseTask
2025-01-21 11:45:43 -08:00
Aleix Conchillo Flaqué
bd6f82cf94
task: allow specifying heartbeat period
2025-01-21 11:45:43 -08:00
Aleix Conchillo Flaqué
af02f8f1cd
filters(frame_filter): allow more than one frame
2025-01-21 09:43:33 -08:00
Aleix Conchillo Flaqué
2e0fb198bf
frame_processor: allow pushing more frames after EndFrame
...
This can be useful for testing purposes. In real practice, there shouldn't be
any frames after an EndFrame is pushed.
2025-01-21 09:42:15 -08:00
Filipi Fuchter
3e0836b340
Ignoring transport messages that are not intended to RTVI.
2025-01-21 10:08:14 -03:00
Aleix Conchillo Flaqué
b7dd9748cf
serializers: fix special fix initialization
2025-01-20 18:39:41 -08:00
Filipi Fuchter
9b61633aa0
Introduce support for extracting and processing grounding metadata from Google LLM responses.
2025-01-20 11:28:12 -03:00
Mark Backman
262d3a19c9
Fixed a type error when using voice_settings in ElevenLabsHttpTTSService
2025-01-20 07:57:02 -05:00
Aleix Conchillo Flaqué
2abbd4bb27
Merge pull request #1039 from pipecat-ai/aleix/fish-audio-websocket-service
...
services(fish): FishAudioTTSService to use WebsocketService
2025-01-18 14:48:20 -08:00
Aleix Conchillo Flaqué
e0011a3996
services(fish): FishAudioTTSService to use WebsocketService
2025-01-18 14:29:45 -08:00
Vaibhav159
a9c7dbbc05
removing unused code
2025-01-18 10:58:07 +05:30
Mark Backman
982f2becc6
Merge pull request #1002 from pipecat-ai/mb/add-on-error-callback
...
Register the on_error handler
2025-01-17 21:58:59 -05:00
Mark Backman
e049ae470d
Register the on_error handler
2025-01-17 21:49:42 -05:00
Mark Backman
e159f2dce1
Merge pull request #1024 from pipecat-ai/mb/elevenlabs-http
...
Add ElevenLabsHttpTTSService
2025-01-17 21:30:31 -05:00
Aleix Conchillo Flaqué
e9162ae467
Merge pull request #1004 from Fluentsai/feature/dtmf_input
...
Twilio serializer reading dtmf websocket messages
2025-01-17 18:14:46 -08:00
Mark Backman
b81323d676
Code review fixes + docstrings
2025-01-17 20:12:43 -05:00
Aleix Conchillo Flaqué
65fa77dfa5
audio: use resample_audio to resample ulaw bytes
2025-01-17 15:24:41 -08:00
Aleix Conchillo Flaqué
9ddd9ae27c
Merge pull request #1011 from Vaibhav159/vl_deepgram_metrics_without_vad
...
adding metric generation without deepgram VAD
2025-01-17 14:47:19 -08:00
Aleix Conchillo Flaqué
3e4020cdba
task: add TaskObserver and avoid pipeline blocking
...
Observers now process frames in separate tasks. This avoids blocking the
pipeline while the observer is processing the frame.
2025-01-17 11:15:52 -08:00
Aleix Conchillo Flaqué
4f883ee31f
Merge pull request #1023 from pipecat-ai/aleix/introduce-heartbeat-frames
...
introduce heartbeat frames
2025-01-17 10:31:07 -08:00
Aleix Conchillo Flaqué
45cbad5b3e
task: add HEARTBEAT_MONITOR_SECONDS
2025-01-17 10:11:28 -08:00
Aleix Conchillo Flaqué
477d0d154b
frame_processor: make sure clock is initialized
2025-01-17 10:05:23 -08:00
Aleix Conchillo Flaqué
4b3c776f58
task: don't use push queue to send a heartbeat
...
This is because we might be waiting for the EndFrame. Currently, if we push an
EndFrame to the task, the task will block until the EndFrame traverses all the
pipeline.
2025-01-17 10:04:24 -08:00
Aleix Conchillo Flaqué
da0c4cfd99
task: increase heartbeat monitoring to 5 seconds
2025-01-17 10:04:05 -08:00
Aleix Conchillo Flaqué
f22a00570d
task: start heartbeats task when push task starts
2025-01-17 10:03:13 -08:00
Mark Backman
85f4663a41
Start UserIdleProcessor on speaking frame, fix bug not pushing EndFrame
2025-01-17 12:54:17 -05:00
Vaibhav159
80779c48d6
sort fix
2025-01-17 20:07:25 +05:30
Vaibhav159
c444557965
fixing IdleFrameProcessor and UserIdleProcessor init logic
2025-01-17 19:50:53 +05:30
Mark Backman
d51893f61c
Refactor for aiohttp, correct use of settings
2025-01-16 23:49:53 -05:00
Mark Backman
740d2743df
Add TTFB metrics
2025-01-16 23:05:53 -05:00
Mark Backman
0dd22fb879
Merge pull request #1022 from pipecat-ai/mb/fix-abstractmethod
...
Remove @abstractmethod from set_model and set_model in TTSService class
2025-01-16 22:59:26 -05:00
Mark Backman
225b65c3d2
Add ElevenLabsHttpTTSService
2025-01-16 22:46:32 -05:00
Aleix Conchillo Flaqué
ff8aa68942
introduce heartbeat frames
2025-01-16 19:31:13 -08:00
Maxim Makatchev
c5edbf4b75
Made InputDTMFFrame a DataFrame and moved up to data frames
2025-01-17 12:27:04 +09:00
Aleix Conchillo Flaqué
799777774b
Merge pull request #1018 from pipecat-ai/aleix/streamline-thread-pool-executors
...
transports: streamline max_workers for ThreadPoolExecutors
2025-01-16 19:05:41 -08:00
Mark Backman
fdef8a97e2
Remove @abstractmethod from set_model and set_model in TTSService class
2025-01-16 21:36:51 -05:00
Mark Backman
e805738d4c
Merge pull request #1009 from pipecat-ai/mb/tts-ignore-interim-transcripts
...
TTSService should only process LLMTextFrames
2025-01-16 17:09:24 -05:00
Mark Backman
119bc7e35f
Update check to exclude transcription frames
2025-01-16 16:43:46 -05:00
Aleix Conchillo Flaqué
3714f12edc
Merge pull request #1019 from Canonical-AI-Inc/canonical-transcripts
...
Add transcript to Canonical Metrics Service
2025-01-16 13:36:55 -08:00
Aleix Conchillo Flaqué
d2b8171197
transports: streamline max_workers for ThreadPoolExecutors
2025-01-16 13:34:04 -08:00
Adrian Cowham
d0b48c95bb
updated the example to use stereo audio and pass in the context. also updated the service to send the transcripts if they're available
2025-01-16 13:12:38 -08:00
Aleix Conchillo Flaqué
73ed0c1ad7
Merge pull request #1017 from pipecat-ai/aleix/additional-trace-logging
...
additional trace logging
2025-01-16 12:38:47 -08:00
Aleix Conchillo Flaqué
359b55a85e
additional trace logging
2025-01-16 11:19:42 -08:00
vipyne
8ba3b150eb
services(gemini_multimodal_live): set content to [] if not present in messages
...
... which it will be if the message is a tool call
2025-01-16 11:59:02 -06:00
Vaibhav159
85e7d62f94
fixing log text
2025-01-16 21:36:51 +05:30
Vaibhav159
923d33eeff
fixing ruff
2025-01-16 21:32:48 +05:30
Vaibhav159
7ee6e7193d
adding metric generation without deepgram VAD
2025-01-16 21:23:56 +05:30
Mark Backman
67e47a388d
TTSService should only process LLMTextFrames
2025-01-16 10:03:24 -05:00
