Mark Backman
d6f29a0f4b
Update AnthropicLLMService to use claude-3-7-sonnet-20250219 by default
2025-02-24 14:32:00 -05:00
Aleix Conchillo Flaqué
b29ab8c608
observers: add LLMLogObserver and TranscriptionLogObserver
2025-02-21 15:15:16 -08:00
Aleix Conchillo Flaqué
12bce2e8c0
utils: add support for ellipses in match_endofsentence()
2025-02-21 15:05:50 -08:00
Aleix Conchillo Flaqué
41720b1a13
LLMUserContextAggregator: don't reset timer with interim transcription
...
It turns out that in some cases we only get interim transcriptions (e.g. someone
is speaking very very softly or someone is talking in the background). In those
cases we don't want to interrupt the bot because there's really nothing to
interrupt the bot for.
We originally thought we should interrupt the bot right at the time we got an
interim frame, but this is causing too many false positives. It's actually
better to simply wait for a real transcription before interrupting (in case VAD
didn't interrupt).
2025-02-21 09:05:56 -08:00
Aleix Conchillo Flaqué
3ef4245166
Merge pull request #1265 from pipecat-ai/aleix/transport-remove-audio-out-is-live
2025-02-21 06:51:09 -08:00
Filipi Fuchter
7c7b4c52af
Fixed an issue where EndTaskFrame was not triggering on_client_disconnected or closing the WebSocket in FastAPI.
2025-02-21 09:11:58 -03:00
Aleix Conchillo Flaqué
01f083b7fc
transports: remove TransportParams.audio_out_is_live
2025-02-20 23:33:06 -08:00
Vaibhav159
9c5fe5c85e
fixing deepgram mismatch
2025-02-21 09:32:40 +05:30
Aleix Conchillo Flaqué
d04c4b36f3
AssistantContextAggregator: append aggregation and tools in the same turn
2025-02-20 17:29:43 -08:00
Aleix Conchillo Flaqué
69e6f3fdb7
rime: pass aiohttp session to constructor
2025-02-20 07:36:24 -08:00
Aleix Conchillo Flaqué
6809254963
tts: fix metrics and TTSStoppedFrame frame in HTTP services
...
Fixes #1247
2025-02-20 07:36:21 -08:00
Aleix Conchillo Flaqué
d9a67164f6
Merge pull request #1251 from pipecat-ai/aleix/fish-tts-service-push-stop-frame
...
FishAudioTTSService should push TTSStoppedFrame
2025-02-20 07:32:05 -08:00
Aleix Conchillo Flaqué
98259af54e
update CHANGELOG
2025-02-19 22:05:48 -08:00
Aleix Conchillo Flaqué
6e3f96aa83
fish: automatically send TTSStoppedFrame after timeout
2025-02-19 21:41:18 -08:00
Filipi Fuchter
7e7926059c
Fixed an issue that start_callback was not invoked for some LLM services.
2025-02-19 18:04:20 -03:00
Aleix Conchillo Flaqué
83f1a8830d
daily: add room_url property
2025-02-19 09:29:53 -08:00
Aleix Conchillo Flaqué
1b0bcebef6
deepgram: use the new nova-3 model as default
2025-02-18 17:51:54 -08:00
Aleix Conchillo Flaqué
4edda718ed
deepgram: add ability to provide custom addons
2025-02-18 17:45:41 -08:00
Aleix Conchillo Flaqué
50b6cc8135
network: added exponential_backoff_time() function
2025-02-18 17:42:43 -08:00
Aleix Conchillo Flaqué
c926063d74
deepgram: handle error event and reconnect
2025-02-18 09:52:18 -08:00
Aleix Conchillo Flaqué
90b9dce710
STTMuteFilter: ignore audio frames so no transcriptions are generated
2025-02-17 19:59:05 -08:00
Aleix Conchillo Flaqué
01c06c5cac
update CHANGELOG for 0.0.57
2025-02-14 18:47:33 -08:00
Aleix Conchillo Flaqué
f6912c0f9a
utils: don't consider colon an end of sentence
2025-02-14 18:47:33 -08:00
Aleix Conchillo Flaqué
633a4d4c58
FalImageGenService: load image async to not block the event loop
2025-02-14 18:47:33 -08:00
Aleix Conchillo Flaqué
b3a575c7c7
Merge pull request #1212 from Vaibhav159/vl_fix_incorrect_has_regular_messages_check
...
fixing google llm service error
2025-02-14 13:16:37 -08:00
Aleix Conchillo Flaqué
aeadb40c3f
CartesiaTTSService: use AudioContextWordTTSService
...
By supporting multiple audio requests we fix an issue that was causing audio
overlapping.
2025-02-14 11:55:54 -08:00
Aleix Conchillo Flaqué
cacb07f4c2
introduce AudioContextWordTTSService
2025-02-14 11:55:54 -08:00
Aleix Conchillo Flaqué
e006dcf172
WebsocketService: handle clean server disconnection
...
The websocket async iterator doesn't raise an exception when the server
disconnects cleanly. We should handle that and raise an exception so we can
reconnect.
2025-02-14 10:11:56 -08:00
Aleix Conchillo Flaqué
5909dff423
LLMContextResponseAggregator: add VAD emulation support
2025-02-13 15:25:22 -08:00
Aleix Conchillo Flaqué
e0d24d7fc0
update CHANGELOG
2025-02-13 13:21:32 -08:00
Aleix Conchillo Flaqué
67cdc0063a
BaseTransportOutput: allow pushing frames upstream
2025-02-13 13:20:38 -08:00
Aleix Conchillo Flaqué
e1f2bbceb3
reimplement LLM response aggregators
2025-02-13 13:20:37 -08:00
Filipi Fuchter
f001819df8
- Added a new audio_in_stream_on_start field to TransportParams.
...
- Added a new method `start_audio_in_streaming` in the `BaseInputTransport`.
- Updated `DailyTransport` to respect the `audio_in_stream_on_start` field, ensuring it only starts receiving the audio input if it is enabled.
2025-02-13 18:08:36 -03:00
Aleix Conchillo Flaqué
68aaa1f8f4
Merge pull request #1213 from pipecat-ai/aleix/base-transport-output-bot-vad-stop-secs
...
BaseOutputTransport: use specific VAD stop secs for the bot
2025-02-12 19:01:56 -08:00
Aleix Conchillo Flaqué
f110a45c85
BaseOutputTransport: use specific VAD stop secs for the bot
2025-02-12 19:01:39 -08:00
Vaibhav159
687b3d9d4c
fixing google llm service error
2025-02-12 22:22:04 +05:30
Mark Backman
397768d872
Add new STTMuteStrategy: MUTE_UNTIL_FIRST_BOT_COMPLETE
2025-02-12 10:59:28 -05:00
Mark Backman
9f1732c390
Update CHANGELOG and README
2025-02-12 10:11:17 -05:00
Mark Backman
fd68b82e48
Merge pull request #1163 from pipecat-ai/mb/rime-websocket
...
Add RimeTTSService
2025-02-12 09:51:56 -05:00
Paul Kompfner
28e233b195
Update CHANGELOG to reflect the addition of update_remote_participants()
2025-02-11 13:23:47 -05:00
Aleix Conchillo Flaqué
0a990b2aaa
Merge pull request #1196 from pipecat-ai/aleix/audio-buffer-processor-continuous-intermittent-stream
...
AudioBufferProcessor: handle continuous and intermittent user audio
2025-02-10 16:07:12 -08:00
Mark Backman
8020db350e
Update RimeHttpTTSService to use mistv2 model by default
2025-02-10 18:45:48 -05:00
Mark Backman
8f8a3ae7f9
Add RimeTTSService
2025-02-10 18:45:06 -05:00
Mark Backman
1a8dd6b713
Improve AzureTTSService error handling
2025-02-10 17:48:55 -05:00
Mark Backman
a64fa44811
Merge pull request #1186 from pipecat-ai/mb/whisper-multilingual
...
Add language support to WhisperSTTService
2025-02-10 17:26:10 -05:00
Vaibhav159
b0c3f80963
resolve merge conf
2025-02-11 03:03:32 +05:30
Aleix Conchillo Flaqué
eb3c9b1e75
AudioBufferProcessor: handle continuous and intermittent user audio
...
Fixes #1172
2025-02-10 11:26:31 -08:00
Aleix Conchillo Flaqué
32baee924b
RTVI: fix premature bot-tts-text messages ( #1193 )
2025-02-10 10:37:54 -08:00
Vaibhav159
b06b16adb7
fixing disconnect issue
2025-02-10 22:55:20 +05:30
Mark Backman
c9d8c572c7
Add language support to WhisperSTTService
2025-02-09 10:51:23 -05:00
