Adrian Cowham
803ea9d8bc
update the canonical client so that the audio recording is optional as long as there is a transcript
2025-02-27 12:31:02 -08:00
Mark Backman
53d403af4b
Remove the RTVIServerMessage logic from the RTVIProcessor
2025-02-27 12:50:43 -05:00
Mark Backman
26c68ccd7c
Add a new generic server to client message and frame type
2025-02-26 18:59:06 -05:00
Mark Backman
a5f41e22f7
Merge pull request #1299 from pipecat-ai/mb/add-track-level-recording
...
Added on_track_audio_data callback to AudioBufferProcessor for track level recording
2025-02-26 13:49:36 -05:00
Mark Backman
1ca2101e3a
Added on_track_audio_data callback to AudioBufferProcessor for track level recording
2025-02-26 10:48:56 -05:00
Aleix Conchillo Flaqué
e80311c323
Merge pull request #1296 from pipecat-ai/aleix/google-always-send-text-with-audio
...
GoogleLLMService: always send text with audio
2025-02-26 07:47:56 -08:00
Aleix Conchillo Flaqué
2f24c422b6
Merge pull request #1289 from pipecat-ai/aleix/tts-http-improvements
...
small TTS http improvements
2025-02-26 07:47:26 -08:00
Mark Backman
1753cc99f4
PlayHTHttpTTSService now takes a separate protocol input
2025-02-26 08:01:54 -05:00
Aleix Conchillo Flaqué
bb89a036e5
google: always send text part when sending inline audio
2025-02-25 22:27:38 -08:00
Aleix Conchillo Flaqué
27161f8e3b
BaseOutputTransport: cleanup audio buffer after bot stops talking
2025-02-25 21:39:47 -08:00
Aleix Conchillo Flaqué
8acf9a488b
tts: some small HTTP-based services improvements
2025-02-25 21:39:47 -08:00
Aleix Conchillo Flaqué
6722aae598
PipelineTask: force constructor keyword arguments
2025-02-25 18:58:47 -08:00
Aleix Conchillo Flaqué
66564392a6
Merge pull request #1293 from pipecat-ai/aleix/log-pipecat-version
...
log pipecat version on application startup
2025-02-25 18:57:52 -08:00
Aleix Conchillo Flaqué
f258f5ab66
Merge pull request #1292 from pipecat-ai/aleix/audiocontext-terminate-nicely
...
AudioContextWordTTSService: wait for all requested audio
2025-02-25 18:56:41 -08:00
Aleix Conchillo Flaqué
f8f0578c3d
log pipecat version on application startup
2025-02-25 18:55:45 -08:00
Aleix Conchillo Flaqué
3e66f2378d
improve test-requirements.txt
2025-02-25 17:34:33 -08:00
Aleix Conchillo Flaqué
9a50f33e36
AudioContextWordTTSService: wait for all requested audio
2025-02-25 15:35:47 -08:00
Aleix Conchillo Flaqué
4bd5e9c0a7
Merge pull request #1285 from pipecat-ai/aleix/handle-stop-task-gracefully
...
handle stop task gracefully
2025-02-25 11:25:38 -08:00
Mark Backman
92cc6d39f2
TTSService: Remove newlines before sending text to TTS service to generate
2025-02-25 13:37:25 -05:00
Aleix Conchillo Flaqué
34a50033cb
tk: use TkTransportParams in examples
2025-02-25 10:24:24 -08:00
Aleix Conchillo Flaqué
e60b65228b
allow multiple StartFrames
2025-02-25 10:24:04 -08:00
Mark Backman
36a729cbfe
Set grok-2 as default model for GrokLLMSService
2025-02-25 10:00:45 -05:00
Aleix Conchillo Flaqué
d2f006682c
introduce new BaseTaskManager
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
fb7fe540f5
tts: don't connect to websocket if already connected
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
1ec68bd071
make sure we don't create tasks if already created
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
4536d03e82
FrameProcessor: cancel input/push tasks on CancelFrame
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
699704732c
asyncio: re-raise CancelledError in wait_for_task()
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
376d969a77
task: handle StopFrame and StopTaskFrame gracefully
2025-02-24 23:38:51 -08:00
Aleix Conchillo Flaqué
68789dfcf0
frames: add new StopFrame
2025-02-24 21:34:23 -08:00
Aleix Conchillo Flaqué
6028f0f23a
PipelineTask: pass observers in contructor parameter
2025-02-24 21:29:17 -08:00
Aleix Conchillo Flaqué
e9a0959e28
Merge pull request #1283 from pipecat-ai/aleix/check-dangling-tasks
...
PipelineTask: add check_dangling_tasks parameter
2025-02-24 21:26:32 -08:00
Aleix Conchillo Flaqué
07b9be5308
PipelineTask: add check_dangling_tasks parameter
2025-02-24 17:33:10 -08:00
Aleix Conchillo Flaqué
40c2452d6e
google: updgrade OpenAILLMContext to GoogleLLMContext
2025-02-24 15:35:18 -08:00
Aleix Conchillo Flaqué
2110b79507
services(llm): add on_completion_timeout event
2025-02-24 14:55:36 -08:00
Aleix Conchillo Flaqué
fc544fa61c
Merge pull request #1272 from pipecat-ai/aleix/tts-websocket-interruptions
...
services: fix some TTS websocket service interruption handling
2025-02-24 14:54:41 -08:00
Mark Backman
976fe95304
Merge pull request #1279 from pipecat-ai/mb/remove-open-optional-dep
...
Remove `openai` optional dependency from services as it's now required
2025-02-24 17:42:53 -05:00
Aleix Conchillo Flaqué
408270b647
lmnt: don't send "eof" before closing the socket
2025-02-24 14:37:37 -08:00
Mark Backman
3b9b9200ea
Remove openai optional dependency from services as it's now required
2025-02-24 15:05:42 -05:00
Mark Backman
d6f29a0f4b
Update AnthropicLLMService to use claude-3-7-sonnet-20250219 by default
2025-02-24 14:32:00 -05:00
Aleix Conchillo Flaqué
2f3e2da6b9
Merge pull request #1259 from pipecat-ai/openai-not-optional
...
Since the `openai` package is used by pretty much everything in pipec…
2025-02-24 08:45:45 -08:00
allenmylath
45058d4a94
Update audio_buffer_processor.py ( #1266 )
2025-02-24 08:41:19 -08:00
Aleix Conchillo Flaqué
5b637bd826
services: fix some TTS websocket service interruption handling
2025-02-24 08:37:22 -08:00
Aleix Conchillo Flaqué
b29ab8c608
observers: add LLMLogObserver and TranscriptionLogObserver
2025-02-21 15:15:16 -08:00
Aleix Conchillo Flaqué
12bce2e8c0
utils: add support for ellipses in match_endofsentence()
2025-02-21 15:05:50 -08:00
Aleix Conchillo Flaqué
98706d429c
LLMUserContextAggregator: make sure incoming transcription has text
2025-02-21 10:12:54 -08:00
Aleix Conchillo Flaqué
41720b1a13
LLMUserContextAggregator: don't reset timer with interim transcription
...
It turns out that in some cases we only get interim transcriptions (e.g. someone
is speaking very very softly or someone is talking in the background). In those
cases we don't want to interrupt the bot because there's really nothing to
interrupt the bot for.
We originally thought we should interrupt the bot right at the time we got an
interim frame, but this is causing too many false positives. It's actually
better to simply wait for a real transcription before interrupting (in case VAD
didn't interrupt).
2025-02-21 09:05:56 -08:00
Aleix Conchillo Flaqué
3ef4245166
Merge pull request #1265 from pipecat-ai/aleix/transport-remove-audio-out-is-live
2025-02-21 06:51:09 -08:00
Filipi Fuchter
7c7b4c52af
Fixed an issue where EndTaskFrame was not triggering on_client_disconnected or closing the WebSocket in FastAPI.
2025-02-21 09:11:58 -03:00
Aleix Conchillo Flaqué
01f083b7fc
transports: remove TransportParams.audio_out_is_live
2025-02-20 23:33:06 -08:00
Vaibhav159
9c5fe5c85e
fixing deepgram mismatch
2025-02-21 09:32:40 +05:30
