Nathan Straub
d4ec6827ce
services(livekit) - Stop Sending EndFrame when Participant Disconnects
...
How It Works Now:
A participant disconnecting triggers and EndFrame, invoking stop() on the input and output transports and causing the LiveKit room to disconnect.
Proposal:
Match the daily implementation, and just trigger the callbacks in the LiveKitTransport. Leave it up to the implementor to decide whether to send EndFrames when this happens.
2024-10-16 23:53:31 -07:00
Aleix Conchillo Flaqué
e31d1152db
Merge pull request #601 from pipecat-ai/aleix/openai-realtime-misc
...
services(openai): rename OpenAILLMServiceRealtimeBeta to OpenAIRealti…
2024-10-16 16:20:18 -07:00
Mark Backman
55f1ae2564
Adjust log levels for log messages
2024-10-16 17:30:47 -04:00
Kwindla Hultman Kramer
93c9e219ce
fix for message handling bug on initialization
2024-10-16 12:40:20 -07:00
Aleix Conchillo Flaqué
edd44cc181
services(openai): rename OpenAILLMServiceRealtimeBeta to OpenAIRealtimeBetaLLMService
2024-10-16 10:20:19 -07:00
Mark Backman
af5a7e9092
Move metrics from transport to rtvi
2024-10-16 11:33:56 -04:00
Mark Backman
8d9a7486d1
Merge pull request #598 from pipecat-ai/mb/add-daily-metrics-message-frame
...
Comply with RTVI format for sending metrics data via Daily transport
2024-10-16 10:14:44 -04:00
Mark Backman
00d0f9ae48
Comply with RTVI format for sending metrics data
2024-10-16 09:00:38 -04:00
Aleix Conchillo Flaqué
3910aeb4de
transports(daily): don't send messages if not joined
2024-10-15 17:51:01 -07:00
Aleix Conchillo Flaqué
713dcb7a4d
transports(daily): cancel messages task when canceling
2024-10-15 17:51:01 -07:00
Aleix Conchillo Flaqué
04da51c7d8
transport(base_output): push EndFrame downstream at the right time
2024-10-15 17:51:01 -07:00
Aleix Conchillo Flaqué
e52d18e42d
processors(audiobuffer): make functions public
2024-10-15 15:31:59 -07:00
Aleix Conchillo Flaqué
4a71eacac3
rtvi: reset bot transcription with interruptions
2024-10-15 14:58:21 -07:00
Aleix Conchillo Flaqué
f0d89e57ad
frames: some frames need to be SystemFrames
...
We want to process user and bot started/stopped speaking frames as fast as
possible. If we queue them they might be processed too late.
2024-10-15 14:37:56 -07:00
Mark Backman
bb00dbefbc
More edge case handling for text filtering
2024-10-15 14:08:27 -04:00
Aleix Conchillo Flaqué
7bbaf4dfe9
rtvi: merge TTS/TTSText and LLM/LLMText processors
2024-10-15 10:24:43 -07:00
Aleix Conchillo Flaqué
3a3bf3fe34
services(cartesia): schedule TTSStoppedFrame after text
2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué
616aa54f75
ruff formatting
2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué
164f06415c
servcies(cartesia): no need to send LLMFullResponseEndFrame
...
Interruptions are already handled by context aggregators.
2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué
51bc4839d1
transport(base_output): simplify code
2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué
6d778e0491
services: add pts to LLMFullResponseEndFrame in WordTTSService
2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué
90b7f65545
rtvi: add RTVIBotTranscriptionProcessor to send bot-transcription
2024-10-15 10:03:20 -07:00
Kwindla Hultman Kramer
f7b7f0d680
Merge pull request #541 from pipecat-ai/khk/openai-realtime-beta
...
openai realtime beta
2024-10-14 21:02:06 -07:00
Kwindla Hultman Kramer
5431c44e51
remove two debug lines
2024-10-14 21:01:20 -07:00
Kwindla Hultman Kramer
40b3e50815
fix system, consecutive same role, and empty message parsing for anthropic
2024-10-14 20:56:42 -07:00
Kwindla Hultman Kramer
2f6232fac9
fix for initial-messages with single message, and hoisting system message into instructions
2024-10-14 18:14:35 -07:00
Aleix Conchillo Flaqué
b4f2525c76
Merge pull request #585 from pipecat-ai/aleix/daily-urgent-transport-message-hang
...
transports(daily): send transport messages in a task
2024-10-14 16:31:10 -07:00
Aleix Conchillo Flaqué
7b9712daad
transports(daily): send transport messages in a task
...
We queue transport messages and send them in a task to avoid potential hangs by
sending urgent transport messages from a transport event handler.
2024-10-14 16:19:53 -07:00
Kwindla Hultman Kramer
d4269acd67
user started/stopped speaking frames and interruption frames
2024-10-14 16:07:04 -07:00
Kwindla Hultman Kramer
d2ae82fb38
added back in missing LLMFullResponseStartFrame and LLMFullResponseEndFrame
2024-10-14 15:18:50 -07:00
Aleix Conchillo Flaqué
cfada94c13
rtvi: bot-tts-audio messages should also be urgent
2024-10-14 12:46:11 -07:00
Mark Backman
96bfcc3dca
Merge pull request #571 from pipecat-ai/mb/add-code-filtering
...
Add code and table filtering option to MarkdownTextFilter
2024-10-14 12:54:16 -04:00
Mark Backman
b0890b1f75
Code review fixes
2024-10-14 12:52:16 -04:00
Mark Backman
ec0bc7a057
A few bug fixes
2024-10-14 09:44:20 -04:00
Kwindla Hultman Kramer
6f2a464451
conversation save/load for openai, openai-realtime, and anthropic
2024-10-13 18:12:03 -07:00
Kwindla Hultman Kramer
ac4c5ab369
response content item truncation when interrupted
2024-10-13 14:38:04 -07:00
Kwindla Hultman Kramer
9e95419301
much cleanup
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
f390ec9608
temp commit; debugging
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
ce8a83efba
tools frame support and wip message resetting/loading
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
e5a2bf9564
context management improvements
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
7838018686
fix default response properties getting appended to ResponseCreateEvent
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
31916ed9fd
turn on/off openai vad
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
3a2fbc2b19
send user started/stopped speaking event from openai realtime events
...
send user started/stopped speaking event from openai realtime events
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
43520b44da
add 'failed' case to Response event object
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
ab4a8d791a
RTVI processors should use TextFrame not TextFrame and all subclasses
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
40dc546b81
function call fix and user transcription frames
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
5426891feb
added input audio pause setting. no frame to update that state, yet.
2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer
1c5ccd3406
fixes for settings updates, context updates, and response creation
2024-10-12 21:58:11 -07:00
Mark Backman
3a745bfa3f
Handle self._context of None
2024-10-12 21:58:11 -07:00
Mark Backman
ac4e39991e
Update ai_services for OpenAI Realtime param inputs
2024-10-12 21:58:11 -07:00
