Kwindla Hultman Kramer
|
93c9e219ce
|
fix for message handling bug on initialization
|
2024-10-16 12:40:20 -07:00 |
|
Aleix Conchillo Flaqué
|
edd44cc181
|
services(openai): rename OpenAILLMServiceRealtimeBeta to OpenAIRealtimeBetaLLMService
|
2024-10-16 10:20:19 -07:00 |
|
Mark Backman
|
af5a7e9092
|
Move metrics from transport to rtvi
|
2024-10-16 11:33:56 -04:00 |
|
Mark Backman
|
8d9a7486d1
|
Merge pull request #598 from pipecat-ai/mb/add-daily-metrics-message-frame
Comply with RTVI format for sending metrics data via Daily transport
|
2024-10-16 10:14:44 -04:00 |
|
Mark Backman
|
00d0f9ae48
|
Comply with RTVI format for sending metrics data
|
2024-10-16 09:00:38 -04:00 |
|
Aleix Conchillo Flaqué
|
3910aeb4de
|
transports(daily): don't send messages if not joined
|
2024-10-15 17:51:01 -07:00 |
|
Aleix Conchillo Flaqué
|
713dcb7a4d
|
transports(daily): cancel messages task when canceling
|
2024-10-15 17:51:01 -07:00 |
|
Aleix Conchillo Flaqué
|
04da51c7d8
|
transport(base_output): push EndFrame downstream at the right time
|
2024-10-15 17:51:01 -07:00 |
|
Aleix Conchillo Flaqué
|
e52d18e42d
|
processors(audiobuffer): make functions public
|
2024-10-15 15:31:59 -07:00 |
|
Aleix Conchillo Flaqué
|
4a71eacac3
|
rtvi: reset bot transcription with interruptions
|
2024-10-15 14:58:21 -07:00 |
|
Aleix Conchillo Flaqué
|
f0d89e57ad
|
frames: some frames need to be SystemFrames
We want to process user and bot started/stopped speaking frames as fast as
possible. If we queue them they might be processed too late.
|
2024-10-15 14:37:56 -07:00 |
|
Mark Backman
|
bb00dbefbc
|
More edge case handling for text filtering
|
2024-10-15 14:08:27 -04:00 |
|
Aleix Conchillo Flaqué
|
7bbaf4dfe9
|
rtvi: merge TTS/TTSText and LLM/LLMText processors
|
2024-10-15 10:24:43 -07:00 |
|
Aleix Conchillo Flaqué
|
3a3bf3fe34
|
services(cartesia): schedule TTSStoppedFrame after text
|
2024-10-15 10:06:28 -07:00 |
|
Aleix Conchillo Flaqué
|
616aa54f75
|
ruff formatting
|
2024-10-15 10:06:28 -07:00 |
|
Aleix Conchillo Flaqué
|
164f06415c
|
servcies(cartesia): no need to send LLMFullResponseEndFrame
Interruptions are already handled by context aggregators.
|
2024-10-15 10:06:28 -07:00 |
|
Aleix Conchillo Flaqué
|
51bc4839d1
|
transport(base_output): simplify code
|
2024-10-15 10:06:28 -07:00 |
|
Aleix Conchillo Flaqué
|
6d778e0491
|
services: add pts to LLMFullResponseEndFrame in WordTTSService
|
2024-10-15 10:06:28 -07:00 |
|
Aleix Conchillo Flaqué
|
90b7f65545
|
rtvi: add RTVIBotTranscriptionProcessor to send bot-transcription
|
2024-10-15 10:03:20 -07:00 |
|
Kwindla Hultman Kramer
|
f7b7f0d680
|
Merge pull request #541 from pipecat-ai/khk/openai-realtime-beta
openai realtime beta
|
2024-10-14 21:02:06 -07:00 |
|
Kwindla Hultman Kramer
|
5431c44e51
|
remove two debug lines
|
2024-10-14 21:01:20 -07:00 |
|
Kwindla Hultman Kramer
|
40b3e50815
|
fix system, consecutive same role, and empty message parsing for anthropic
|
2024-10-14 20:56:42 -07:00 |
|
Kwindla Hultman Kramer
|
2f6232fac9
|
fix for initial-messages with single message, and hoisting system message into instructions
|
2024-10-14 18:14:35 -07:00 |
|
Aleix Conchillo Flaqué
|
b4f2525c76
|
Merge pull request #585 from pipecat-ai/aleix/daily-urgent-transport-message-hang
transports(daily): send transport messages in a task
|
2024-10-14 16:31:10 -07:00 |
|
Aleix Conchillo Flaqué
|
7b9712daad
|
transports(daily): send transport messages in a task
We queue transport messages and send them in a task to avoid potential hangs by
sending urgent transport messages from a transport event handler.
|
2024-10-14 16:19:53 -07:00 |
|
Kwindla Hultman Kramer
|
d4269acd67
|
user started/stopped speaking frames and interruption frames
|
2024-10-14 16:07:04 -07:00 |
|
Kwindla Hultman Kramer
|
d2ae82fb38
|
added back in missing LLMFullResponseStartFrame and LLMFullResponseEndFrame
|
2024-10-14 15:18:50 -07:00 |
|
Aleix Conchillo Flaqué
|
cfada94c13
|
rtvi: bot-tts-audio messages should also be urgent
|
2024-10-14 12:46:11 -07:00 |
|
Mark Backman
|
96bfcc3dca
|
Merge pull request #571 from pipecat-ai/mb/add-code-filtering
Add code and table filtering option to MarkdownTextFilter
|
2024-10-14 12:54:16 -04:00 |
|
Mark Backman
|
b0890b1f75
|
Code review fixes
|
2024-10-14 12:52:16 -04:00 |
|
Mark Backman
|
ec0bc7a057
|
A few bug fixes
|
2024-10-14 09:44:20 -04:00 |
|
Kwindla Hultman Kramer
|
6f2a464451
|
conversation save/load for openai, openai-realtime, and anthropic
|
2024-10-13 18:12:03 -07:00 |
|
Kwindla Hultman Kramer
|
ac4c5ab369
|
response content item truncation when interrupted
|
2024-10-13 14:38:04 -07:00 |
|
Kwindla Hultman Kramer
|
9e95419301
|
much cleanup
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
f390ec9608
|
temp commit; debugging
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
ce8a83efba
|
tools frame support and wip message resetting/loading
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
e5a2bf9564
|
context management improvements
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
7838018686
|
fix default response properties getting appended to ResponseCreateEvent
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
31916ed9fd
|
turn on/off openai vad
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
3a2fbc2b19
|
send user started/stopped speaking event from openai realtime events
send user started/stopped speaking event from openai realtime events
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
43520b44da
|
add 'failed' case to Response event object
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
ab4a8d791a
|
RTVI processors should use TextFrame not TextFrame and all subclasses
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
40dc546b81
|
function call fix and user transcription frames
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
5426891feb
|
added input audio pause setting. no frame to update that state, yet.
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
1c5ccd3406
|
fixes for settings updates, context updates, and response creation
|
2024-10-12 21:58:11 -07:00 |
|
Mark Backman
|
3a745bfa3f
|
Handle self._context of None
|
2024-10-12 21:58:11 -07:00 |
|
Mark Backman
|
ac4e39991e
|
Update ai_services for OpenAI Realtime param inputs
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
c870832da6
|
types seem complete; some ws error handling
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
e782016c57
|
renamed a file
|
2024-10-12 21:58:11 -07:00 |
|
Kwindla Hultman Kramer
|
00badaf98e
|
more pydantic cleanup
|
2024-10-12 21:58:11 -07:00 |
|