901 Commits

Author	SHA1	Message	Date
Aleix Conchillo Flaqué	3910aeb4de	transports(daily): don't send messages if not joined	2024-10-15 17:51:01 -07:00
Aleix Conchillo Flaqué	713dcb7a4d	transports(daily): cancel messages task when canceling	2024-10-15 17:51:01 -07:00
Aleix Conchillo Flaqué	04da51c7d8	transport(base_output): push EndFrame downstream at the right time	2024-10-15 17:51:01 -07:00
Aleix Conchillo Flaqué	e52d18e42d	processors(audiobuffer): make functions public	2024-10-15 15:31:59 -07:00
Aleix Conchillo Flaqué	4a71eacac3	rtvi: reset bot transcription with interruptions	2024-10-15 14:58:21 -07:00
Aleix Conchillo Flaqué	f0d89e57ad	frames: some frames need to be SystemFrames ... We want to process user and bot started/stopped speaking frames as fast as possible. If we queue them they might be processed too late.	2024-10-15 14:37:56 -07:00
Mark Backman	bb00dbefbc	More edge case handling for text filtering	2024-10-15 14:08:27 -04:00
Aleix Conchillo Flaqué	7bbaf4dfe9	rtvi: merge TTS/TTSText and LLM/LLMText processors	2024-10-15 10:24:43 -07:00
Aleix Conchillo Flaqué	3a3bf3fe34	services(cartesia): schedule TTSStoppedFrame after text	2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué	616aa54f75	ruff formatting	2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué	164f06415c	servcies(cartesia): no need to send LLMFullResponseEndFrame ... Interruptions are already handled by context aggregators.	2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué	51bc4839d1	transport(base_output): simplify code	2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué	6d778e0491	services: add pts to LLMFullResponseEndFrame in WordTTSService	2024-10-15 10:06:28 -07:00
Aleix Conchillo Flaqué	90b7f65545	rtvi: add RTVIBotTranscriptionProcessor to send bot-transcription	2024-10-15 10:03:20 -07:00
Kwindla Hultman Kramer	f7b7f0d680	Merge pull request #541 from pipecat-ai/khk/openai-realtime-beta ... openai realtime beta	2024-10-14 21:02:06 -07:00
Kwindla Hultman Kramer	5431c44e51	remove two debug lines	2024-10-14 21:01:20 -07:00
Kwindla Hultman Kramer	40b3e50815	fix system, consecutive same role, and empty message parsing for anthropic	2024-10-14 20:56:42 -07:00
Kwindla Hultman Kramer	2f6232fac9	fix for initial-messages with single message, and hoisting system message into instructions	2024-10-14 18:14:35 -07:00
Aleix Conchillo Flaqué	b4f2525c76	Merge pull request #585 from pipecat-ai/aleix/daily-urgent-transport-message-hang ... transports(daily): send transport messages in a task	2024-10-14 16:31:10 -07:00
Aleix Conchillo Flaqué	7b9712daad	transports(daily): send transport messages in a task ... We queue transport messages and send them in a task to avoid potential hangs by sending urgent transport messages from a transport event handler.	2024-10-14 16:19:53 -07:00
Kwindla Hultman Kramer	d4269acd67	user started/stopped speaking frames and interruption frames	2024-10-14 16:07:04 -07:00
Kwindla Hultman Kramer	d2ae82fb38	added back in missing LLMFullResponseStartFrame and LLMFullResponseEndFrame	2024-10-14 15:18:50 -07:00
Aleix Conchillo Flaqué	cfada94c13	rtvi: bot-tts-audio messages should also be urgent	2024-10-14 12:46:11 -07:00
Mark Backman	96bfcc3dca	Merge pull request #571 from pipecat-ai/mb/add-code-filtering ... Add code and table filtering option to MarkdownTextFilter	2024-10-14 12:54:16 -04:00
Mark Backman	b0890b1f75	Code review fixes	2024-10-14 12:52:16 -04:00
Mark Backman	ec0bc7a057	A few bug fixes	2024-10-14 09:44:20 -04:00
Kwindla Hultman Kramer	6f2a464451	conversation save/load for openai, openai-realtime, and anthropic	2024-10-13 18:12:03 -07:00
Kwindla Hultman Kramer	ac4c5ab369	response content item truncation when interrupted	2024-10-13 14:38:04 -07:00
Kwindla Hultman Kramer	9e95419301	much cleanup	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	f390ec9608	temp commit; debugging	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	ce8a83efba	tools frame support and wip message resetting/loading	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	e5a2bf9564	context management improvements	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	7838018686	fix default response properties getting appended to ResponseCreateEvent	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	31916ed9fd	turn on/off openai vad	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	3a2fbc2b19	send user started/stopped speaking event from openai realtime events ... send user started/stopped speaking event from openai realtime events	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	43520b44da	add 'failed' case to Response event object	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	ab4a8d791a	RTVI processors should use TextFrame not TextFrame and all subclasses	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	40dc546b81	function call fix and user transcription frames	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	5426891feb	added input audio pause setting. no frame to update that state, yet.	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	1c5ccd3406	fixes for settings updates, context updates, and response creation	2024-10-12 21:58:11 -07:00
Mark Backman	3a745bfa3f	Handle self._context of None	2024-10-12 21:58:11 -07:00
Mark Backman	ac4e39991e	Update ai_services for OpenAI Realtime param inputs	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	c870832da6	types seem complete; some ws error handling	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	e782016c57	renamed a file	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	00badaf98e	more pydantic cleanup	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	7dfac0163b	bits of pydantic	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	09a3c2a82d	major functionality working (not configurable, occasional timing bugs maybe)	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	c32c65014b	definitely broke something in the pipeline	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	f082eb10a2	small cleanup	2024-10-12 21:58:11 -07:00
Kwindla Hultman Kramer	b8898e449e	lots of debugging statements. multiple function calls broken	2024-10-12 21:58:11 -07:00