Aleix Conchillo Flaqué
c1170260b5
processors(rtvi): use generic LLM and TTS names
2024-07-22 15:27:33 -07:00
Aleix Conchillo Flaqué
65cdf50774
processors(rtvi): fix task cleanup
2024-07-22 15:01:45 -07:00
Aleix Conchillo Flaqué
9233bb490c
processors(rtvi): add support for "tts-text" messages
2024-07-22 11:40:17 -07:00
Aleix Conchillo Flaqué
43932220f7
processors(rtvi): use only user-transcription
2024-07-22 09:40:16 -07:00
Aleix Conchillo Flaqué
cea4d1894e
processors(rtvi): change voice before LLM updates
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
80baa0358d
processors(rtvi): lable is now rtvi
2024-07-22 09:32:18 -07:00
Chad Bailey
5d73db53a0
initial pseudo function calling
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
302ea90dce
processors(rtvi): messages now require an id
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
37b04ed283
processors(rtvi): use send a type=response as command responses
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
be6995cfdf
processors(rtvi): renamed realtime-ai to rtvi
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
dfbc11300c
processors(realtime-ai): use label instead of tag
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
82d539d174
processors(realtime-ai): add support for interrupting the bot
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
6fbf98d8e2
processors(realtime-ai): llm-context now uses a data field
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
f094c42728
processors(realtime-ai): add transcription messages
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
13827e1282
processors(realtime-ai): send a successful response for every command
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
32170b47d9
processors(realtime-ai): add user-[start|stopped]-speaking messages
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
09c05354c2
processors(realtime-ai): fix voice initialization
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
b0b1475563
processors(realtime-ai): add support making TTS to speak
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
b85dd7283a
processors(realtime-ai): add support for appending to the LLM context
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
846ae765e5
services(TTSService): fix sentence cleanup
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
4c629e538e
processors(realtime-ai): add assistant before output transport
...
Cartesia can do word-to-word output instead of full sentences. This means that
for properly adding things into the context we need to add it before the
transport, otherwise some words might be lost.
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
f6e22bb3b9
processors(realtime-ai): add silero vad to the transport
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
46a048d7f6
processors(realtime-ai): allow default setup to be None
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
bd9f4eea06
processors(realtime-ai): provide default values
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
0a672e61e2
processors(realtime-ai): update it to use groq by default
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
29a8530221
processors(realtime-ai): add support for updating config (model, voice...)
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
3e738642a7
processors(realtime-ai): add support for getting/updating LLM context
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
9f012c8002
processors: add new RealtimeAIProcessor
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
0a69a9e5ef
transport(daily): also accept TransportMessageFrame
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
194790183a
processor: add support for setting a processor parent
2024-07-22 09:32:18 -07:00
weedge
e5363f65f0
fix: push_frame use TextFrame
...
Signed-off-by: weedge <weege007@gmail.com >
2024-07-22 17:29:06 +08:00
Lewis Wolfgang
f9fdadb4c0
Allow openai http connections to remain open in the pool indefinitely.
...
Rather than expiring in 5 seconds.
2024-07-18 11:18:21 -04:00
Aleix Conchillo Flaqué
37027f68cb
remove LLMResponseStartFrame and LLMResponseEndFrame
...
This was added in the past to properly handle interruptions for the
LLMAssistantContextAggregator. But this is not necessary anymore since we can
handle interruptions by just processing the StartInterruptionFrame, so there's
no need for these extra frames.
2024-07-17 20:53:35 -07:00
Kwindla Hultman Kramer
355fe01cb7
fixed forgotten renames
2024-07-17 20:28:27 -07:00
Kwindla Hultman Kramer
fa53c67606
comments re fixes
2024-07-17 18:30:45 -07:00
Kwindla Hultman Kramer
2204b8e205
cartesia streaming and context management via word-level timestamps
2024-07-17 15:17:00 -07:00
Kwindla Hultman Kramer
270007b17c
wip - using cartesia word timestamps for context management
2024-07-17 14:13:52 -07:00
Kwindla Hultman Kramer
568eb2ef4c
cartesia websockets and streaming
2024-07-17 14:13:52 -07:00
Kwindla Hultman Kramer
73ca9184a8
wip cartesia continuation (not working yet)
2024-07-17 14:13:52 -07:00
TomTom101
da2082b025
chore: Combined combinable lookaheads
2024-07-06 11:11:40 +02:00
TomTom101
327ea9d547
chore: Make it a const
2024-07-06 11:08:51 +02:00
TomTom101
b23db4a202
chore: commented regex
2024-07-06 11:06:52 +02:00
TomTom101
d1a36004ab
fix: No more falsely detect a sentence end on "U.S.A", "3:00 a.m." and more
2024-07-06 11:01:32 +02:00
Aleix Conchillo Flaqué
b9b0bcdcbd
services(azure): close the audio stream on exit
2024-07-02 10:11:35 -07:00
Aleix Conchillo Flaqué
5bcece56f3
services(cartesia): make sure we close the client on exit
2024-07-02 10:11:16 -07:00
Aleix Conchillo Flaqué
82e93a0560
use exclude_none=True when dumping BaseModels
2024-07-02 08:03:31 -07:00
Aleix Conchillo Flaqué
a9a82c083b
services: add GladiaSTTService support
2024-07-02 08:03:29 -07:00
Aleix Conchillo Flaqué
be14ce465d
transports(daily): make sure we don't send data if client is closed
2024-07-01 18:26:13 -07:00
Aleix Conchillo Flaqué
535514f506
processors: added new UserIdleProcessor
2024-07-01 18:17:43 -07:00
Aleix Conchillo Flaqué
933b63cf13
processors: added new IdleFrameProcessor
2024-07-01 14:57:42 -07:00
