Aleix Conchillo Flaqué
4c629e538e
processors(realtime-ai): add assistant before output transport
...
Cartesia can do word-to-word output instead of full sentences. This means that
for properly adding things into the context we need to add it before the
transport, otherwise some words might be lost.
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
f6e22bb3b9
processors(realtime-ai): add silero vad to the transport
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
46a048d7f6
processors(realtime-ai): allow default setup to be None
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
bd9f4eea06
processors(realtime-ai): provide default values
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
0a672e61e2
processors(realtime-ai): update it to use groq by default
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
29a8530221
processors(realtime-ai): add support for updating config (model, voice...)
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
3e738642a7
processors(realtime-ai): add support for getting/updating LLM context
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
9f012c8002
processors: add new RealtimeAIProcessor
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
0a69a9e5ef
transport(daily): also accept TransportMessageFrame
2024-07-22 09:32:18 -07:00
Aleix Conchillo Flaqué
194790183a
processor: add support for setting a processor parent
2024-07-22 09:32:18 -07:00
weedge
e5363f65f0
fix: push_frame use TextFrame
...
Signed-off-by: weedge <weege007@gmail.com >
2024-07-22 17:29:06 +08:00
Lewis Wolfgang
f9fdadb4c0
Allow openai http connections to remain open in the pool indefinitely.
...
Rather than expiring in 5 seconds.
2024-07-18 11:18:21 -04:00
Aleix Conchillo Flaqué
37027f68cb
remove LLMResponseStartFrame and LLMResponseEndFrame
...
This was added in the past to properly handle interruptions for the
LLMAssistantContextAggregator. But this is not necessary anymore since we can
handle interruptions by just processing the StartInterruptionFrame, so there's
no need for these extra frames.
2024-07-17 20:53:35 -07:00
Kwindla Hultman Kramer
355fe01cb7
fixed forgotten renames
2024-07-17 20:28:27 -07:00
Kwindla Hultman Kramer
fa53c67606
comments re fixes
2024-07-17 18:30:45 -07:00
Kwindla Hultman Kramer
2204b8e205
cartesia streaming and context management via word-level timestamps
2024-07-17 15:17:00 -07:00
Kwindla Hultman Kramer
270007b17c
wip - using cartesia word timestamps for context management
2024-07-17 14:13:52 -07:00
Kwindla Hultman Kramer
568eb2ef4c
cartesia websockets and streaming
2024-07-17 14:13:52 -07:00
Kwindla Hultman Kramer
73ca9184a8
wip cartesia continuation (not working yet)
2024-07-17 14:13:52 -07:00
TomTom101
da2082b025
chore: Combined combinable lookaheads
2024-07-06 11:11:40 +02:00
TomTom101
327ea9d547
chore: Make it a const
2024-07-06 11:08:51 +02:00
TomTom101
b23db4a202
chore: commented regex
2024-07-06 11:06:52 +02:00
TomTom101
d1a36004ab
fix: No more falsely detect a sentence end on "U.S.A", "3:00 a.m." and more
2024-07-06 11:01:32 +02:00
Aleix Conchillo Flaqué
b9b0bcdcbd
services(azure): close the audio stream on exit
2024-07-02 10:11:35 -07:00
Aleix Conchillo Flaqué
5bcece56f3
services(cartesia): make sure we close the client on exit
2024-07-02 10:11:16 -07:00
Aleix Conchillo Flaqué
82e93a0560
use exclude_none=True when dumping BaseModels
2024-07-02 08:03:31 -07:00
Aleix Conchillo Flaqué
a9a82c083b
services: add GladiaSTTService support
2024-07-02 08:03:29 -07:00
Aleix Conchillo Flaqué
be14ce465d
transports(daily): make sure we don't send data if client is closed
2024-07-01 18:26:13 -07:00
Aleix Conchillo Flaqué
535514f506
processors: added new UserIdleProcessor
2024-07-01 18:17:43 -07:00
Aleix Conchillo Flaqué
933b63cf13
processors: added new IdleFrameProcessor
2024-07-01 14:57:42 -07:00
Aleix Conchillo Flaqué
d7c3e380a5
added BotSpeakingFrame
2024-07-01 14:57:18 -07:00
Aleix Conchillo Flaqué
c5298f78cb
add more missing keyword-only arguments
2024-07-01 12:34:53 -07:00
Aleix Conchillo Flaqué
5018a552c1
services(xtts): no need the WAV header
2024-07-01 10:44:32 -07:00
Aleix Conchillo Flaqué
7f9fd9ffce
examples: added 07i-interruptible-xtts
2024-07-01 10:41:34 -07:00
Aleix Conchillo Flaqué
06f817c7e3
transport(websocket): don't send if serializer returns None
2024-07-01 10:27:26 -07:00
Aleix Conchillo Flaqué
df4c3e56c4
services: add missing * keyword separator
2024-07-01 10:27:26 -07:00
Aleix Conchillo Flaqué
9d5c2b9656
Merge pull request #276 from eddieoz/feature/xtts
...
Added service XTTS
2024-07-01 10:26:53 -07:00
eddieoz
7ce59c5e2e
added service xtts
2024-07-01 20:17:19 +03:00
Aleix Conchillo Flaqué
efbe7297f7
vad(silero): allow specifying a Silero VAD version
2024-07-01 09:38:43 -07:00
Aleix Conchillo Flaqué
cbf5a6362c
add new AsyncFrameProcessor and AsyncAIService
2024-07-01 09:37:02 -07:00
Aleix Conchillo Flaqué
fc0920504d
improve error handling and don't swallow exceptions
2024-07-01 09:35:45 -07:00
Aleix Conchillo Flaqué
c3244fdd7a
transports(websocket): don't send data if websocket closed
2024-07-01 09:31:58 -07:00
Aleix Conchillo Flaqué
fd5d879bf5
add support for processing metrics
...
Processing metrics indicate how much time a processor takes to generate all of
its output.
2024-06-28 14:26:57 -07:00
Aleix Conchillo Flaqué
cce1ddb183
vad: fix Silero VAD required number of frames
2024-06-28 10:45:48 -07:00
Aleix Conchillo Flaqué
8691d14289
Merge pull request #255 from Viking5274/main
...
Fix twilio error
2024-06-26 10:17:03 -07:00
daniil5701133
dd402da9e5
added handling streamSid after first wss connect
...
fixx name
2024-06-26 18:56:30 +03:00
Aleix Conchillo Flaqué
4be3e8c87d
aggregators: revert using intermediate results
2024-06-25 21:33:17 -07:00
Aleix Conchillo Flaqué
dac033fe61
services(azure): allow transcriptions during interruptions
...
If the user interrupts we can't just discard transcriptions because the user is
actually interrupting and talking.
2024-06-25 21:33:06 -07:00
Aleix Conchillo Flaqué
d302cbb114
services(deepgram): allow transcriptions during interruptions
...
If the user interrupts we can't just discard transcriptions because the user is
actually interrupting and talking.
2024-06-25 21:32:21 -07:00
Aleix Conchillo Flaqué
4f38d989f5
services(cartesia): upgrade to new cartesia 1.0.0
2024-06-25 11:51:34 -07:00
