Commit Graph

1381 Commits

Author SHA1 Message Date
Kwindla Hultman Kramer
e7ccaed56c temp commit; debugging 2024-10-10 15:34:25 -07:00
Kwindla Hultman Kramer
07124bfafc tools frame support and wip message resetting/loading 2024-10-09 11:03:53 -07:00
Kwindla Hultman Kramer
df2ddb4b91 context management improvements 2024-10-08 17:47:32 -07:00
Kwindla Hultman Kramer
0db5c86494 fix default response properties getting appended to ResponseCreateEvent 2024-10-08 08:55:49 -07:00
Kwindla Hultman Kramer
d0cdb496e4 turn on/off openai vad 2024-10-07 22:09:18 -07:00
Kwindla Hultman Kramer
b640b2d024 send user started/stopped speaking event from openai realtime events
send user started/stopped speaking event from openai realtime events
2024-10-07 21:00:18 -07:00
Kwindla Hultman Kramer
bd0649e3ed add 'failed' case to Response event object 2024-10-07 20:34:39 -07:00
Kwindla Hultman Kramer
711d9a1021 RTVI processors should use TextFrame not TextFrame and all subclasses 2024-10-07 18:34:52 -07:00
Kwindla Hultman Kramer
e856566c30 function call fix and user transcription frames 2024-10-07 18:34:52 -07:00
Kwindla Hultman Kramer
996c337dd1 added input audio pause setting. no frame to update that state, yet. 2024-10-07 18:34:52 -07:00
Kwindla Hultman Kramer
856a0e321b fixes for settings updates, context updates, and response creation 2024-10-07 18:34:52 -07:00
Mark Backman
425ad3e90d Handle self._context of None 2024-10-07 18:34:52 -07:00
Mark Backman
d13137c99f Update ai_services for OpenAI Realtime param inputs 2024-10-07 18:34:32 -07:00
Kwindla Hultman Kramer
687fd97b63 types seem complete; some ws error handling 2024-10-07 18:32:51 -07:00
Kwindla Hultman Kramer
b2aaad43f0 renamed a file 2024-10-07 18:32:51 -07:00
Kwindla Hultman Kramer
8cae729181 more pydantic cleanup 2024-10-07 18:32:51 -07:00
Kwindla Hultman Kramer
71fe09f7f0 bits of pydantic 2024-10-07 18:32:51 -07:00
Kwindla Hultman Kramer
7ae3c420f4 major functionality working (not configurable, occasional timing bugs maybe) 2024-10-07 18:32:51 -07:00
Kwindla Hultman Kramer
830a36319c definitely broke something in the pipeline 2024-10-07 18:32:50 -07:00
Kwindla Hultman Kramer
2abf70527a small cleanup 2024-10-07 18:32:50 -07:00
Kwindla Hultman Kramer
b4214b56b3 lots of debugging statements. multiple function calls broken 2024-10-07 18:32:50 -07:00
Kwindla Hultman Kramer
8565655f08 space exploration prompt 2024-10-07 18:32:50 -07:00
Kwindla Hultman Kramer
fa3a6647ef configurability via constructor 2024-10-07 18:32:50 -07:00
Kwindla Hultman Kramer
efd3627202 working 19-openai-realtime-beta.py example 2024-10-07 18:32:50 -07:00
Kwindla Hultman Kramer
cc94ec179c beginning of realtime impl 2024-10-07 18:32:50 -07:00
Aleix Conchillo Flaqué
3403197a90 Merge pull request #552 from pipecat-ai/aleix/rtvi-user-llm-text
rtvi: add RTVIUserLLMTextProcessor
2024-10-07 08:33:29 -07:00
Aleix Conchillo Flaqué
8cdb9ab1ad rtvi: internal transport message should be urgent 2024-10-07 08:04:14 -07:00
Mark Backman
5dbf26d283 Handle cases where text is either a list or a string 2024-10-07 07:21:32 -04:00
Mark Backman
8001bab9b0 Remove another instance of urgent=true 2024-10-07 06:58:32 -04:00
Aleix Conchillo Flaqué
12d0686adc rtvi: rename bot-audio to bot-tts-audio 2024-10-06 16:50:55 -07:00
Aleix Conchillo Flaqué
a28a5e954a add TransportMessageSystemFrame 2024-10-06 16:50:12 -07:00
Aleix Conchillo Flaqué
bb966a89d2 rtvi: add RTVIUserLLMTextProcessor 2024-10-06 01:05:58 -07:00
Aleix Conchillo Flaqué
4a74eb3321 use isinstance tuples 2024-10-06 00:45:27 -07:00
Aleix Conchillo Flaqué
1f54ee6991 pyproject: update deepgram to 3.7.3 2024-10-06 00:40:47 -07:00
Mark Backman
ea2a05a04b Merge pull request #545 from pipecat-ai/mb/fix-language-handling
Improve language string handling for TTS services
2024-10-04 10:03:06 -04:00
Mark Backman
5692ca586c Merge pull request #547 from pipecat-ai/mb/update-test-requirements
Update fastapi version in test-requirements.txt
2024-10-04 08:28:05 -04:00
Mark Backman
a11ad81f02 Update fastapi version in test-requirements.txt 2024-10-04 07:35:48 -04:00
Mark Backman
c49b31e6ad Add CHANGELOG entry 2024-10-03 23:13:59 -04:00
Mark Backman
7796a272ce Improve language handling for TTS services 2024-10-03 23:09:27 -04:00
Mark Backman
27dcf83f37 Merge pull request #543 from pipecat-ai/mb/fix-deepgram-stt-language
Deepgram: disconnect and reconnect on language change
2024-10-03 12:40:27 -04:00
Mark Backman
72db83528d Update changelog 2024-10-03 12:37:26 -04:00
Mark Backman
45c7d36b2e Deepgram: disconnect and reconnect on language change 2024-10-03 12:31:42 -04:00
Aleix Conchillo Flaqué
65eeb0f1f6 Merge pull request #540 from pipecat-ai/cb/interruption-fix
Fixed RTVI `tts:interrupt` action not interrupting
v0.0.42
2024-10-02 13:46:52 -07:00
Aleix Conchillo Flaqué
1d7d0bb1ea Merge pull request #539 from pipecat-ai/aleix/pipecat-0.0.42-fixes
pipecat 0.0.42 fixes
2024-10-02 13:34:28 -07:00
Aleix Conchillo Flaqué
598936bc53 services: apply service language code before using service 2024-10-02 13:30:01 -07:00
Chad Bailey
b1bf6f7733 fixed botinterruptionframe 2024-10-02 19:43:51 +00:00
Aleix Conchillo Flaqué
75d27aeb9f examples(storytelling): update packages 2024-10-02 12:00:00 -07:00
Aleix Conchillo Flaqué
0a37caf4b4 openai: fix image json logging 2024-10-02 11:57:50 -07:00
Aleix Conchillo Flaqué
6db65f4335 cartesia: use model_name instead of model_id 2024-10-02 11:57:36 -07:00
Aleix Conchillo Flaqué
3648874301 gladia: fix languages 2024-10-02 11:57:25 -07:00