Commit Graph

  • d13137c99f Update ai_services for OpenAI Realtime param inputs Mark Backman 2024-10-07 13:25:17 -04:00
  • 687fd97b63 types seem complete; some ws error handling Kwindla Hultman Kramer 2024-10-06 21:52:48 -07:00
  • b2aaad43f0 renamed a file Kwindla Hultman Kramer 2024-10-06 19:52:13 -07:00
  • 8cae729181 more pydantic cleanup Kwindla Hultman Kramer 2024-10-06 16:39:11 -07:00
  • 71fe09f7f0 bits of pydantic Kwindla Hultman Kramer 2024-10-06 08:13:37 -07:00
  • 7ae3c420f4 major functionality working (not configurable, occasional timing bugs maybe) Kwindla Hultman Kramer 2024-10-04 15:01:57 -07:00
  • 830a36319c definitely broke something in the pipeline Kwindla Hultman Kramer 2024-10-04 13:37:17 -07:00
  • 2abf70527a small cleanup Kwindla Hultman Kramer 2024-10-04 08:53:48 -07:00
  • b4214b56b3 lots of debugging statements. multiple function calls broken Kwindla Hultman Kramer 2024-10-03 22:36:18 -07:00
  • 8565655f08 space exploration prompt Kwindla Hultman Kramer 2024-10-03 12:15:16 -07:00
  • fa3a6647ef configurability via constructor Kwindla Hultman Kramer 2024-10-02 16:26:22 -07:00
  • efd3627202 working 19-openai-realtime-beta.py example Kwindla Hultman Kramer 2024-10-02 14:24:06 -07:00
  • cc94ec179c beginning of realtime impl Kwindla Hultman Kramer 2024-10-01 21:21:43 -07:00
  • 3403197a90 Merge pull request #552 from pipecat-ai/aleix/rtvi-user-llm-text Aleix Conchillo Flaqué 2024-10-07 08:33:29 -07:00
  • 8cdb9ab1ad rtvi: internal transport message should be urgent Aleix Conchillo Flaqué 2024-10-07 08:04:14 -07:00
  • 5dbf26d283 Handle cases where text is either a list or a string Mark Backman 2024-10-07 07:21:32 -04:00
  • 8001bab9b0 Remove another instance of urgent=true Mark Backman 2024-10-07 06:58:32 -04:00
  • 12d0686adc rtvi: rename bot-audio to bot-tts-audio Aleix Conchillo Flaqué 2024-10-06 16:50:55 -07:00
  • a28a5e954a add TransportMessageSystemFrame Aleix Conchillo Flaqué 2024-10-06 16:47:10 -07:00
  • bb966a89d2 rtvi: add RTVIUserLLMTextProcessor Aleix Conchillo Flaqué 2024-10-06 01:02:22 -07:00
  • 4a74eb3321 use isinstance tuples Aleix Conchillo Flaqué 2024-10-06 00:45:27 -07:00
  • 1f54ee6991 pyproject: update deepgram to 3.7.3 Aleix Conchillo Flaqué 2024-10-06 00:40:47 -07:00
  • 40af3571f0 Create Frames.md Allenmylath 2024-10-05 22:04:03 +05:30
  • 86143f79a1 use new InputAudioRawFrame and OutputAudioRawFrame joachimchauvet 2024-10-05 14:16:44 +03:00
  • b373bc82b5 match behavior of Daily's on_first_participant_joined joachimchauvet 2024-10-01 10:48:34 +03:00
  • ea2a05a04b Merge pull request #545 from pipecat-ai/mb/fix-language-handling Mark Backman 2024-10-04 10:03:06 -04:00
  • 5692ca586c Merge pull request #547 from pipecat-ai/mb/update-test-requirements Mark Backman 2024-10-04 08:28:05 -04:00
  • a11ad81f02 Update fastapi version in test-requirements.txt Mark Backman 2024-10-04 07:35:48 -04:00
  • 805efdb144 Update README.md Allenmylath 2024-10-04 10:19:38 +05:30
  • c49b31e6ad Add CHANGELOG entry Mark Backman 2024-10-03 23:13:59 -04:00
  • 7796a272ce Improve language handling for TTS services Mark Backman 2024-10-03 22:51:15 -04:00
  • 678e87fd31 comment back in some code Adrian Cowham 2024-10-03 14:12:23 -07:00
  • 4d81a2ebfe nuked the code that marks user audio in favor for InputAudioRawFrame. also moving to stereo instead of mono with the human and bot on their own channel. Adrian Cowham 2024-10-03 14:10:03 -07:00
  • 2d82702e04 merge from main Adrian Cowham 2024-10-03 09:42:06 -07:00
  • 27dcf83f37 Merge pull request #543 from pipecat-ai/mb/fix-deepgram-stt-language Mark Backman 2024-10-03 12:40:27 -04:00
  • 72db83528d Update changelog Mark Backman 2024-10-03 12:37:26 -04:00
  • 45c7d36b2e Deepgram: disconnect and reconnect on language change Mark Backman 2024-10-03 12:31:42 -04:00
  • 65eeb0f1f6 Merge pull request #540 from pipecat-ai/cb/interruption-fix v0.0.42 Aleix Conchillo Flaqué 2024-10-02 13:46:52 -07:00
  • 1d7d0bb1ea Merge pull request #539 from pipecat-ai/aleix/pipecat-0.0.42-fixes Aleix Conchillo Flaqué 2024-10-02 13:34:28 -07:00
  • 598936bc53 services: apply service language code before using service Aleix Conchillo Flaqué 2024-10-02 13:30:01 -07:00
  • b1bf6f7733 fixed botinterruptionframe Chad Bailey 2024-10-02 19:43:51 +00:00
  • 75d27aeb9f examples(storytelling): update packages Aleix Conchillo Flaqué 2024-10-02 12:00:00 -07:00
  • 0a37caf4b4 openai: fix image json logging Aleix Conchillo Flaqué 2024-10-02 11:57:50 -07:00
  • 6db65f4335 cartesia: use model_name instead of model_id Aleix Conchillo Flaqué 2024-10-02 11:57:36 -07:00
  • 3648874301 gladia: fix languages Aleix Conchillo Flaqué 2024-10-02 11:57:25 -07:00
  • 8bcb5d7fd2 services: async generators should yield frames Aleix Conchillo Flaqué 2024-10-02 11:57:08 -07:00
  • 8c01a900cd google: allow using GOOGLE_APPLICATION_CREDENTIALS Aleix Conchillo Flaqué 2024-10-02 11:56:01 -07:00
  • d378e699d2 Merge pull request #538 from Allenmylath/patch-2 Mark Backman 2024-10-02 12:53:50 -04:00
  • c25c375c41 Merge pull request #537 from pipecat-ai/mb/fix-nested-strings Mark Backman 2024-10-02 12:39:00 -04:00
  • 70c3ff31fd Update env.example Allenmylath 2024-10-02 21:59:51 +05:30
  • cd2e29f285 Fix nested strings issue Mark Backman 2024-10-02 12:26:30 -04:00
  • 6d4d7d763d Merge pull request #534 from pipecat-ai/aleix/prepare-0.0.42 Aleix Conchillo Flaqué 2024-10-02 08:36:32 -07:00
  • 6c1851eef8 update CHANGELOG for 0.0.42 Aleix Conchillo Flaqué 2024-10-01 14:22:35 -07:00
  • 096a15eef6 Merge pull request #527 from pipecat-ai/mb/google-tts-inputs Mark Backman 2024-10-02 11:13:25 -04:00
  • 3d642df2b0 Revert aligning voice_id name in TTS service constructor Mark Backman 2024-10-02 11:07:48 -04:00
  • d75a02dc51 Use Language enum and set languages accordingly Mark Backman 2024-10-01 21:01:44 -04:00
  • 28643b453d Update to use LLM, STT, TTS subclasses and remove setter methods Mark Backman 2024-10-01 14:37:07 -04:00
  • d5635de5f6 add new lines and unicode to JSON debug logs Nasr Maswood 2024-10-01 13:31:58 -04:00
  • 88cca7bf68 Consolidate service UpdateSettingsFrame into a single ServiceUpdateSettingsFrame Mark Backman 2024-10-01 10:35:59 -04:00
  • a397b859fe Add support for gender and google_style inputs to Google TTS Mark Backman 2024-09-30 15:47:41 -04:00
  • 8aae4e9856 Merge pull request #531 from pipecat-ai/khk/function-calling-improvements Kwindla Hultman Kramer 2024-10-01 07:23:38 -07:00
  • 92d8b37229 implement vision for openai Kwindla Hultman Kramer 2024-09-30 21:49:29 -07:00
  • 0801fc578b Merge pull request #530 from pipecat-ai/khk/tts-say-fix Kwindla Hultman Kramer 2024-09-30 20:59:53 -07:00
  • 0d5cb84531 function calling testing and improvements Kwindla Hultman Kramer 2024-09-30 20:59:28 -07:00
  • 47b943a117 Merge pull request #522 from pipecat-ai/rebase-openai-multi-function-call Kwindla Hultman Kramer 2024-09-30 16:23:37 -07:00
  • 128355add5 fix for multi-sentence tts say utterances Kwindla Hultman Kramer 2024-09-30 16:19:31 -07:00
  • 0499fe41e4 get rid of some debug log lines used during development Kwindla Hultman Kramer 2024-09-29 21:12:09 -07:00
  • 6ad3437fd2 throw error if the llm tries to call a function that's not registered Kwindla Hultman Kramer 2024-09-29 21:10:21 -07:00
  • a5c73ec829 handle openai multiple function calls Kwindla Hultman Kramer 2024-09-29 21:03:59 -07:00
  • def04ac0ce openai can give multiple tool calls, current implementation assumes only one function call at a time. Fixed this to handle multiple function calls. JeevanReddy 2024-08-07 13:07:18 +05:30
  • 5d63615b1b Merge pull request #528 from pipecat-ai/khk/sentence-splits Kwindla Hultman Kramer 2024-09-30 16:07:21 -07:00
  • 90ee284fe0 Merge pull request #520 from pipecat-ai/khk/context-frame-push Kwindla Hultman Kramer 2024-09-30 16:06:54 -07:00
  • 539e0b66fb small fix as per aleix Kwindla Hultman Kramer 2024-09-30 09:26:06 -07:00
  • fef393dcac assistant aggregator switch for space padding or not Kwindla Hultman Kramer 2024-09-29 14:11:17 -07:00
  • ed607d5c4b typo fix Kwindla Hultman Kramer 2024-09-28 22:02:33 -07:00
  • 37da7e44cd whitespace fix Kwindla Hultman Kramer 2024-09-28 22:01:40 -07:00
  • 69c7edd60c pushing context frames from assistant aggregators Kwindla Hultman Kramer 2024-09-28 21:37:03 -07:00
  • 392f210371 Merge pull request #524 from pipecat-ai/aleix/everything-is-async Aleix Conchillo Flaqué 2024-09-30 15:59:03 -07:00
  • 9a63df1ea1 Merge pull request #529 from pipecat-ai/mb/daily-python-0-11-0 Mark Backman 2024-09-30 18:29:27 -04:00
  • f8a75cede9 Update daily-python to 0.11.0 Mark Backman 2024-09-30 18:22:38 -04:00
  • 4d1e370e02 pipeline(task): since everything is async tasks should wait for EndFrame Aleix Conchillo Flaqué 2024-09-30 11:56:59 -07:00
  • d080a31a5c tests: fix langchanin tests Aleix Conchillo Flaqué 2024-09-30 11:37:26 -07:00
  • a90ebdfe7c syncparallelpipeline: fix now that all frames are asynchronous Aleix Conchillo Flaqué 2024-09-30 11:36:59 -07:00
  • c8995b82e5 all frame processors are asynchrnous Aleix Conchillo Flaqué 2024-09-30 10:05:56 -07:00
  • 9cd7c82e77 testing pushing a frame from function call start hook async-rebase-openai-multi-function-call Kwindla Hultman Kramer 2024-09-30 14:52:18 -07:00
  • 43161c816e get rid of some debug log lines used during development Kwindla Hultman Kramer 2024-09-29 21:12:09 -07:00
  • 6644c06af1 throw error if the llm tries to call a function that's not registered Kwindla Hultman Kramer 2024-09-29 21:10:21 -07:00
  • ed47212e07 handle openai multiple function calls Kwindla Hultman Kramer 2024-09-29 21:03:59 -07:00
  • db9cb74364 openai can give multiple tool calls, current implementation assumes only one function call at a time. Fixed this to handle multiple function calls. JeevanReddy 2024-08-07 13:07:18 +05:30
  • 6b7f924af6 tts sentence aggregation fix Kwindla Hultman Kramer 2024-09-30 14:33:08 -07:00
  • f64902eb25 pipeline(task): since everything is async tasks should wait for EndFrame Aleix Conchillo Flaqué 2024-09-30 11:56:59 -07:00
  • e115a274d6 tests: fix langchanin tests Aleix Conchillo Flaqué 2024-09-30 11:37:26 -07:00
  • 00239c2fd4 syncparallelpipeline: fix now that all frames are asynchronous Aleix Conchillo Flaqué 2024-09-30 11:36:59 -07:00
  • c0f9ad19fe all frame processors are asynchrnous Aleix Conchillo Flaqué 2024-09-30 10:05:56 -07:00
  • 51580e5349 Merge pull request #526 from pipecat-ai/mb/google-tts-lang-update Mark Backman 2024-09-30 15:32:43 -04:00
  • ed49cebf2c Set Google TTS default language to en-US Mark Backman 2024-09-30 15:16:46 -04:00
  • 46ac76701e Merge pull request #517 from pipecat-ai/mb/update-settings-frame Mark Backman 2024-09-30 12:56:45 -04:00
  • 1f77863aef Code review feedback Mark Backman 2024-09-30 12:45:32 -04:00
  • d7555609fd Add TTS update settings options Mark Backman 2024-09-27 11:57:50 -04:00
  • 7fe118ce63 Align use of language param across TTS services Mark Backman 2024-09-27 11:22:03 -04:00