Kwindla Hultman Kramer ab3bcde5f7 Merge pull request #907 from pipecat-ai/khk/gemini-20241221 ...

Gemini unary API fixes and natural conversation demo

2024-12-23 17:34:57 -08:00

..

assets

examples: fix 11-sound-effects

2024-12-10 18:25:43 -08:00

01-say-one-thing.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

01a-local-audio.py

examples(01a): remove unused import

2024-12-19 17:49:27 -08:00

01b-livekit-audio.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

01c-fastpitch.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

02-llm-say-one-thing.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

03-still-frame.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

03a-local-still-frame.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

04-utterance-and-speech.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

05-sync-speech-and-image.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

05a-local-sync-speech-and-image.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

06-listen-and-respond.py

transports(daily): make functions async

2024-10-25 15:01:52 -07:00

06a-image-sync.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07-interruptible-vad.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07-interruptible.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07a-interruptible-anthropic.py

Code review changes

2024-12-17 22:34:02 -05:00

07b-interruptible-langchain.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07c-interruptible-deepgram-vad.py

deepgram: add VAD event handlers

2024-12-04 19:31:09 -08:00

07c-interruptible-deepgram.py

examples: don't require room token if using an STT

2024-11-01 23:06:50 -07:00

07d-interruptible-elevenlabs.py

revert elevenlabs example changes

2024-12-23 17:33:59 -08:00

07e-interruptible-playht.py

examples(playht): use a 2.0 engine

2024-11-13 17:19:23 +01:00

07f-interruptible-azure.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07g-interruptible-openai-tts.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07h-interruptible-openpipe.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07i-interruptible-xtts.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07j-interruptible-gladia.py

transports(daily): make functions async

2024-10-25 15:01:52 -07:00

07k-interruptible-lmnt.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07l-interruptible-together.py

transports(daily): make functions async

2024-10-25 15:01:52 -07:00

07m-interruptible-polly.py

polly: renamed AWSTTSService to PollyTTSService

2024-12-11 17:56:43 -08:00

07n-interruptible-google.py

examples: don't require room token if using an STT

2024-11-01 23:06:50 -07:00

07o-interruptible-assemblyai.py

transports(daily): make functions async

2024-10-25 15:01:52 -07:00

07p-interruptible-krisp.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07q-interruptible-rime.py

Update changelog

2024-11-12 18:28:04 -05:00

07r-interruptible-riva-nim.py

riva: rename FastpitchTTSService to FastPitchTTSService

2024-12-10 13:30:43 -08:00

07s-interruptible-google-audio-in.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

07t-interruptible-fish.py

Add Fish Audio TTS service

2024-12-21 12:42:56 -05:00

08-bots-arguing.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

09-mirror.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

09a-local-mirror.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

10-wake-phrase.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

11-sound-effects.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

12-describe-video.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

12a-describe-video-gemini-flash.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

12b-describe-video-gpt-4o.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

12c-describe-video-anthropic.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

13-whisper-transcription.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

13a-whisper-local.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

13b-deepgram-transcription.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

13c-gladia-transcription.py

Revert "no longer necessary to call super().process_frame(frame, direction)"

2024-12-12 17:03:40 -08:00

13d-assemblyai-transcription.py

Revert "no longer necessary to call super().process_frame(frame, direction)"

2024-12-12 17:03:40 -08:00

14-function-calling.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

14a-function-calling-anthropic.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

14b-function-calling-anthropic-video.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

14c-function-calling-together.py

Add LLMService stubs for Grok and Groq, add examples

2024-12-04 10:08:28 -05:00

14d-function-calling-video.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

14e-function-calling-gemini.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

14f-function-calling-groq.py

Add LLMService stubs for Grok and Groq, add examples

2024-12-04 10:08:28 -05:00

14g-function-calling-grok.py

Add LLMService stubs for Grok and Groq, add examples

2024-12-04 10:08:28 -05:00

14h-function-calling-azure.py

Update AzureLLMService to use OpenAILLMService

2024-12-04 11:01:56 -05:00

14i-function-calling-fireworks.py

Update FireworksLLMService to use OpenAILLMService

2024-12-04 11:51:05 -05:00

14j-function-calling-nim.py

Add custom assistant context aggregator for Grok due to content requirement in function calling

2024-12-17 09:11:21 -05:00

14k-function-calling-cerebras.py

Add CerebrasLLMService and foundational example

2024-12-19 08:10:31 -05:00

15-switch-voices.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

15a-switch-languages.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

16-gpu-container-local-bot.py

transports(daily): make functions async

2024-10-25 15:01:52 -07:00

17-detect-user-idle.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

18-gstreamer-filesrc.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

18a-gstreamer-videotestsrc.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

19-openai-realtime-beta.py

transports(daily): make functions async

2024-10-25 15:01:52 -07:00

20a-persistent-context-openai.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

20b-persistent-context-openai-realtime.py

transports(daily): make functions async

2024-10-25 15:01:52 -07:00

20c-persistent-context-anthropic.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

20d-persistent-context-gemini.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

21-tavus-layer.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

22-natural-conversation.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

22b-natural-conversation-proposal.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

22c-natural-conversation-mixed-llms.py

Revert "no longer necessary to call super().process_frame(frame, direction)"

2024-12-12 17:03:40 -08:00

22d-natural-conversation-gemini-audio.py

feature complete gemini audio, transcription, and phrase endpointing demo

2024-12-22 11:19:02 -08:00

23-bot-background-sound.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

24-stt-mute-filter.py

Push FunctionCall Frames upstream and downstream; update example

2024-12-09 18:27:07 -05:00

25-google-audio-in.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

26-gemini-multimodal-live.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

26a-gemini-multimodal-live-transcription.py

Minor changes to demos

2024-12-11 11:23:59 -05:00

26b-gemini-multimodal-live-function-calling.py

Fix demo numbering and prompt the bot to say hi in 26b

2024-12-11 11:36:38 -05:00

26c-gemini-multimodal-live-video.py

Fix demo numbering and prompt the bot to say hi in 26b

2024-12-11 11:36:38 -05:00

27-simli-layer.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00

28a-transcription-processor-openai.py

Refactor TranscriptProcessor into user and assistant processors

2024-12-17 22:34:22 -05:00

28b-transcript-processor-anthropic.py

Refactor TranscriptProcessor into user and assistant processors

2024-12-17 22:34:22 -05:00

28c-transcription-processor-gemini.py

Refactor TranscriptProcessor into user and assistant processors

2024-12-17 22:34:22 -05:00

runner.py

fix ruff linter import organization

2024-12-17 11:28:58 -08:00